3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1676 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 2
Shuffle Read Size / Records:
9.0 MiB / 31520
Shuffle Write Size / Records:
504.5 KiB / 3000
Associated Job Ids:
1195
DAG Visualization
digraph G { subgraph clusterstage_1676 { label="Stage 1676"; subgraph cluster12172 { label="AQEShuffleRead"; 4955 [labelType="html" label="ShuffledRowRDD [4955] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster12169 { label="WholeStageCodegen (19)"; 4956 [labelType="html" label="MapPartitionsRDD [4956] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster12177 { label="AQEShuffleRead"; 4957 [labelType="html" label="ShuffledRowRDD [4957] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster12174 { label="WholeStageCodegen (20)"; 4958 [labelType="html" label="MapPartitionsRDD [4958] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster12164 { label="WholeStageCodegen (21)"; 4959 [labelType="html" label="ZippedPartitionsRDD2 [4959] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 4960 [labelType="html" label="MapPartitionsRDD [4960] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster12163 { label="Exchange"; 4961 [labelType="html" label="MapPartitionsRDD [4961] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 4955->4956; 4957->4958; 4956->4959; 4958->4959; 4959->4960; 4960->4961; }
4923,4955
4951,4957
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time