3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1668 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
11.7 MiB / 121612
Shuffle Write Size / Records:
8.8 MiB / 28520
Associated Job Ids:
1193
DAG Visualization
digraph G { subgraph clusterstage_1668 { label="Stage 1668"; subgraph cluster12143 { label="AQEShuffleRead"; 4941 [labelType="html" label="ShuffledRowRDD [4941] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster12140 { label="WholeStageCodegen (13)"; 4942 [labelType="html" label="MapPartitionsRDD [4942] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster12152 { label="AQEShuffleRead"; 4943 [labelType="html" label="ShuffledRowRDD [4943] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster12149 { label="WholeStageCodegen (14)"; 4944 [labelType="html" label="MapPartitionsRDD [4944] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster12157 { label="AQEShuffleRead"; 4945 [labelType="html" label="ShuffledRowRDD [4945] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster12154 { label="WholeStageCodegen (15)"; 4946 [labelType="html" label="MapPartitionsRDD [4946] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster12145 { label="WholeStageCodegen (16)"; 4947 [labelType="html" label="ZippedPartitionsRDD2 [4947] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 4948 [labelType="html" label="MapPartitionsRDD [4948] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster12136 { label="WholeStageCodegen (17)"; 4949 [labelType="html" label="ZippedPartitionsRDD2 [4949] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 4950 [labelType="html" label="MapPartitionsRDD [4950] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster12135 { label="Exchange"; 4951 [labelType="html" label="MapPartitionsRDD [4951] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 4941->4942; 4943->4944; 4945->4946; 4944->4947; 4946->4947; 4947->4948; 4942->4949; 4948->4949; 4949->4950; 4950->4951; }
4927,4941
4931,4943
4935,4945
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time