3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2457 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
40 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
2.5 KiB / 36
Associated Job Ids:
1612
DAG Visualization
digraph G { subgraph clusterstage_2457 { label="Stage 2457"; subgraph cluster16113 { label="AQEShuffleRead"; 6774 [labelType="html" label="ShuffledRowRDD [6774] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16102 { label="WholeStageCodegen (4)"; 6779 [labelType="html" label="MapPartitionsRDD [6779] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16130 { label="AQEShuffleRead"; 6782 [labelType="html" label="ShuffledRowRDD [6782] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16121 { label="WholeStageCodegen (5)"; 6784 [labelType="html" label="MapPartitionsRDD [6784] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16098 { label="WholeStageCodegen (6)"; 6786 [labelType="html" label="ZippedPartitionsRDD2 [6786] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 6790 [labelType="html" label="MapPartitionsRDD [6790] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16146 { label="AQEShuffleRead"; 6792 [labelType="html" label="ShuffledRowRDD [6792] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16135 { label="WholeStageCodegen (7)"; 6795 [labelType="html" label="MapPartitionsRDD [6795] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16084 { label="WholeStageCodegen (8)"; 6798 [labelType="html" label="ZippedPartitionsRDD2 [6798] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 6801 [labelType="html" label="MapPartitionsRDD [6801] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16153 { label="mapPartitionsInternal"; 6802 [labelType="html" label="MapPartitionsRDD [6802] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 6774->6779; 6782->6784; 6779->6786; 6784->6786; 6786->6790; 6792->6795; 6790->6798; 6795->6798; 6798->6801; 6801->6802; }
6725,6774
6737,6782
6749,6792
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time