3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1020 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 5
Shuffle Read Size / Records:
5.5 MiB / 695759
Shuffle Write Size / Records:
295.0 B / 5
Associated Job Ids:
656
DAG Visualization
digraph G { subgraph clusterstage_1020 { label="Stage 1020"; subgraph cluster7092 { label="AQEShuffleRead"; 3039 [labelType="html" label="ShuffledRowRDD [3039] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster7089 { label="WholeStageCodegen (3)"; 3040 [labelType="html" label="MapPartitionsRDD [3040] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster7102 { label="AQEShuffleRead"; 3041 [labelType="html" label="ShuffledRowRDD [3041] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster7099 { label="WholeStageCodegen (4)"; 3042 [labelType="html" label="MapPartitionsRDD [3042] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster7098 { label="Window"; 3043 [labelType="html" label="MapPartitionsRDD [3043] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster7094 { label="WholeStageCodegen (5)"; 3044 [labelType="html" label="MapPartitionsRDD [3044] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster7084 { label="WholeStageCodegen (6)"; 3045 [labelType="html" label="ZippedPartitionsRDD2 [3045] [Unordered]<br>count at ColumnStatJob.java:47"]; 3046 [labelType="html" label="MapPartitionsRDD [3046] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster7083 { label="Exchange"; 3047 [labelType="html" label="MapPartitionsRDD [3047] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 3039->3040; 3041->3042; 3042->3043; 3043->3044; 3040->3045; 3044->3045; 3045->3046; 3046->3047; }
3034,3039
3038,3041
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time