3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1070 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Any: 10
Shuffle Read Size / Records:
16.4 MiB / 695759
Shuffle Write Size / Records:
653.5 KiB / 602754
Associated Job Ids:
678
DAG Visualization
digraph G { subgraph clusterstage_1070 { label="Stage 1070"; subgraph cluster7360 { label="Exchange"; 3159 [labelType="html" label="ShuffledRowRDD [3159] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7356 { label="WholeStageCodegen (5)"; 3160 [labelType="html" label="MapPartitionsRDD [3160] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7371 { label="Exchange"; 3161 [labelType="html" label="ShuffledRowRDD [3161] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7367 { label="WholeStageCodegen (6)"; 3162 [labelType="html" label="MapPartitionsRDD [3162] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7366 { label="Window"; 3163 [labelType="html" label="MapPartitionsRDD [3163] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7362 { label="WholeStageCodegen (7)"; 3164 [labelType="html" label="MapPartitionsRDD [3164] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7352 { label="WholeStageCodegen (8)"; 3165 [labelType="html" label="ZippedPartitionsRDD2 [3165] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 3166 [labelType="html" label="MapPartitionsRDD [3166] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7351 { label="Exchange"; 3167 [labelType="html" label="MapPartitionsRDD [3167] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 3159->3160; 3161->3162; 3162->3163; 3163->3164; 3160->3165; 3164->3165; 3165->3166; 3166->3167; }
3152,3159
3133,3161
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time