3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1059 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Any: 10
Shuffle Read Size / Records:
16.4 MiB / 695759
Shuffle Write Size / Records:
653.5 KiB / 602754
Associated Job Ids:
675
DAG Visualization
digraph G { subgraph clusterstage_1059 { label="Stage 1059"; subgraph cluster7318 { label="Exchange"; 3139 [labelType="html" label="ShuffledRowRDD [3139] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7314 { label="WholeStageCodegen (5)"; 3140 [labelType="html" label="MapPartitionsRDD [3140] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7329 { label="Exchange"; 3141 [labelType="html" label="ShuffledRowRDD [3141] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7325 { label="WholeStageCodegen (6)"; 3142 [labelType="html" label="MapPartitionsRDD [3142] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7324 { label="Window"; 3143 [labelType="html" label="MapPartitionsRDD [3143] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7320 { label="WholeStageCodegen (7)"; 3144 [labelType="html" label="MapPartitionsRDD [3144] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7310 { label="WholeStageCodegen (8)"; 3145 [labelType="html" label="ZippedPartitionsRDD2 [3145] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 3146 [labelType="html" label="MapPartitionsRDD [3146] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7309 { label="Exchange"; 3147 [labelType="html" label="MapPartitionsRDD [3147] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 3139->3140; 3141->3142; 3142->3143; 3143->3144; 3140->3145; 3144->3145; 3145->3146; 3146->3147; }
3138,3139
3113,3141
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time