3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1118 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
13 s
Locality Level Summary:
Any: 10
Shuffle Read Size / Records:
107.1 MiB / 695759
Shuffle Write Size / Records:
104.6 MiB / 602754
Associated Job Ids:
695
DAG Visualization
digraph G { subgraph clusterstage_1118 { label="Stage 1118"; subgraph cluster7587 { label="Exchange"; 3249 [labelType="html" label="ShuffledRowRDD [3249] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7583 { label="WholeStageCodegen (5)"; 3250 [labelType="html" label="MapPartitionsRDD [3250] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7598 { label="Exchange"; 3251 [labelType="html" label="ShuffledRowRDD [3251] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7594 { label="WholeStageCodegen (6)"; 3252 [labelType="html" label="MapPartitionsRDD [3252] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7593 { label="Window"; 3253 [labelType="html" label="MapPartitionsRDD [3253] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7589 { label="WholeStageCodegen (7)"; 3254 [labelType="html" label="MapPartitionsRDD [3254] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7578 { label="WholeStageCodegen (8)"; 3255 [labelType="html" label="ZippedPartitionsRDD2 [3255] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 3256 [labelType="html" label="MapPartitionsRDD [3256] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7577 { label="Exchange"; 3257 [labelType="html" label="MapPartitionsRDD [3257] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 3249->3250; 3251->3252; 3252->3253; 3253->3254; 3250->3255; 3254->3255; 3255->3256; 3256->3257; }
3248,3249
3215,3251
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time