3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1034 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
14 s
Locality Level Summary:
Any: 10
Shuffle Read Size / Records:
107.1 MiB / 695759
Shuffle Write Size / Records:
104.6 MiB / 602754
Associated Job Ids:
663
DAG Visualization
digraph G { subgraph clusterstage_1034 { label="Stage 1034"; subgraph cluster7180 { label="Exchange"; 3076 [labelType="html" label="ShuffledRowRDD [3076] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7176 { label="WholeStageCodegen (5)"; 3077 [labelType="html" label="MapPartitionsRDD [3077] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7191 { label="Exchange"; 3078 [labelType="html" label="ShuffledRowRDD [3078] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7187 { label="WholeStageCodegen (6)"; 3079 [labelType="html" label="MapPartitionsRDD [3079] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7186 { label="Window"; 3080 [labelType="html" label="MapPartitionsRDD [3080] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7182 { label="WholeStageCodegen (7)"; 3081 [labelType="html" label="MapPartitionsRDD [3081] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7171 { label="WholeStageCodegen (8)"; 3082 [labelType="html" label="ZippedPartitionsRDD2 [3082] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 3083 [labelType="html" label="MapPartitionsRDD [3083] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7170 { label="Exchange"; 3084 [labelType="html" label="MapPartitionsRDD [3084] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 3076->3077; 3078->3079; 3079->3080; 3080->3081; 3077->3082; 3081->3082; 3082->3083; 3083->3084; }
3075,3076
3070,3078
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time