3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1377 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1534.3 KiB / 134184
Shuffle Write Size / Records:
5.4 KiB / 197
Associated Job Ids:
827
DAG Visualization
digraph G { subgraph clusterstage_1377 { label="Stage 1377"; subgraph cluster9200 { label="AQEShuffleRead"; 3891 [labelType="html" label="ShuffledRowRDD [3891] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9197 { label="WholeStageCodegen (3)"; 3892 [labelType="html" label="MapPartitionsRDD [3892] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9210 { label="AQEShuffleRead"; 3893 [labelType="html" label="ShuffledRowRDD [3893] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9207 { label="WholeStageCodegen (4)"; 3894 [labelType="html" label="MapPartitionsRDD [3894] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9206 { label="Window"; 3895 [labelType="html" label="MapPartitionsRDD [3895] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9202 { label="WholeStageCodegen (5)"; 3896 [labelType="html" label="MapPartitionsRDD [3896] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9191 { label="WholeStageCodegen (6)"; 3897 [labelType="html" label="ZippedPartitionsRDD2 [3897] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 3898 [labelType="html" label="MapPartitionsRDD [3898] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9190 { label="Exchange"; 3899 [labelType="html" label="MapPartitionsRDD [3899] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 3891->3892; 3893->3894; 3894->3895; 3895->3896; 3892->3897; 3896->3897; 3897->3898; 3898->3899; }
3871,3891
3875,3893
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time