3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1485 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1511.0 KiB / 134184
Shuffle Write Size / Records:
4.2 KiB / 139
Associated Job Ids:
879
DAG Visualization
digraph G { subgraph clusterstage_1485 { label="Stage 1485"; subgraph cluster9860 { label="AQEShuffleRead"; 4161 [labelType="html" label="ShuffledRowRDD [4161] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9857 { label="WholeStageCodegen (3)"; 4162 [labelType="html" label="MapPartitionsRDD [4162] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9870 { label="AQEShuffleRead"; 4163 [labelType="html" label="ShuffledRowRDD [4163] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9867 { label="WholeStageCodegen (4)"; 4164 [labelType="html" label="MapPartitionsRDD [4164] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9866 { label="Window"; 4165 [labelType="html" label="MapPartitionsRDD [4165] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9862 { label="WholeStageCodegen (5)"; 4166 [labelType="html" label="MapPartitionsRDD [4166] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9851 { label="WholeStageCodegen (6)"; 4167 [labelType="html" label="ZippedPartitionsRDD2 [4167] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 4168 [labelType="html" label="MapPartitionsRDD [4168] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9850 { label="Exchange"; 4169 [labelType="html" label="MapPartitionsRDD [4169] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 4161->4162; 4163->4164; 4164->4165; 4165->4166; 4162->4167; 4166->4167; 4167->4168; 4168->4169; }
4141,4161
4145,4163
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time