3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1473 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1511.0 KiB / 134184
Shuffle Write Size / Records:
3.5 KiB / 139
Associated Job Ids:
876
DAG Visualization
digraph G { subgraph clusterstage_1473 { label="Stage 1473"; subgraph cluster9803 { label="AQEShuffleRead"; 4146 [labelType="html" label="ShuffledRowRDD [4146] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9800 { label="WholeStageCodegen (3)"; 4147 [labelType="html" label="MapPartitionsRDD [4147] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9813 { label="AQEShuffleRead"; 4148 [labelType="html" label="ShuffledRowRDD [4148] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9810 { label="WholeStageCodegen (4)"; 4149 [labelType="html" label="MapPartitionsRDD [4149] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9809 { label="Window"; 4150 [labelType="html" label="MapPartitionsRDD [4150] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9805 { label="WholeStageCodegen (5)"; 4151 [labelType="html" label="MapPartitionsRDD [4151] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9794 { label="WholeStageCodegen (6)"; 4152 [labelType="html" label="ZippedPartitionsRDD2 [4152] [Unordered]<br>count at ColumnStatJob.java:47"]; 4153 [labelType="html" label="MapPartitionsRDD [4153] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9793 { label="Exchange"; 4154 [labelType="html" label="MapPartitionsRDD [4154] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 4146->4147; 4148->4149; 4149->4150; 4150->4151; 4147->4152; 4151->4152; 4152->4153; 4153->4154; }
4121,4146
4125,4148
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time