3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1078 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Output Size / Records:
276.8 KiB / 1455
Shuffle Read Size / Records:
584.6 KiB / 2455
Associated Job Ids:
688
DAG Visualization
digraph G { subgraph clusterstage_1078 { label="Stage 1078"; subgraph cluster7276 { label="AQEShuffleRead"; 3061 [labelType="html" label="ShuffledRowRDD [3061] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster7273 { label="WholeStageCodegen (8)"; 3062 [labelType="html" label="MapPartitionsRDD [3062] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster7281 { label="AQEShuffleRead"; 3063 [labelType="html" label="ShuffledRowRDD [3063] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster7278 { label="WholeStageCodegen (9)"; 3064 [labelType="html" label="MapPartitionsRDD [3064] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster7269 { label="WholeStageCodegen (10)"; 3065 [labelType="html" label="ZippedPartitionsRDD2 [3065] [Unordered]<br>parquet at PersistJob.java:35"]; 3066 [labelType="html" label="MapPartitionsRDD [3066] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster7268 { label="WriteFiles"; 3067 [labelType="html" label="MapPartitionsRDD [3067] [Unordered]<br>parquet at PersistJob.java:35"]; } } 3061->3062; 3063->3064; 3062->3065; 3064->3065; 3065->3066; 3066->3067; }
3057,3061
3060,3063
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time