3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 2384 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
15 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
7.8 KiB / 500
Shuffle Write Size / Records:
3.5 KiB / 177
Associated Job Ids:
1447
DAG Visualization
digraph G { subgraph clusterstage_2384 { label="Stage 2384"; subgraph cluster13220 { label="AQEShuffleRead"; 5279 [labelType="html" label="ShuffledRowRDD [5279] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster13217 { label="WholeStageCodegen (6)"; 5280 [labelType="html" label="MapPartitionsRDD [5280] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster13225 { label="AQEShuffleRead"; 5281 [labelType="html" label="ShuffledRowRDD [5281] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster13222 { label="WholeStageCodegen (7)"; 5282 [labelType="html" label="MapPartitionsRDD [5282] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster13213 { label="WholeStageCodegen (8)"; 5283 [labelType="html" label="ZippedPartitionsRDD2 [5283] [Unordered]<br>parquet at PersistJob.java:35"]; 5284 [labelType="html" label="MapPartitionsRDD [5284] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster13212 { label="Exchange"; 5285 [labelType="html" label="MapPartitionsRDD [5285] [Unordered]<br>parquet at PersistJob.java:35"]; } } 5279->5280; 5281->5282; 5280->5283; 5282->5283; 5283->5284; 5284->5285; }
5274,5279
5278,5281
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time