3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 4 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
15 s
Locality Level Summary:
Any: 1
Output Size / Records:
91.4 MiB / 2401930
Shuffle Read Size / Records:
86.0 MiB / 2401931
Associated Job Ids:
3
DAG Visualization
digraph G { subgraph clusterstage_4 { label="Stage 4"; subgraph cluster46 { label="AQEShuffleRead"; 26 [labelType="html" label="ShuffledRowRDD [26] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster43 { label="WholeStageCodegen (2)"; 27 [labelType="html" label="MapPartitionsRDD [27] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster42 { label="Window"; 28 [labelType="html" label="MapPartitionsRDD [28] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster38 { label="WholeStageCodegen (3)"; 29 [labelType="html" label="MapPartitionsRDD [29] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster37 { label="Window"; 30 [labelType="html" label="MapPartitionsRDD [30] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster36 { label="WriteFiles"; 31 [labelType="html" label="MapPartitionsRDD [31] [Unordered]<br>parquet at PersistJob.java:35"]; } } 26->27; 27->28; 28->29; 29->30; 30->31; }
25,26
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time