3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1994 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
7.0 MiB / 102662
Shuffle Write Size / Records:
8.2 MiB / 102689
Associated Job Ids:
1333
DAG Visualization
digraph G { subgraph clusterstage_1994 { label="Stage 1994"; subgraph cluster11655 { label="AQEShuffleRead"; 4637 [labelType="html" label="ShuffledRowRDD [4637] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster11652 { label="WholeStageCodegen (12)"; 4638 [labelType="html" label="MapPartitionsRDD [4638] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster11660 { label="AQEShuffleRead"; 4639 [labelType="html" label="ShuffledRowRDD [4639] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster11657 { label="WholeStageCodegen (13)"; 4640 [labelType="html" label="MapPartitionsRDD [4640] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster11643 { label="WholeStageCodegen (14)"; 4641 [labelType="html" label="ZippedPartitionsRDD2 [4641] [Unordered]<br>parquet at PersistJob.java:35"]; 4642 [labelType="html" label="MapPartitionsRDD [4642] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster11642 { label="Exchange"; 4643 [labelType="html" label="MapPartitionsRDD [4643] [Unordered]<br>parquet at PersistJob.java:35"]; } } 4637->4638; 4639->4640; 4638->4641; 4640->4641; 4641->4642; 4642->4643; }
4596,4637
4603,4639
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time