3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1980 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
84 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
7.8 KiB / 500
Shuffle Write Size / Records:
3.5 KiB / 177
Associated Job Ids:
1327
DAG Visualization
digraph G { subgraph clusterstage_1980 { label="Stage 1980"; subgraph cluster11574 { label="AQEShuffleRead"; 4597 [labelType="html" label="ShuffledRowRDD [4597] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster11571 { label="WholeStageCodegen (9)"; 4598 [labelType="html" label="MapPartitionsRDD [4598] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster11579 { label="AQEShuffleRead"; 4599 [labelType="html" label="ShuffledRowRDD [4599] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster11576 { label="WholeStageCodegen (10)"; 4600 [labelType="html" label="MapPartitionsRDD [4600] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster11567 { label="WholeStageCodegen (11)"; 4601 [labelType="html" label="ZippedPartitionsRDD2 [4601] [Unordered]<br>parquet at PersistJob.java:35"]; 4602 [labelType="html" label="MapPartitionsRDD [4602] [Unordered]<br>parquet at PersistJob.java:35"]; } subgraph cluster11566 { label="Exchange"; 4603 [labelType="html" label="MapPartitionsRDD [4603] [Unordered]<br>parquet at PersistJob.java:35"]; } } 4597->4598; 4599->4600; 4598->4601; 4600->4601; 4601->4602; 4602->4603; }
4573,4597
4577,4599
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time