3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 2291 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
16 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
7.8 KiB / 500
Shuffle Write Size / Records:
3.5 KiB / 177
Associated Job Ids:
1427
DAG Visualization
digraph G { subgraph clusterstage_2291 { label="Stage 2291"; subgraph cluster12896 { label="AQEShuffleRead"; 5160 [labelType="html" label="ShuffledRowRDD [5160] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster12893 { label="WholeStageCodegen (6)"; 5161 [labelType="html" label="MapPartitionsRDD [5161] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster12901 { label="AQEShuffleRead"; 5162 [labelType="html" label="ShuffledRowRDD [5162] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster12898 { label="WholeStageCodegen (7)"; 5163 [labelType="html" label="MapPartitionsRDD [5163] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster12889 { label="WholeStageCodegen (8)"; 5164 [labelType="html" label="ZippedPartitionsRDD2 [5164] [Unordered]<br>rdd at PersistJob.java:28"]; 5165 [labelType="html" label="MapPartitionsRDD [5165] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster12888 { label="Exchange"; 5166 [labelType="html" label="MapPartitionsRDD [5166] [Unordered]<br>rdd at PersistJob.java:28"]; } } 5160->5161; 5162->5163; 5161->5164; 5163->5164; 5164->5165; 5165->5166; }
5155,5160
5159,5162
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time