3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 2285 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
4.4 MiB / 102485
Shuffle Write Size / Records:
7.0 MiB / 102485
Associated Job Ids:
1423
DAG Visualization
digraph G { subgraph clusterstage_2285 { label="Stage 2285"; subgraph cluster12856 { label="AQEShuffleRead"; 5134 [labelType="html" label="ShuffledRowRDD [5134] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster12853 { label="WholeStageCodegen (9)"; 5135 [labelType="html" label="MapPartitionsRDD [5135] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster12852 { label="Window"; 5136 [labelType="html" label="MapPartitionsRDD [5136] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster12848 { label="WholeStageCodegen (10)"; 5137 [labelType="html" label="MapPartitionsRDD [5137] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster12847 { label="Window"; 5138 [labelType="html" label="MapPartitionsRDD [5138] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster12840 { label="WholeStageCodegen (11)"; 5139 [labelType="html" label="MapPartitionsRDD [5139] [Unordered]<br>rdd at PersistJob.java:28"]; } subgraph cluster12839 { label="Exchange"; 5140 [labelType="html" label="MapPartitionsRDD [5140] [Unordered]<br>rdd at PersistJob.java:28"]; } } 5134->5135; 5135->5136; 5136->5137; 5137->5138; 5138->5139; 5139->5140; }
5111,5134
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time