3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 593 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
41 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
465.6 KiB / 2559
Shuffle Write Size / Records:
534.2 KiB / 1455
Associated Job Ids:
389
DAG Visualization
digraph G { subgraph clusterstage_593 { label="Stage 593"; subgraph cluster4095 { label="AQEShuffleRead"; 1798 [labelType="html" label="ShuffledRowRDD [1798] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4092 { label="WholeStageCodegen (4)"; 1799 [labelType="html" label="MapPartitionsRDD [1799] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4100 { label="AQEShuffleRead"; 1800 [labelType="html" label="ShuffledRowRDD [1800] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4097 { label="WholeStageCodegen (5)"; 1801 [labelType="html" label="MapPartitionsRDD [1801] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4087 { label="WholeStageCodegen (6)"; 1802 [labelType="html" label="ZippedPartitionsRDD2 [1802] [Unordered]<br>count at ColumnStatJob.java:47"]; 1803 [labelType="html" label="MapPartitionsRDD [1803] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4086 { label="Exchange"; 1804 [labelType="html" label="MapPartitionsRDD [1804] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 1798->1799; 1800->1801; 1799->1802; 1801->1802; 1802->1803; 1803->1804; }
1789,1798
1793,1800
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time