3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1722 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
87 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
416.0 KiB / 21566
Shuffle Write Size / Records:
342.8 KiB / 21127
Associated Job Ids:
1124
DAG Visualization
digraph G { subgraph clusterstage_1722 { label="Stage 1722"; subgraph cluster13432 { label="AQEShuffleRead"; 6796 [labelType="html" label="ShuffledRowRDD [6796] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13429 { label="WholeStageCodegen (5)"; 6797 [labelType="html" label="MapPartitionsRDD [6797] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13438 { label="AQEShuffleRead"; 6798 [labelType="html" label="ShuffledRowRDD [6798] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13437 { label="ObjectHashAggregate"; 6799 [labelType="html" label="MapPartitionsRDD [6799] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13434 { label="WholeStageCodegen (6)"; 6800 [labelType="html" label="MapPartitionsRDD [6800] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13425 { label="WholeStageCodegen (7)"; 6801 [labelType="html" label="ZippedPartitionsRDD2 [6801] [Unordered]<br>count at ColumnStatJob.java:47"]; 6802 [labelType="html" label="MapPartitionsRDD [6802] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13424 { label="Exchange"; 6803 [labelType="html" label="MapPartitionsRDD [6803] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 6796->6797; 6798->6799; 6799->6800; 6797->6801; 6800->6801; 6801->6802; 6802->6803; }
6777,6796
6782,6798
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time