3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1642 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
967.1 KiB / 98222
Shuffle Write Size / Records:
96.1 KiB / 72488
Associated Job Ids:
1185
DAG Visualization
digraph G { subgraph clusterstage_1642 { label="Stage 1642"; subgraph cluster12002 { label="AQEShuffleRead"; 4892 [labelType="html" label="ShuffledRowRDD [4892] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster11999 { label="WholeStageCodegen (18)"; 4893 [labelType="html" label="MapPartitionsRDD [4893] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster12007 { label="AQEShuffleRead"; 4894 [labelType="html" label="ShuffledRowRDD [4894] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster12004 { label="WholeStageCodegen (19)"; 4895 [labelType="html" label="MapPartitionsRDD [4895] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster11995 { label="WholeStageCodegen (20)"; 4896 [labelType="html" label="ZippedPartitionsRDD2 [4896] [Unordered]<br>count at ColumnStatJob.java:47"]; 4897 [labelType="html" label="MapPartitionsRDD [4897] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster11994 { label="Exchange"; 4898 [labelType="html" label="MapPartitionsRDD [4898] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 4892->4893; 4894->4895; 4893->4896; 4895->4896; 4896->4897; 4897->4898; }
4864,4892
4888,4894
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time