3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1271 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
154.0 B / 5
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
962
DAG Visualization
digraph G { subgraph clusterstage_1271 { label="Stage 1271"; subgraph cluster9262 { label="AQEShuffleRead"; 3835 [labelType="html" label="ShuffledRowRDD [3835] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9259 { label="WholeStageCodegen (3)"; 3836 [labelType="html" label="MapPartitionsRDD [3836] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9267 { label="AQEShuffleRead"; 3837 [labelType="html" label="ShuffledRowRDD [3837] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9264 { label="WholeStageCodegen (4)"; 3838 [labelType="html" label="MapPartitionsRDD [3838] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9254 { label="WholeStageCodegen (5)"; 3839 [labelType="html" label="ZippedPartitionsRDD2 [3839] [Unordered]<br>count at ColumnStatJob.java:47"]; 3840 [labelType="html" label="MapPartitionsRDD [3840] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9253 { label="Exchange"; 3841 [labelType="html" label="MapPartitionsRDD [3841] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 3835->3836; 3837->3838; 3836->3839; 3838->3839; 3839->3840; 3840->3841; }
3830,3835
3834,3837
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time