3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1858 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
95 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
425.1 KiB / 22030
Shuffle Write Size / Records:
3.2 KiB / 247
Associated Job Ids:
1178
DAG Visualization
digraph G { subgraph clusterstage_1858 { label="Stage 1858"; subgraph cluster14235 { label="AQEShuffleRead"; 7177 [labelType="html" label="ShuffledRowRDD [7177] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster14234 { label="ObjectHashAggregate"; 7178 [labelType="html" label="MapPartitionsRDD [7178] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster14230 { label="WholeStageCodegen (8)"; 7179 [labelType="html" label="MapPartitionsRDD [7179] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster14244 { label="AQEShuffleRead"; 7180 [labelType="html" label="ShuffledRowRDD [7180] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster14241 { label="WholeStageCodegen (5)"; 7181 [labelType="html" label="MapPartitionsRDD [7181] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster14250 { label="AQEShuffleRead"; 7182 [labelType="html" label="ShuffledRowRDD [7182] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster14249 { label="ObjectHashAggregate"; 7183 [labelType="html" label="MapPartitionsRDD [7183] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster14246 { label="WholeStageCodegen (6)"; 7184 [labelType="html" label="MapPartitionsRDD [7184] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster14237 { label="WholeStageCodegen (7)"; 7185 [labelType="html" label="ZippedPartitionsRDD2 [7185] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 7186 [labelType="html" label="MapPartitionsRDD [7186] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster14225 { label="WholeStageCodegen (9)"; 7187 [labelType="html" label="ZippedPartitionsRDD2 [7187] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 7188 [labelType="html" label="MapPartitionsRDD [7188] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster14224 { label="Exchange"; 7189 [labelType="html" label="MapPartitionsRDD [7189] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 7177->7178; 7178->7179; 7180->7181; 7182->7183; 7183->7184; 7181->7185; 7184->7185; 7185->7186; 7179->7187; 7186->7187; 7187->7188; 7188->7189; }
7172,7177
7162,7180
7167,7182
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time