3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1804 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1903.5 KiB / 58251
Associated Job Ids:
1259
DAG Visualization
digraph G { subgraph clusterstage_1804 { label="Stage 1804"; subgraph cluster13246 { label="AQEShuffleRead"; 5360 [labelType="html" label="ShuffledRowRDD [5360] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13243 { label="WholeStageCodegen (12)"; 5361 [labelType="html" label="MapPartitionsRDD [5361] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13255 { label="AQEShuffleRead"; 5362 [labelType="html" label="ShuffledRowRDD [5362] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13252 { label="WholeStageCodegen (13)"; 5363 [labelType="html" label="MapPartitionsRDD [5363] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13260 { label="AQEShuffleRead"; 5364 [labelType="html" label="ShuffledRowRDD [5364] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13257 { label="WholeStageCodegen (14)"; 5365 [labelType="html" label="MapPartitionsRDD [5365] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13248 { label="WholeStageCodegen (15)"; 5366 [labelType="html" label="ZippedPartitionsRDD2 [5366] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 5367 [labelType="html" label="MapPartitionsRDD [5367] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13238 { label="WholeStageCodegen (16)"; 5368 [labelType="html" label="ZippedPartitionsRDD2 [5368] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 5369 [labelType="html" label="MapPartitionsRDD [5369] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13265 { label="AQEShuffleRead"; 5370 [labelType="html" label="ShuffledRowRDD [5370] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13262 { label="WholeStageCodegen (17)"; 5371 [labelType="html" label="MapPartitionsRDD [5371] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13234 { label="WholeStageCodegen (18)"; 5372 [labelType="html" label="ZippedPartitionsRDD2 [5372] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 5373 [labelType="html" label="MapPartitionsRDD [5373] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13266 { label="mapPartitionsInternal"; 5374 [labelType="html" label="MapPartitionsRDD [5374] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 5360->5361; 5362->5363; 5364->5365; 5363->5366; 5365->5366; 5366->5367; 5361->5368; 5367->5368; 5368->5369; 5370->5371; 5369->5372; 5371->5372; 5372->5373; 5373->5374; }
5342,5360
5346,5362
5350,5364
5359,5370
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time