3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1783 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
2.7 MiB / 85773
Associated Job Ids:
1249
DAG Visualization
digraph G { subgraph clusterstage_1783 { label="Stage 1783"; subgraph cluster13030 { label="AQEShuffleRead"; 5281 [labelType="html" label="ShuffledRowRDD [5281] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13027 { label="WholeStageCodegen (12)"; 5282 [labelType="html" label="MapPartitionsRDD [5282] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13039 { label="AQEShuffleRead"; 5283 [labelType="html" label="ShuffledRowRDD [5283] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13036 { label="WholeStageCodegen (13)"; 5284 [labelType="html" label="MapPartitionsRDD [5284] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13044 { label="AQEShuffleRead"; 5285 [labelType="html" label="ShuffledRowRDD [5285] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13041 { label="WholeStageCodegen (14)"; 5286 [labelType="html" label="MapPartitionsRDD [5286] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13032 { label="WholeStageCodegen (15)"; 5287 [labelType="html" label="ZippedPartitionsRDD2 [5287] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 5288 [labelType="html" label="MapPartitionsRDD [5288] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13022 { label="WholeStageCodegen (16)"; 5289 [labelType="html" label="ZippedPartitionsRDD2 [5289] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 5290 [labelType="html" label="MapPartitionsRDD [5290] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13049 { label="AQEShuffleRead"; 5291 [labelType="html" label="ShuffledRowRDD [5291] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13046 { label="WholeStageCodegen (17)"; 5292 [labelType="html" label="MapPartitionsRDD [5292] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13018 { label="WholeStageCodegen (18)"; 5293 [labelType="html" label="ZippedPartitionsRDD2 [5293] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 5294 [labelType="html" label="MapPartitionsRDD [5294] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster13050 { label="mapPartitionsInternal"; 5295 [labelType="html" label="MapPartitionsRDD [5295] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 5281->5282; 5283->5284; 5285->5286; 5284->5287; 5286->5287; 5287->5288; 5282->5289; 5288->5289; 5289->5290; 5291->5292; 5290->5293; 5292->5293; 5293->5294; 5294->5295; }
5263,5281
5267,5283
5271,5285
5280,5291
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time