3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 227 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
44 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
169.4 KiB / 5365
Associated Job Ids:
185
DAG Visualization
digraph G { subgraph clusterstage_227 { label="Stage 227"; subgraph cluster2157 { label="AQEShuffleRead"; 1166 [labelType="html" label="ShuffledRowRDD [1166] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2154 { label="WholeStageCodegen (4)"; 1167 [labelType="html" label="MapPartitionsRDD [1167] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2162 { label="AQEShuffleRead"; 1168 [labelType="html" label="ShuffledRowRDD [1168] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2159 { label="WholeStageCodegen (5)"; 1169 [labelType="html" label="MapPartitionsRDD [1169] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2149 { label="WholeStageCodegen (6)"; 1170 [labelType="html" label="ZippedPartitionsRDD2 [1170] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 1171 [labelType="html" label="MapPartitionsRDD [1171] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2167 { label="AQEShuffleRead"; 1172 [labelType="html" label="ShuffledRowRDD [1172] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2164 { label="WholeStageCodegen (7)"; 1173 [labelType="html" label="MapPartitionsRDD [1173] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2145 { label="WholeStageCodegen (8)"; 1174 [labelType="html" label="ZippedPartitionsRDD2 [1174] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 1175 [labelType="html" label="MapPartitionsRDD [1175] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2168 { label="mapPartitionsInternal"; 1176 [labelType="html" label="MapPartitionsRDD [1176] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 1166->1167; 1168->1169; 1167->1170; 1169->1170; 1170->1171; 1172->1173; 1171->1174; 1173->1174; 1174->1175; 1175->1176; }
1157,1166
1161,1168
1165,1172
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time