3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1788 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1259.7 KiB / 168622
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
1252
DAG Visualization
digraph G { subgraph clusterstage_1788 { label="Stage 1788"; subgraph cluster13128 { label="AQEShuffleRead"; 5312 [labelType="html" label="ShuffledRowRDD [5312] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13125 { label="WholeStageCodegen (9)"; 5313 [labelType="html" label="MapPartitionsRDD [5313] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13137 { label="AQEShuffleRead"; 5314 [labelType="html" label="ShuffledRowRDD [5314] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13134 { label="WholeStageCodegen (10)"; 5315 [labelType="html" label="MapPartitionsRDD [5315] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13142 { label="AQEShuffleRead"; 5316 [labelType="html" label="ShuffledRowRDD [5316] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13139 { label="WholeStageCodegen (11)"; 5317 [labelType="html" label="MapPartitionsRDD [5317] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13130 { label="WholeStageCodegen (12)"; 5318 [labelType="html" label="ZippedPartitionsRDD2 [5318] [Unordered]<br>count at ColumnStatJob.java:47"]; 5319 [labelType="html" label="MapPartitionsRDD [5319] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13121 { label="WholeStageCodegen (13)"; 5320 [labelType="html" label="ZippedPartitionsRDD2 [5320] [Unordered]<br>count at ColumnStatJob.java:47"]; 5321 [labelType="html" label="MapPartitionsRDD [5321] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13147 { label="AQEShuffleRead"; 5322 [labelType="html" label="ShuffledRowRDD [5322] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13144 { label="WholeStageCodegen (14)"; 5323 [labelType="html" label="MapPartitionsRDD [5323] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13116 { label="WholeStageCodegen (15)"; 5324 [labelType="html" label="ZippedPartitionsRDD2 [5324] [Unordered]<br>count at ColumnStatJob.java:47"]; 5325 [labelType="html" label="MapPartitionsRDD [5325] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13115 { label="Exchange"; 5326 [labelType="html" label="MapPartitionsRDD [5326] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 5312->5313; 5314->5315; 5316->5317; 5315->5318; 5317->5318; 5318->5319; 5313->5320; 5319->5320; 5320->5321; 5322->5323; 5321->5324; 5323->5324; 5324->5325; 5325->5326; }
5307,5312
5311,5314
5311,5316
5311,5322
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time