3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 3299 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
399.5 KiB / 438537
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
2267
DAG Visualization
digraph G { subgraph clusterstage_3299 { label="Stage 3299"; subgraph cluster23234 { label="AQEShuffleRead"; 10165 [labelType="html" label="ShuffledRowRDD [10165] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster23231 { label="WholeStageCodegen (3)"; 10167 [labelType="html" label="MapPartitionsRDD [10167] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster23240 { label="AQEShuffleRead"; 10171 [labelType="html" label="ShuffledRowRDD [10171] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster23236 { label="WholeStageCodegen (4)"; 10172 [labelType="html" label="MapPartitionsRDD [10172] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster23222 { label="WholeStageCodegen (5)"; 10173 [labelType="html" label="ZippedPartitionsRDD2 [10173] [Unordered]<br>count at ColumnStatJob.java:47"]; 10174 [labelType="html" label="MapPartitionsRDD [10174] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster23221 { label="Exchange"; 10175 [labelType="html" label="MapPartitionsRDD [10175] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 10165->10167; 10171->10172; 10167->10173; 10172->10173; 10173->10174; 10174->10175; }
10150,10165
10154,10171
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time