3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1727 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
54 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
351.9 KiB / 21591
Shuffle Write Size / Records:
7.5 KiB / 895
Associated Job Ids:
1125
DAG Visualization
digraph G { subgraph clusterstage_1727 { label="Stage 1727"; subgraph cluster13456 { label="AQEShuffleRead"; 6810 [labelType="html" label="ShuffledRowRDD [6810] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13453 { label="WholeStageCodegen (8)"; 6811 [labelType="html" label="MapPartitionsRDD [6811] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13462 { label="AQEShuffleRead"; 6812 [labelType="html" label="ShuffledRowRDD [6812] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13461 { label="ObjectHashAggregate"; 6813 [labelType="html" label="MapPartitionsRDD [6813] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13458 { label="WholeStageCodegen (9)"; 6814 [labelType="html" label="MapPartitionsRDD [6814] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13448 { label="WholeStageCodegen (10)"; 6815 [labelType="html" label="ZippedPartitionsRDD2 [6815] [Unordered]<br>count at ColumnStatJob.java:47"]; 6816 [labelType="html" label="MapPartitionsRDD [6816] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster13447 { label="Exchange"; 6817 [labelType="html" label="MapPartitionsRDD [6817] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 6810->6811; 6812->6813; 6813->6814; 6811->6815; 6814->6815; 6815->6816; 6816->6817; }
6803,6810
6787,6812
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time