3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2465 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
2.5 KiB / 36
Associated Job Ids:
1614
DAG Visualization
digraph G { subgraph clusterstage_2465 { label="Stage 2465"; subgraph cluster16115 { label="AQEShuffleRead"; 6776 [labelType="html" label="ShuffledRowRDD [6776] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16110 { label="WholeStageCodegen (4)"; 6777 [labelType="html" label="MapPartitionsRDD [6777] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16128 { label="AQEShuffleRead"; 6780 [labelType="html" label="ShuffledRowRDD [6780] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16119 { label="WholeStageCodegen (5)"; 6785 [labelType="html" label="MapPartitionsRDD [6785] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16094 { label="WholeStageCodegen (6)"; 6788 [labelType="html" label="ZippedPartitionsRDD2 [6788] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 6791 [labelType="html" label="MapPartitionsRDD [6791] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16148 { label="AQEShuffleRead"; 6794 [labelType="html" label="ShuffledRowRDD [6794] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16140 { label="WholeStageCodegen (7)"; 6797 [labelType="html" label="MapPartitionsRDD [6797] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16083 { label="WholeStageCodegen (8)"; 6800 [labelType="html" label="ZippedPartitionsRDD2 [6800] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 6804 [labelType="html" label="MapPartitionsRDD [6804] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16159 { label="mapPartitionsInternal"; 6806 [labelType="html" label="MapPartitionsRDD [6806] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 6776->6777; 6780->6785; 6777->6788; 6785->6788; 6788->6791; 6794->6797; 6791->6800; 6797->6800; 6800->6804; 6804->6806; }
6722,6776
6736,6780
6748,6794
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time