3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2473 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
2.5 KiB / 36
Associated Job Ids:
1616
DAG Visualization
digraph G { subgraph clusterstage_2473 { label="Stage 2473"; subgraph cluster16185 { label="AQEShuffleRead"; 6815 [labelType="html" label="ShuffledRowRDD [6815] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16182 { label="WholeStageCodegen (4)"; 6817 [labelType="html" label="MapPartitionsRDD [6817] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16191 { label="AQEShuffleRead"; 6820 [labelType="html" label="ShuffledRowRDD [6820] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16187 { label="WholeStageCodegen (5)"; 6821 [labelType="html" label="MapPartitionsRDD [6821] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16173 { label="WholeStageCodegen (6)"; 6822 [labelType="html" label="ZippedPartitionsRDD2 [6822] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 6823 [labelType="html" label="MapPartitionsRDD [6823] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16197 { label="AQEShuffleRead"; 6824 [labelType="html" label="ShuffledRowRDD [6824] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16194 { label="WholeStageCodegen (7)"; 6825 [labelType="html" label="MapPartitionsRDD [6825] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16164 { label="WholeStageCodegen (8)"; 6826 [labelType="html" label="ZippedPartitionsRDD2 [6826] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 6827 [labelType="html" label="MapPartitionsRDD [6827] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16198 { label="mapPartitionsInternal"; 6828 [labelType="html" label="MapPartitionsRDD [6828] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 6815->6817; 6820->6821; 6817->6822; 6821->6822; 6822->6823; 6824->6825; 6823->6826; 6825->6826; 6826->6827; 6827->6828; }
6756,6815
6764,6820
6772,6824
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time