3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 875 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
53 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
842.4 KiB / 21591
Associated Job Ids:
595
DAG Visualization
digraph G { subgraph clusterstage_875 { label="Stage 875"; subgraph cluster7495 { label="AQEShuffleRead"; 3972 [labelType="html" label="ShuffledRowRDD [3972] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7492 { label="WholeStageCodegen (7)"; 3973 [labelType="html" label="MapPartitionsRDD [3973] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7502 { label="AQEShuffleRead"; 3974 [labelType="html" label="ShuffledRowRDD [3974] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7501 { label="ObjectHashAggregate"; 3975 [labelType="html" label="MapPartitionsRDD [3975] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7497 { label="WholeStageCodegen (8)"; 3976 [labelType="html" label="MapPartitionsRDD [3976] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7488 { label="WholeStageCodegen (9)"; 3977 [labelType="html" label="ZippedPartitionsRDD2 [3977] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 3978 [labelType="html" label="MapPartitionsRDD [3978] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7503 { label="mapPartitionsInternal"; 3979 [labelType="html" label="MapPartitionsRDD [3979] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 3972->3973; 3974->3975; 3975->3976; 3973->3977; 3976->3977; 3977->3978; 3978->3979; }
3971,3972
3963,3974
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time