3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2461 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
38 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
2.5 KiB / 36
Associated Job Ids:
1613
DAG Visualization
digraph G { subgraph clusterstage_2461 { label="Stage 2461"; subgraph cluster16114 { label="AQEShuffleRead"; 6775 [labelType="html" label="ShuffledRowRDD [6775] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16106 { label="WholeStageCodegen (4)"; 6778 [labelType="html" label="MapPartitionsRDD [6778] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16129 { label="AQEShuffleRead"; 6781 [labelType="html" label="ShuffledRowRDD [6781] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16120 { label="WholeStageCodegen (5)"; 6783 [labelType="html" label="MapPartitionsRDD [6783] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16090 { label="WholeStageCodegen (6)"; 6787 [labelType="html" label="ZippedPartitionsRDD2 [6787] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 6789 [labelType="html" label="MapPartitionsRDD [6789] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16147 { label="AQEShuffleRead"; 6793 [labelType="html" label="ShuffledRowRDD [6793] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16132 { label="WholeStageCodegen (7)"; 6796 [labelType="html" label="MapPartitionsRDD [6796] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16080 { label="WholeStageCodegen (8)"; 6799 [labelType="html" label="ZippedPartitionsRDD2 [6799] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 6803 [labelType="html" label="MapPartitionsRDD [6803] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16155 { label="mapPartitionsInternal"; 6805 [labelType="html" label="MapPartitionsRDD [6805] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 6775->6778; 6781->6783; 6778->6787; 6783->6787; 6787->6789; 6793->6796; 6789->6799; 6796->6799; 6799->6803; 6803->6805; }
6723,6775
6735,6781
6746,6793
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time