3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2495 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
2.5 KiB / 36
Associated Job Ids:
1635
DAG Visualization
digraph G { subgraph clusterstage_2495 { label="Stage 2495"; subgraph cluster16482 { label="AQEShuffleRead"; 6913 [labelType="html" label="ShuffledRowRDD [6913] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16479 { label="WholeStageCodegen (4)"; 6914 [labelType="html" label="MapPartitionsRDD [6914] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16487 { label="AQEShuffleRead"; 6915 [labelType="html" label="ShuffledRowRDD [6915] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16484 { label="WholeStageCodegen (5)"; 6916 [labelType="html" label="MapPartitionsRDD [6916] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16475 { label="WholeStageCodegen (6)"; 6917 [labelType="html" label="ZippedPartitionsRDD2 [6917] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 6918 [labelType="html" label="MapPartitionsRDD [6918] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16492 { label="AQEShuffleRead"; 6919 [labelType="html" label="ShuffledRowRDD [6919] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16489 { label="WholeStageCodegen (7)"; 6920 [labelType="html" label="MapPartitionsRDD [6920] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16471 { label="WholeStageCodegen (8)"; 6921 [labelType="html" label="ZippedPartitionsRDD2 [6921] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 6922 [labelType="html" label="MapPartitionsRDD [6922] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16493 { label="mapPartitionsInternal"; 6923 [labelType="html" label="MapPartitionsRDD [6923] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 6913->6914; 6915->6916; 6914->6917; 6916->6917; 6917->6918; 6919->6920; 6918->6921; 6920->6921; 6921->6922; 6922->6923; }
6892,6913
6896,6915
6904,6919
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time