3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2499 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
2.5 KiB / 36
Associated Job Ids:
1636
DAG Visualization
digraph G { subgraph clusterstage_2499 { label="Stage 2499"; subgraph cluster16506 { label="AQEShuffleRead"; 6924 [labelType="html" label="ShuffledRowRDD [6924] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16503 { label="WholeStageCodegen (4)"; 6925 [labelType="html" label="MapPartitionsRDD [6925] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16511 { label="AQEShuffleRead"; 6926 [labelType="html" label="ShuffledRowRDD [6926] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16508 { label="WholeStageCodegen (5)"; 6927 [labelType="html" label="MapPartitionsRDD [6927] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16499 { label="WholeStageCodegen (6)"; 6928 [labelType="html" label="ZippedPartitionsRDD2 [6928] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 6929 [labelType="html" label="MapPartitionsRDD [6929] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16516 { label="AQEShuffleRead"; 6930 [labelType="html" label="ShuffledRowRDD [6930] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16513 { label="WholeStageCodegen (7)"; 6931 [labelType="html" label="MapPartitionsRDD [6931] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16495 { label="WholeStageCodegen (8)"; 6932 [labelType="html" label="ZippedPartitionsRDD2 [6932] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 6933 [labelType="html" label="MapPartitionsRDD [6933] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster16540 { label="mapPartitionsInternal"; 6934 [labelType="html" label="MapPartitionsRDD [6934] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 6924->6925; 6926->6927; 6925->6928; 6927->6928; 6928->6929; 6930->6931; 6929->6932; 6931->6932; 6932->6933; 6933->6934; }
6900,6924
6908,6926
6912,6930
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time