3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1635 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1126.6 KiB / 121612
Shuffle Write Size / Records:
204.0 KiB / 28520
Associated Job Ids:
1183
DAG Visualization
digraph G { subgraph clusterstage_1635 { label="Stage 1635"; subgraph cluster11974 { label="AQEShuffleRead"; 4878 [labelType="html" label="ShuffledRowRDD [4878] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster11971 { label="WholeStageCodegen (12)"; 4879 [labelType="html" label="MapPartitionsRDD [4879] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster11983 { label="AQEShuffleRead"; 4880 [labelType="html" label="ShuffledRowRDD [4880] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster11980 { label="WholeStageCodegen (13)"; 4881 [labelType="html" label="MapPartitionsRDD [4881] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster11988 { label="AQEShuffleRead"; 4882 [labelType="html" label="ShuffledRowRDD [4882] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster11985 { label="WholeStageCodegen (14)"; 4883 [labelType="html" label="MapPartitionsRDD [4883] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster11976 { label="WholeStageCodegen (15)"; 4884 [labelType="html" label="ZippedPartitionsRDD2 [4884] [Unordered]<br>count at ColumnStatJob.java:47"]; 4885 [labelType="html" label="MapPartitionsRDD [4885] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster11967 { label="WholeStageCodegen (16)"; 4886 [labelType="html" label="ZippedPartitionsRDD2 [4886] [Unordered]<br>count at ColumnStatJob.java:47"]; 4887 [labelType="html" label="MapPartitionsRDD [4887] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster11966 { label="Exchange"; 4888 [labelType="html" label="MapPartitionsRDD [4888] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 4878->4879; 4880->4881; 4882->4883; 4881->4884; 4883->4884; 4884->4885; 4879->4886; 4885->4886; 4886->4887; 4887->4888; }
4868,4878
4872,4880
4872,4882
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time