3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2627 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 2
Shuffle Read Size / Records:
2.2 MiB / 692509
Shuffle Write Size / Records:
118.0 B / 2
Associated Job Ids:
1747
DAG Visualization
digraph G { subgraph clusterstage_2627 { label="Stage 2627"; subgraph cluster17795 { label="AQEShuffleRead"; 7531 [labelType="html" label="ShuffledRowRDD [7531] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17792 { label="WholeStageCodegen (8)"; 7532 [labelType="html" label="MapPartitionsRDD [7532] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17800 { label="AQEShuffleRead"; 7533 [labelType="html" label="ShuffledRowRDD [7533] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17797 { label="WholeStageCodegen (9)"; 7534 [labelType="html" label="MapPartitionsRDD [7534] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17788 { label="WholeStageCodegen (10)"; 7535 [labelType="html" label="ZippedPartitionsRDD2 [7535] [Unordered]<br>count at ColumnStatJob.java:47"]; 7536 [labelType="html" label="MapPartitionsRDD [7536] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17805 { label="AQEShuffleRead"; 7537 [labelType="html" label="ShuffledRowRDD [7537] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17802 { label="WholeStageCodegen (11)"; 7538 [labelType="html" label="MapPartitionsRDD [7538] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17783 { label="WholeStageCodegen (12)"; 7539 [labelType="html" label="ZippedPartitionsRDD2 [7539] [Unordered]<br>count at ColumnStatJob.java:47"]; 7540 [labelType="html" label="MapPartitionsRDD [7540] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17782 { label="Exchange"; 7541 [labelType="html" label="MapPartitionsRDD [7541] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 7531->7532; 7533->7534; 7532->7535; 7534->7535; 7535->7536; 7537->7538; 7536->7539; 7538->7539; 7539->7540; 7540->7541; }
7498,7531
7527,7533
7520,7537
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time