3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2821 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
11 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
30.1 MiB / 692509
Shuffle Write Size / Records:
51.5 MiB / 502502
Associated Job Ids:
1875
DAG Visualization
digraph G { subgraph clusterstage_2821 { label="Stage 2821"; subgraph cluster19224 { label="AQEShuffleRead"; 8153 [labelType="html" label="ShuffledRowRDD [8153] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19221 { label="WholeStageCodegen (8)"; 8154 [labelType="html" label="MapPartitionsRDD [8154] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19229 { label="AQEShuffleRead"; 8155 [labelType="html" label="ShuffledRowRDD [8155] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19226 { label="WholeStageCodegen (9)"; 8156 [labelType="html" label="MapPartitionsRDD [8156] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19217 { label="WholeStageCodegen (10)"; 8157 [labelType="html" label="ZippedPartitionsRDD2 [8157] [Unordered]<br>count at CreateSubscriptionService.java:123"]; 8158 [labelType="html" label="MapPartitionsRDD [8158] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19234 { label="AQEShuffleRead"; 8159 [labelType="html" label="ShuffledRowRDD [8159] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19231 { label="WholeStageCodegen (11)"; 8160 [labelType="html" label="MapPartitionsRDD [8160] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19211 { label="WholeStageCodegen (12)"; 8161 [labelType="html" label="ZippedPartitionsRDD2 [8161] [Unordered]<br>count at CreateSubscriptionService.java:123"]; 8162 [labelType="html" label="MapPartitionsRDD [8162] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19210 { label="Window"; 8163 [labelType="html" label="MapPartitionsRDD [8163] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19206 { label="WholeStageCodegen (13)"; 8164 [labelType="html" label="MapPartitionsRDD [8164] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19205 { label="Window"; 8165 [labelType="html" label="MapPartitionsRDD [8165] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19202 { label="WholeStageCodegen (14)"; 8166 [labelType="html" label="MapPartitionsRDD [8166] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19201 { label="Exchange"; 8167 [labelType="html" label="MapPartitionsRDD [8167] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } } 8153->8154; 8155->8156; 8154->8157; 8156->8157; 8157->8158; 8159->8160; 8158->8161; 8160->8161; 8161->8162; 8162->8163; 8163->8164; 8164->8165; 8165->8166; 8166->8167; }
8136,8153
8152,8155
8149,8159
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time