3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2813 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 4
Input Size / Records:
10.1 MiB / 95008
Shuffle Write Size / Records:
14.4 MiB / 95008
Associated Job Ids:
1872
DAG Visualization
digraph G { subgraph clusterstage_2813 { label="Stage 2813"; subgraph cluster19182 { label="Scan csv "; 8137 [labelType="html" label="FileScanRDD [8137]<br>count at CreateSubscriptionService.java:123"]; 8138 [labelType="html" label="MapPartitionsRDD [8138]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19177 { label="WholeStageCodegen (3)"; 8139 [labelType="html" label="MapPartitionsRDD [8139]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19188 { label="Scan csv "; 8140 [labelType="html" label="FileScanRDD [8140]<br>count at CreateSubscriptionService.java:123"]; 8141 [labelType="html" label="MapPartitionsRDD [8141]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19183 { label="WholeStageCodegen (4)"; 8142 [labelType="html" label="MapPartitionsRDD [8142]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19176 { label="Union"; 8143 [labelType="html" label="UnionRDD [8143]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19173 { label="WholeStageCodegen (5)"; 8144 [labelType="html" label="MapPartitionsRDD [8144]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster19172 { label="Exchange"; 8145 [labelType="html" label="MapPartitionsRDD [8145]<br>count at CreateSubscriptionService.java:123"]; } } 8137->8138; 8138->8139; 8140->8141; 8141->8142; 8139->8143; 8142->8143; 8143->8144; 8144->8145; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time