3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2765 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
16 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
30.1 MiB / 692509
Shuffle Write Size / Records:
51.5 MiB / 502502
Associated Job Ids:
1847
DAG Visualization
digraph G { subgraph clusterstage_2765 { label="Stage 2765"; subgraph cluster18917 { label="AQEShuffleRead"; 8035 [labelType="html" label="ShuffledRowRDD [8035] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster18914 { label="WholeStageCodegen (8)"; 8036 [labelType="html" label="MapPartitionsRDD [8036] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster18922 { label="AQEShuffleRead"; 8037 [labelType="html" label="ShuffledRowRDD [8037] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster18919 { label="WholeStageCodegen (9)"; 8038 [labelType="html" label="MapPartitionsRDD [8038] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster18910 { label="WholeStageCodegen (10)"; 8039 [labelType="html" label="ZippedPartitionsRDD2 [8039] [Unordered]<br>count at CreateSubscriptionService.java:123"]; 8040 [labelType="html" label="MapPartitionsRDD [8040] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster18927 { label="AQEShuffleRead"; 8041 [labelType="html" label="ShuffledRowRDD [8041] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster18924 { label="WholeStageCodegen (11)"; 8042 [labelType="html" label="MapPartitionsRDD [8042] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster18904 { label="WholeStageCodegen (12)"; 8043 [labelType="html" label="ZippedPartitionsRDD2 [8043] [Unordered]<br>count at CreateSubscriptionService.java:123"]; 8044 [labelType="html" label="MapPartitionsRDD [8044] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster18903 { label="Window"; 8045 [labelType="html" label="MapPartitionsRDD [8045] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster18899 { label="WholeStageCodegen (13)"; 8046 [labelType="html" label="MapPartitionsRDD [8046] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster18898 { label="Window"; 8047 [labelType="html" label="MapPartitionsRDD [8047] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster18895 { label="WholeStageCodegen (14)"; 8048 [labelType="html" label="MapPartitionsRDD [8048] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster18894 { label="Exchange"; 8049 [labelType="html" label="MapPartitionsRDD [8049] [Unordered]<br>count at CreateSubscriptionService.java:123"]; } } 8035->8036; 8037->8038; 8036->8039; 8038->8039; 8039->8040; 8041->8042; 8040->8043; 8042->8043; 8043->8044; 8044->8045; 8045->8046; 8046->8047; 8047->8048; 8048->8049; }
8018,8035
8034,8037
8031,8041
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time