3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2632 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
17 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
30.1 MiB / 692509
Shuffle Write Size / Records:
51.5 MiB / 502502
Associated Job Ids:
1748
DAG Visualization
digraph G { subgraph clusterstage_2632 { label="Stage 2632"; subgraph cluster17829 { label="AQEShuffleRead"; 7542 [labelType="html" label="ShuffledRowRDD [7542] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17826 { label="WholeStageCodegen (8)"; 7543 [labelType="html" label="MapPartitionsRDD [7543] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17834 { label="AQEShuffleRead"; 7544 [labelType="html" label="ShuffledRowRDD [7544] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17831 { label="WholeStageCodegen (9)"; 7545 [labelType="html" label="MapPartitionsRDD [7545] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17822 { label="WholeStageCodegen (10)"; 7546 [labelType="html" label="ZippedPartitionsRDD2 [7546] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 7547 [labelType="html" label="MapPartitionsRDD [7547] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17839 { label="AQEShuffleRead"; 7548 [labelType="html" label="ShuffledRowRDD [7548] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17836 { label="WholeStageCodegen (11)"; 7549 [labelType="html" label="MapPartitionsRDD [7549] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17816 { label="WholeStageCodegen (12)"; 7550 [labelType="html" label="ZippedPartitionsRDD2 [7550] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 7551 [labelType="html" label="MapPartitionsRDD [7551] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17815 { label="Window"; 7552 [labelType="html" label="MapPartitionsRDD [7552] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17811 { label="WholeStageCodegen (13)"; 7553 [labelType="html" label="MapPartitionsRDD [7553] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17810 { label="Window"; 7554 [labelType="html" label="MapPartitionsRDD [7554] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17807 { label="WholeStageCodegen (14)"; 7555 [labelType="html" label="MapPartitionsRDD [7555] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17806 { label="Exchange"; 7556 [labelType="html" label="MapPartitionsRDD [7556] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 7542->7543; 7544->7545; 7543->7546; 7545->7546; 7546->7547; 7548->7549; 7547->7550; 7549->7550; 7550->7551; 7551->7552; 7552->7553; 7553->7554; 7554->7555; 7555->7556; }
7492,7542
7530,7544
7524,7548
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time