3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 282 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
37 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
161.7 KiB / 5365
Associated Job Ids:
221
DAG Visualization
digraph G { subgraph clusterstage_282 { label="Stage 282"; subgraph cluster2626 { label="AQEShuffleRead"; 1410 [labelType="html" label="ShuffledRowRDD [1410] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2623 { label="WholeStageCodegen (4)"; 1411 [labelType="html" label="MapPartitionsRDD [1411] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2631 { label="AQEShuffleRead"; 1412 [labelType="html" label="ShuffledRowRDD [1412] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2628 { label="WholeStageCodegen (5)"; 1413 [labelType="html" label="MapPartitionsRDD [1413] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2618 { label="WholeStageCodegen (6)"; 1414 [labelType="html" label="ZippedPartitionsRDD2 [1414] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 1415 [labelType="html" label="MapPartitionsRDD [1415] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2636 { label="AQEShuffleRead"; 1416 [labelType="html" label="ShuffledRowRDD [1416] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2633 { label="WholeStageCodegen (7)"; 1417 [labelType="html" label="MapPartitionsRDD [1417] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2614 { label="WholeStageCodegen (8)"; 1418 [labelType="html" label="ZippedPartitionsRDD2 [1418] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; 1419 [labelType="html" label="MapPartitionsRDD [1419] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster2637 { label="mapPartitionsInternal"; 1420 [labelType="html" label="MapPartitionsRDD [1420] [Unordered]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 1410->1411; 1412->1413; 1411->1414; 1413->1414; 1414->1415; 1416->1417; 1415->1418; 1417->1418; 1418->1419; 1419->1420; }
1401,1410
1405,1412
1409,1416
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time