3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 2626 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
49.5 KiB / 4045
Shuffle Write Size / Records:
136.0 B / 1
Associated Job Ids:
1560
DAG Visualization
digraph G { subgraph clusterstage_2626 { label="Stage 2626"; subgraph cluster14362 { label="AQEShuffleRead"; 5698 [labelType="html" label="ShuffledRowRDD [5698] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster14359 { label="WholeStageCodegen (4)"; 5699 [labelType="html" label="MapPartitionsRDD [5699] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster14367 { label="AQEShuffleRead"; 5700 [labelType="html" label="ShuffledRowRDD [5700] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster14364 { label="WholeStageCodegen (5)"; 5701 [labelType="html" label="MapPartitionsRDD [5701] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster14355 { label="WholeStageCodegen (6)"; 5702 [labelType="html" label="ZippedPartitionsRDD2 [5702] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 5703 [labelType="html" label="MapPartitionsRDD [5703] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster14372 { label="AQEShuffleRead"; 5704 [labelType="html" label="ShuffledRowRDD [5704] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster14369 { label="WholeStageCodegen (7)"; 5705 [labelType="html" label="MapPartitionsRDD [5705] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster14351 { label="WholeStageCodegen (8)"; 5706 [labelType="html" label="ZippedPartitionsRDD2 [5706] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 5707 [labelType="html" label="MapPartitionsRDD [5707] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster14350 { label="ObjectHashAggregate"; 5708 [labelType="html" label="MapPartitionsRDD [5708] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster14349 { label="Exchange"; 5709 [labelType="html" label="MapPartitionsRDD [5709] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 5698->5699; 5700->5701; 5699->5702; 5701->5702; 5702->5703; 5704->5705; 5703->5706; 5705->5706; 5706->5707; 5707->5708; 5708->5709; }
5689,5698
5693,5700
5697,5704
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time