3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1229 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1511.2 KiB / 134184
Shuffle Write Size / Records:
3.9 KiB / 54
Associated Job Ids:
751
DAG Visualization
digraph G { subgraph clusterstage_1229 { label="Stage 1229"; subgraph cluster8274 { label="AQEShuffleRead"; 3505 [labelType="html" label="ShuffledRowRDD [3505] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8271 { label="WholeStageCodegen (3)"; 3506 [labelType="html" label="MapPartitionsRDD [3506] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8284 { label="AQEShuffleRead"; 3507 [labelType="html" label="ShuffledRowRDD [3507] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8281 { label="WholeStageCodegen (4)"; 3508 [labelType="html" label="MapPartitionsRDD [3508] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8280 { label="Window"; 3509 [labelType="html" label="MapPartitionsRDD [3509] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8276 { label="WholeStageCodegen (5)"; 3510 [labelType="html" label="MapPartitionsRDD [3510] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8267 { label="WholeStageCodegen (6)"; 3511 [labelType="html" label="ZippedPartitionsRDD2 [3511] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 3512 [labelType="html" label="MapPartitionsRDD [3512] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8266 { label="ObjectHashAggregate"; 3513 [labelType="html" label="MapPartitionsRDD [3513] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8265 { label="Exchange"; 3514 [labelType="html" label="MapPartitionsRDD [3514] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 3505->3506; 3507->3508; 3508->3509; 3509->3510; 3506->3511; 3510->3511; 3511->3512; 3512->3513; 3513->3514; }
3494,3505
3498,3507
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time