3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1458 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1511.0 KiB / 134184
Shuffle Write Size / Records:
3.9 KiB / 139
Associated Job Ids:
866
DAG Visualization
digraph G { subgraph clusterstage_1458 { label="Stage 1458"; subgraph cluster9694 { label="AQEShuffleRead"; 4094 [labelType="html" label="ShuffledRowRDD [4094] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9691 { label="WholeStageCodegen (3)"; 4095 [labelType="html" label="MapPartitionsRDD [4095] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9704 { label="AQEShuffleRead"; 4096 [labelType="html" label="ShuffledRowRDD [4096] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9701 { label="WholeStageCodegen (4)"; 4097 [labelType="html" label="MapPartitionsRDD [4097] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9700 { label="Window"; 4098 [labelType="html" label="MapPartitionsRDD [4098] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9696 { label="WholeStageCodegen (5)"; 4099 [labelType="html" label="MapPartitionsRDD [4099] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9686 { label="WholeStageCodegen (6)"; 4100 [labelType="html" label="ZippedPartitionsRDD2 [4100] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 4101 [labelType="html" label="MapPartitionsRDD [4101] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9685 { label="Exchange"; 4102 [labelType="html" label="MapPartitionsRDD [4102] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 4094->4095; 4096->4097; 4097->4098; 4098->4099; 4095->4100; 4099->4100; 4100->4101; 4101->4102; }
4074,4094
4078,4096
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time