3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1512 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1511.0 KiB / 134184
Shuffle Write Size / Records:
4.2 KiB / 139
Associated Job Ids:
892
DAG Visualization
digraph G { subgraph clusterstage_1512 { label="Stage 1512"; subgraph cluster10026 { label="AQEShuffleRead"; 4228 [labelType="html" label="ShuffledRowRDD [4228] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster10023 { label="WholeStageCodegen (3)"; 4229 [labelType="html" label="MapPartitionsRDD [4229] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster10036 { label="AQEShuffleRead"; 4230 [labelType="html" label="ShuffledRowRDD [4230] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster10033 { label="WholeStageCodegen (4)"; 4231 [labelType="html" label="MapPartitionsRDD [4231] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster10032 { label="Window"; 4232 [labelType="html" label="MapPartitionsRDD [4232] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster10028 { label="WholeStageCodegen (5)"; 4233 [labelType="html" label="MapPartitionsRDD [4233] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster10017 { label="WholeStageCodegen (6)"; 4234 [labelType="html" label="ZippedPartitionsRDD2 [4234] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 4235 [labelType="html" label="MapPartitionsRDD [4235] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster10016 { label="Exchange"; 4236 [labelType="html" label="MapPartitionsRDD [4236] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 4228->4229; 4230->4231; 4231->4232; 4232->4233; 4229->4234; 4233->4234; 4234->4235; 4235->4236; }
4208,4228
4212,4230
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time