3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1431 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1511.0 KiB / 134184
Shuffle Write Size / Records:
3.9 KiB / 139
Associated Job Ids:
853
DAG Visualization
digraph G { subgraph clusterstage_1431 { label="Stage 1431"; subgraph cluster9530 { label="AQEShuffleRead"; 4027 [labelType="html" label="ShuffledRowRDD [4027] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9527 { label="WholeStageCodegen (3)"; 4028 [labelType="html" label="MapPartitionsRDD [4028] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9540 { label="AQEShuffleRead"; 4029 [labelType="html" label="ShuffledRowRDD [4029] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9537 { label="WholeStageCodegen (4)"; 4030 [labelType="html" label="MapPartitionsRDD [4030] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9536 { label="Window"; 4031 [labelType="html" label="MapPartitionsRDD [4031] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9532 { label="WholeStageCodegen (5)"; 4032 [labelType="html" label="MapPartitionsRDD [4032] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9522 { label="WholeStageCodegen (6)"; 4033 [labelType="html" label="ZippedPartitionsRDD2 [4033] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 4034 [labelType="html" label="MapPartitionsRDD [4034] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9521 { label="Exchange"; 4035 [labelType="html" label="MapPartitionsRDD [4035] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 4027->4028; 4029->4030; 4030->4031; 4031->4032; 4028->4033; 4032->4033; 4033->4034; 4034->4035; }
4007,4027
4011,4029
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time