3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1404 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1534.3 KiB / 134184
Shuffle Write Size / Records:
5.4 KiB / 197
Associated Job Ids:
840
DAG Visualization
digraph G { subgraph clusterstage_1404 { label="Stage 1404"; subgraph cluster9366 { label="AQEShuffleRead"; 3959 [labelType="html" label="ShuffledRowRDD [3959] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9363 { label="WholeStageCodegen (3)"; 3960 [labelType="html" label="MapPartitionsRDD [3960] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9376 { label="AQEShuffleRead"; 3961 [labelType="html" label="ShuffledRowRDD [3961] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9373 { label="WholeStageCodegen (4)"; 3962 [labelType="html" label="MapPartitionsRDD [3962] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9372 { label="Window"; 3963 [labelType="html" label="MapPartitionsRDD [3963] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9368 { label="WholeStageCodegen (5)"; 3964 [labelType="html" label="MapPartitionsRDD [3964] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9357 { label="WholeStageCodegen (6)"; 3965 [labelType="html" label="ZippedPartitionsRDD2 [3965] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 3966 [labelType="html" label="MapPartitionsRDD [3966] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster9356 { label="Exchange"; 3967 [labelType="html" label="MapPartitionsRDD [3967] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 3959->3960; 3961->3962; 3962->3963; 3963->3964; 3960->3965; 3964->3965; 3965->3966; 3966->3967; }
3939,3959
3943,3961
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time