3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1365 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1534.3 KiB / 134184
Shuffle Write Size / Records:
4.4 KiB / 197
Associated Job Ids:
824
DAG Visualization
digraph G { subgraph clusterstage_1365 { label="Stage 1365"; subgraph cluster9143 { label="AQEShuffleRead"; 3876 [labelType="html" label="ShuffledRowRDD [3876] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9140 { label="WholeStageCodegen (3)"; 3877 [labelType="html" label="MapPartitionsRDD [3877] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9153 { label="AQEShuffleRead"; 3878 [labelType="html" label="ShuffledRowRDD [3878] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9150 { label="WholeStageCodegen (4)"; 3879 [labelType="html" label="MapPartitionsRDD [3879] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9149 { label="Window"; 3880 [labelType="html" label="MapPartitionsRDD [3880] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9145 { label="WholeStageCodegen (5)"; 3881 [labelType="html" label="MapPartitionsRDD [3881] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9134 { label="WholeStageCodegen (6)"; 3882 [labelType="html" label="ZippedPartitionsRDD2 [3882] [Unordered]<br>count at ColumnStatJob.java:47"]; 3883 [labelType="html" label="MapPartitionsRDD [3883] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster9133 { label="Exchange"; 3884 [labelType="html" label="MapPartitionsRDD [3884] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 3876->3877; 3878->3879; 3879->3880; 3880->3881; 3877->3882; 3881->3882; 3882->3883; 3883->3884; }
3851,3876
3855,3878
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time