3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1311 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1511.0 KiB / 134184
Shuffle Write Size / Records:
3.9 KiB / 139
Associated Job Ids:
798
DAG Visualization
digraph G { subgraph clusterstage_1311 { label="Stage 1311"; subgraph cluster8813 { label="AQEShuffleRead"; 3739 [labelType="html" label="ShuffledRowRDD [3739] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster8810 { label="WholeStageCodegen (3)"; 3740 [labelType="html" label="MapPartitionsRDD [3740] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster8823 { label="AQEShuffleRead"; 3741 [labelType="html" label="ShuffledRowRDD [3741] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster8820 { label="WholeStageCodegen (4)"; 3742 [labelType="html" label="MapPartitionsRDD [3742] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster8819 { label="Window"; 3743 [labelType="html" label="MapPartitionsRDD [3743] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster8815 { label="WholeStageCodegen (5)"; 3744 [labelType="html" label="MapPartitionsRDD [3744] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster8805 { label="WholeStageCodegen (6)"; 3745 [labelType="html" label="ZippedPartitionsRDD2 [3745] [Unordered]<br>count at ColumnStatJob.java:47"]; 3746 [labelType="html" label="MapPartitionsRDD [3746] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster8804 { label="Exchange"; 3747 [labelType="html" label="MapPartitionsRDD [3747] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 3739->3740; 3741->3742; 3742->3743; 3743->3744; 3740->3745; 3744->3745; 3745->3746; 3746->3747; }
3714,3739
3718,3741
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time