3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 642 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
53 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
465.6 KiB / 2559
Shuffle Write Size / Records:
534.2 KiB / 1455
Associated Job Ids:
410
DAG Visualization
digraph G { subgraph clusterstage_642 { label="Stage 642"; subgraph cluster4338 { label="AQEShuffleRead"; 1892 [labelType="html" label="ShuffledRowRDD [1892] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4335 { label="WholeStageCodegen (4)"; 1893 [labelType="html" label="MapPartitionsRDD [1893] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4343 { label="AQEShuffleRead"; 1894 [labelType="html" label="ShuffledRowRDD [1894] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4340 { label="WholeStageCodegen (5)"; 1895 [labelType="html" label="MapPartitionsRDD [1895] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4330 { label="WholeStageCodegen (6)"; 1896 [labelType="html" label="ZippedPartitionsRDD2 [1896] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 1897 [labelType="html" label="MapPartitionsRDD [1897] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4327 { label="Exchange"; 1898 [labelType="html" label="MapPartitionsRDD [1898] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 1892->1893; 1894->1895; 1893->1896; 1895->1896; 1896->1897; 1897->1898; }
1881,1892
1885,1894
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time