3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 2131 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
18 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
22.0 B / 0
Associated Job Ids:
1374
DAG Visualization
digraph G { subgraph clusterstage_2131 { label="Stage 2131"; subgraph cluster12216 { label="Scan csv "; 4852 [labelType="html" label="FileScanRDD [4852]<br>takeAsList at DataFrameCommonJob.java:145"]; 4853 [labelType="html" label="MapPartitionsRDD [4853]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster12211 { label="WholeStageCodegen (2)"; 4854 [labelType="html" label="MapPartitionsRDD [4854]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster12234 { label="Exchange"; 4855 [labelType="html" label="ShuffledRowRDD [4855] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster12229 { label="WholeStageCodegen (3)"; 4856 [labelType="html" label="MapPartitionsRDD [4856] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster12228 { label="Window"; 4857 [labelType="html" label="MapPartitionsRDD [4857] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster12222 { label="WholeStageCodegen (4)"; 4858 [labelType="html" label="MapPartitionsRDD [4858] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster12238 { label="Scan csv "; 4859 [labelType="html" label="FileScanRDD [4859]<br>takeAsList at DataFrameCommonJob.java:145"]; 4860 [labelType="html" label="MapPartitionsRDD [4860]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster12235 { label="WholeStageCodegen (5)"; 4861 [labelType="html" label="MapPartitionsRDD [4861]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster12221 { label="CartesianProduct"; 4862 [labelType="html" label="UnsafeCartesianRDD [4862] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 4863 [labelType="html" label="MapPartitionsRDD [4863] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster12217 { label="WholeStageCodegen (6)"; 4864 [labelType="html" label="MapPartitionsRDD [4864] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster12210 { label="Union"; 4865 [labelType="html" label="UnionRDD [4865] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster12239 { label="mapPartitionsInternal"; 4866 [labelType="html" label="MapPartitionsRDD [4866] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 4852->4853; 4853->4854; 4855->4856; 4856->4857; 4857->4858; 4859->4860; 4860->4861; 4858->4862; 4861->4862; 4862->4863; 4863->4864; 4854->4865; 4864->4865; 4865->4866; }
4851,4855
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time