3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 514 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
30 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
22.0 B / 0
Associated Job Ids:
353
DAG Visualization
digraph G { subgraph clusterstage_514 { label="Stage 514"; subgraph cluster4723 { label="Scan csv "; 2229 [labelType="html" label="FileScanRDD [2229]<br>takeAsList at DataFrameCommonJob.java:145"]; 2230 [labelType="html" label="MapPartitionsRDD [2230]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4719 { label="WholeStageCodegen (1)"; 2231 [labelType="html" label="MapPartitionsRDD [2231]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4729 { label="Scan parquet "; 2232 [labelType="html" label="FileScanRDD [2232]<br>takeAsList at DataFrameCommonJob.java:145"]; 2233 [labelType="html" label="MapPartitionsRDD [2233]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4724 { label="WholeStageCodegen (2)"; 2234 [labelType="html" label="MapPartitionsRDD [2234]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4735 { label="Scan parquet "; 2235 [labelType="html" label="FileScanRDD [2235]<br>takeAsList at DataFrameCommonJob.java:145"]; 2236 [labelType="html" label="MapPartitionsRDD [2236]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4730 { label="WholeStageCodegen (3)"; 2237 [labelType="html" label="MapPartitionsRDD [2237]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4741 { label="Scan parquet "; 2238 [labelType="html" label="FileScanRDD [2238]<br>takeAsList at DataFrameCommonJob.java:145"]; 2239 [labelType="html" label="MapPartitionsRDD [2239]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4736 { label="WholeStageCodegen (4)"; 2240 [labelType="html" label="MapPartitionsRDD [2240]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4718 { label="Union"; 2241 [labelType="html" label="UnionRDD [2241]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4742 { label="mapPartitionsInternal"; 2242 [labelType="html" label="MapPartitionsRDD [2242]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2229->2230; 2230->2231; 2232->2233; 2233->2234; 2235->2236; 2236->2237; 2238->2239; 2239->2240; 2231->2241; 2234->2241; 2237->2241; 2240->2241; 2241->2242; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time