3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 502 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
75 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
154.2 KiB / 31
Associated Job Ids:
342
DAG Visualization
digraph G { subgraph clusterstage_502 { label="Stage 502"; subgraph cluster4594 { label="Scan csv "; 2169 [labelType="html" label="FileScanRDD [2169]<br>takeAsList at DataFrameCommonJob.java:145"]; 2170 [labelType="html" label="MapPartitionsRDD [2170]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4590 { label="WholeStageCodegen (1)"; 2171 [labelType="html" label="MapPartitionsRDD [2171]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4600 { label="Scan parquet "; 2172 [labelType="html" label="FileScanRDD [2172]<br>takeAsList at DataFrameCommonJob.java:145"]; 2173 [labelType="html" label="MapPartitionsRDD [2173]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4595 { label="WholeStageCodegen (2)"; 2174 [labelType="html" label="MapPartitionsRDD [2174]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4606 { label="Scan parquet "; 2175 [labelType="html" label="FileScanRDD [2175]<br>takeAsList at DataFrameCommonJob.java:145"]; 2176 [labelType="html" label="MapPartitionsRDD [2176]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4601 { label="WholeStageCodegen (3)"; 2177 [labelType="html" label="MapPartitionsRDD [2177]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4589 { label="Union"; 2178 [labelType="html" label="UnionRDD [2178]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4607 { label="mapPartitionsInternal"; 2179 [labelType="html" label="MapPartitionsRDD [2179]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2169->2170; 2170->2171; 2172->2173; 2173->2174; 2175->2176; 2176->2177; 2171->2178; 2174->2178; 2177->2178; 2178->2179; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time