3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 2380 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
57 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.0 KiB / 499
Shuffle Write Size / Records:
7.7 KiB / 499
Associated Job Ids:
1445
DAG Visualization
digraph G { subgraph clusterstage_2380 { label="Stage 2380"; subgraph cluster13194 { label="Scan parquet "; 5264 [labelType="html" label="FileScanRDD [5264]<br>parquet at PersistJob.java:35"]; 5265 [labelType="html" label="MapPartitionsRDD [5265]<br>parquet at PersistJob.java:35"]; } subgraph cluster13189 { label="WholeStageCodegen (2)"; 5266 [labelType="html" label="MapPartitionsRDD [5266]<br>parquet at PersistJob.java:35"]; } subgraph cluster13200 { label="Scan parquet "; 5267 [labelType="html" label="FileScanRDD [5267]<br>parquet at PersistJob.java:35"]; 5268 [labelType="html" label="MapPartitionsRDD [5268]<br>parquet at PersistJob.java:35"]; } subgraph cluster13195 { label="WholeStageCodegen (3)"; 5269 [labelType="html" label="MapPartitionsRDD [5269]<br>parquet at PersistJob.java:35"]; } subgraph cluster13206 { label="Scan parquet "; 5270 [labelType="html" label="FileScanRDD [5270]<br>parquet at PersistJob.java:35"]; 5271 [labelType="html" label="MapPartitionsRDD [5271]<br>parquet at PersistJob.java:35"]; } subgraph cluster13201 { label="WholeStageCodegen (4)"; 5272 [labelType="html" label="MapPartitionsRDD [5272]<br>parquet at PersistJob.java:35"]; } subgraph cluster13188 { label="Union"; 5273 [labelType="html" label="UnionRDD [5273]<br>parquet at PersistJob.java:35"]; } subgraph cluster13187 { label="Exchange"; 5274 [labelType="html" label="MapPartitionsRDD [5274]<br>parquet at PersistJob.java:35"]; } } 5264->5265; 5265->5266; 5267->5268; 5268->5269; 5270->5271; 5271->5272; 5266->5273; 5269->5273; 5272->5273; 5273->5274; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time