3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 2372 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
72 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.0 KiB / 499
Shuffle Write Size / Records:
7.7 KiB / 499
Associated Job Ids:
1440
DAG Visualization
digraph G { subgraph clusterstage_2372 { label="Stage 2372"; subgraph cluster13125 { label="Scan parquet "; 5226 [labelType="html" label="FileScanRDD [5226]<br>parquet at PersistJob.java:35"]; 5227 [labelType="html" label="MapPartitionsRDD [5227]<br>parquet at PersistJob.java:35"]; } subgraph cluster13106 { label="WholeStageCodegen (2)"; 5228 [labelType="html" label="MapPartitionsRDD [5228]<br>parquet at PersistJob.java:35"]; } subgraph cluster13131 { label="Scan parquet "; 5229 [labelType="html" label="FileScanRDD [5229]<br>parquet at PersistJob.java:35"]; 5230 [labelType="html" label="MapPartitionsRDD [5230]<br>parquet at PersistJob.java:35"]; } subgraph cluster13126 { label="WholeStageCodegen (3)"; 5231 [labelType="html" label="MapPartitionsRDD [5231]<br>parquet at PersistJob.java:35"]; } subgraph cluster13137 { label="Scan parquet "; 5232 [labelType="html" label="FileScanRDD [5232]<br>parquet at PersistJob.java:35"]; 5233 [labelType="html" label="MapPartitionsRDD [5233]<br>parquet at PersistJob.java:35"]; } subgraph cluster13132 { label="WholeStageCodegen (4)"; 5234 [labelType="html" label="MapPartitionsRDD [5234]<br>parquet at PersistJob.java:35"]; } subgraph cluster13105 { label="Union"; 5235 [labelType="html" label="UnionRDD [5235]<br>parquet at PersistJob.java:35"]; } subgraph cluster13104 { label="Exchange"; 5236 [labelType="html" label="MapPartitionsRDD [5236]<br>parquet at PersistJob.java:35"]; } } 5226->5227; 5227->5228; 5229->5230; 5230->5231; 5232->5233; 5233->5234; 5228->5235; 5231->5235; 5234->5235; 5235->5236; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time