3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1881 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
88 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.0 KiB / 499
Shuffle Write Size / Records:
7.7 KiB / 499
Associated Job Ids:
1304
DAG Visualization
digraph G { subgraph clusterstage_1881 { label="Stage 1881"; subgraph cluster11205 { label="Scan parquet "; 4456 [labelType="html" label="FileScanRDD [4456]<br>rdd at PersistJob.java:28"]; 4457 [labelType="html" label="MapPartitionsRDD [4457]<br>rdd at PersistJob.java:28"]; } subgraph cluster11200 { label="WholeStageCodegen (2)"; 4458 [labelType="html" label="MapPartitionsRDD [4458]<br>rdd at PersistJob.java:28"]; } subgraph cluster11211 { label="Scan parquet "; 4459 [labelType="html" label="FileScanRDD [4459]<br>rdd at PersistJob.java:28"]; 4460 [labelType="html" label="MapPartitionsRDD [4460]<br>rdd at PersistJob.java:28"]; } subgraph cluster11206 { label="WholeStageCodegen (3)"; 4461 [labelType="html" label="MapPartitionsRDD [4461]<br>rdd at PersistJob.java:28"]; } subgraph cluster11217 { label="Scan parquet "; 4462 [labelType="html" label="FileScanRDD [4462]<br>rdd at PersistJob.java:28"]; 4463 [labelType="html" label="MapPartitionsRDD [4463]<br>rdd at PersistJob.java:28"]; } subgraph cluster11212 { label="WholeStageCodegen (4)"; 4464 [labelType="html" label="MapPartitionsRDD [4464]<br>rdd at PersistJob.java:28"]; } subgraph cluster11199 { label="Union"; 4465 [labelType="html" label="UnionRDD [4465]<br>rdd at PersistJob.java:28"]; } subgraph cluster11198 { label="Exchange"; 4466 [labelType="html" label="MapPartitionsRDD [4466]<br>rdd at PersistJob.java:28"]; } } 4456->4457; 4457->4458; 4459->4460; 4460->4461; 4462->4463; 4463->4464; 4458->4465; 4461->4465; 4464->4465; 4465->4466; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time