3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1954 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
83 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.0 KiB / 499
Shuffle Write Size / Records:
7.7 KiB / 499
Associated Job Ids:
1322
DAG Visualization
digraph G { subgraph clusterstage_1954 { label="Stage 1954"; subgraph cluster11503 { label="Scan parquet "; 4563 [labelType="html" label="FileScanRDD [4563]<br>parquet at PersistJob.java:35"]; 4564 [labelType="html" label="MapPartitionsRDD [4564]<br>parquet at PersistJob.java:35"]; } subgraph cluster11497 { label="WholeStageCodegen (2)"; 4565 [labelType="html" label="MapPartitionsRDD [4565]<br>parquet at PersistJob.java:35"]; } subgraph cluster11509 { label="Scan parquet "; 4566 [labelType="html" label="FileScanRDD [4566]<br>parquet at PersistJob.java:35"]; 4567 [labelType="html" label="MapPartitionsRDD [4567]<br>parquet at PersistJob.java:35"]; } subgraph cluster11504 { label="WholeStageCodegen (3)"; 4568 [labelType="html" label="MapPartitionsRDD [4568]<br>parquet at PersistJob.java:35"]; } subgraph cluster11515 { label="Scan parquet "; 4569 [labelType="html" label="FileScanRDD [4569]<br>parquet at PersistJob.java:35"]; 4570 [labelType="html" label="MapPartitionsRDD [4570]<br>parquet at PersistJob.java:35"]; } subgraph cluster11510 { label="WholeStageCodegen (4)"; 4571 [labelType="html" label="MapPartitionsRDD [4571]<br>parquet at PersistJob.java:35"]; } subgraph cluster11496 { label="Union"; 4572 [labelType="html" label="UnionRDD [4572]<br>parquet at PersistJob.java:35"]; } subgraph cluster11495 { label="Exchange"; 4573 [labelType="html" label="MapPartitionsRDD [4573]<br>parquet at PersistJob.java:35"]; } } 4563->4564; 4564->4565; 4566->4567; 4567->4568; 4569->4570; 4570->4571; 4565->4572; 4568->4572; 4571->4572; 4572->4573; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time