3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 2279 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Process local: 3
Input Size / Records:
32.0 KiB / 499
Shuffle Write Size / Records:
7.7 KiB / 499
Associated Job Ids:
1420
DAG Visualization
digraph G { subgraph clusterstage_2279 { label="Stage 2279"; subgraph cluster12807 { label="Scan parquet "; 5112 [labelType="html" label="FileScanRDD [5112]<br>rdd at PersistJob.java:28"]; 5113 [labelType="html" label="MapPartitionsRDD [5113]<br>rdd at PersistJob.java:28"]; } subgraph cluster12802 { label="WholeStageCodegen (2)"; 5114 [labelType="html" label="MapPartitionsRDD [5114]<br>rdd at PersistJob.java:28"]; } subgraph cluster12813 { label="Scan parquet "; 5115 [labelType="html" label="FileScanRDD [5115]<br>rdd at PersistJob.java:28"]; 5116 [labelType="html" label="MapPartitionsRDD [5116]<br>rdd at PersistJob.java:28"]; } subgraph cluster12808 { label="WholeStageCodegen (3)"; 5117 [labelType="html" label="MapPartitionsRDD [5117]<br>rdd at PersistJob.java:28"]; } subgraph cluster12819 { label="Scan parquet "; 5118 [labelType="html" label="FileScanRDD [5118]<br>rdd at PersistJob.java:28"]; 5119 [labelType="html" label="MapPartitionsRDD [5119]<br>rdd at PersistJob.java:28"]; } subgraph cluster12814 { label="WholeStageCodegen (4)"; 5120 [labelType="html" label="MapPartitionsRDD [5120]<br>rdd at PersistJob.java:28"]; } subgraph cluster12801 { label="Union"; 5121 [labelType="html" label="UnionRDD [5121]<br>rdd at PersistJob.java:28"]; } subgraph cluster12800 { label="Exchange"; 5122 [labelType="html" label="MapPartitionsRDD [5122]<br>rdd at PersistJob.java:28"]; } } 5112->5113; 5113->5114; 5115->5116; 5116->5117; 5118->5119; 5119->5120; 5114->5121; 5117->5121; 5120->5121; 5121->5122; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time