3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 2287 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
45 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
32.0 KiB / 499
Shuffle Write Size / Records:
7.7 KiB / 499
Associated Job Ids:
1425
DAG Visualization
digraph G { subgraph clusterstage_2287 { label="Stage 2287"; subgraph cluster12870 { label="Scan parquet "; 5145 [labelType="html" label="FileScanRDD [5145]<br>rdd at PersistJob.java:28"]; 5146 [labelType="html" label="MapPartitionsRDD [5146]<br>rdd at PersistJob.java:28"]; } subgraph cluster12865 { label="WholeStageCodegen (2)"; 5147 [labelType="html" label="MapPartitionsRDD [5147]<br>rdd at PersistJob.java:28"]; } subgraph cluster12876 { label="Scan parquet "; 5148 [labelType="html" label="FileScanRDD [5148]<br>rdd at PersistJob.java:28"]; 5149 [labelType="html" label="MapPartitionsRDD [5149]<br>rdd at PersistJob.java:28"]; } subgraph cluster12871 { label="WholeStageCodegen (3)"; 5150 [labelType="html" label="MapPartitionsRDD [5150]<br>rdd at PersistJob.java:28"]; } subgraph cluster12882 { label="Scan parquet "; 5151 [labelType="html" label="FileScanRDD [5151]<br>rdd at PersistJob.java:28"]; 5152 [labelType="html" label="MapPartitionsRDD [5152]<br>rdd at PersistJob.java:28"]; } subgraph cluster12877 { label="WholeStageCodegen (4)"; 5153 [labelType="html" label="MapPartitionsRDD [5153]<br>rdd at PersistJob.java:28"]; } subgraph cluster12864 { label="Union"; 5154 [labelType="html" label="UnionRDD [5154]<br>rdd at PersistJob.java:28"]; } subgraph cluster12863 { label="Exchange"; 5155 [labelType="html" label="MapPartitionsRDD [5155]<br>rdd at PersistJob.java:28"]; } } 5145->5146; 5146->5147; 5148->5149; 5149->5150; 5151->5152; 5152->5153; 5147->5154; 5150->5154; 5153->5154; 5154->5155; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time