3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 277 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
33 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
147.3 KiB / 2002
Shuffle Write Size / Records:
166.6 KiB / 2002
Associated Job Ids:
172
DAG Visualization
digraph G { subgraph clusterstage_277 { label="Stage 277"; subgraph cluster2675 { label="Scan csv "; 1286 [labelType="html" label="FileScanRDD [1286]<br>toJavaRDD at AbsExportExecutor.java:55"]; 1287 [labelType="html" label="MapPartitionsRDD [1287]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2671 { label="WholeStageCodegen (1)"; 1288 [labelType="html" label="MapPartitionsRDD [1288]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2681 { label="Scan parquet "; 1289 [labelType="html" label="FileScanRDD [1289]<br>toJavaRDD at AbsExportExecutor.java:55"]; 1290 [labelType="html" label="MapPartitionsRDD [1290]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2676 { label="WholeStageCodegen (2)"; 1291 [labelType="html" label="MapPartitionsRDD [1291]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2670 { label="Union"; 1292 [labelType="html" label="UnionRDD [1292]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2669 { label="Exchange"; 1293 [labelType="html" label="MapPartitionsRDD [1293]<br>toJavaRDD at AbsExportExecutor.java:55"]; } } 1286->1287; 1287->1288; 1289->1290; 1290->1291; 1288->1292; 1291->1292; 1292->1293; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time