3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1536 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 1
Input Size / Records:
81.6 KiB / 4034
Shuffle Write Size / Records:
1375.0 B / 1
Associated Job Ids:
913
DAG Visualization
digraph G { subgraph clusterstage_1536 { label="Stage 1536"; 4354 [labelType="html" label="SQLExecutionRDD [4354]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster10272 { label="Scan parquet "; 4350 [labelType="html" label="FileScanRDD [4350]<br>toJavaRDD at AbsExportExecutor.java:55"]; 4351 [labelType="html" label="MapPartitionsRDD [4351]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster10267 { label="WholeStageCodegen (1)"; 4352 [labelType="html" label="MapPartitionsRDD [4352]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster10266 { label="DeserializeToObject"; 4353 [labelType="html" label="MapPartitionsRDD [4353]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster10273 { label="mapPartitions"; 4355 [labelType="html" label="MapPartitionsRDD [4355]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster10274 { label="map"; 4356 [labelType="html" label="MapPartitionsRDD [4356]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster10280 { label="WholeStageCodegen (1)"; 4361 [labelType="html" label="MapPartitionsRDD [4361]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster10279 { label="Exchange"; 4362 [labelType="html" label="MapPartitionsRDD [4362]<br>parquet at DataFrameParquetWriter.java:12"]; } } 4350->4351; 4351->4352; 4352->4353; 4353->4354; 4354->4355; 4355->4356; 4356->4361; 4361->4362; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time