3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1448 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Process local: 2
Input Size / Records:
23.4 KiB / 420
Output Size / Records:
0.0 B / 420
Associated Job Ids:
972
DAG Visualization
digraph G { subgraph clusterstage_1448 { label="Stage 1448"; 4344 [labelType="html" label="SQLExecutionRDD [4344]<br>toJavaRDD at AbsExportExecutor.java:55"]; 4349 [labelType="html" label="SQLExecutionRDD [4349]<br>jdbc at SqlDbWriter.java:111"]; subgraph cluster10217 { label="Scan parquet "; 4340 [labelType="html" label="FileScanRDD [4340]<br>toJavaRDD at AbsExportExecutor.java:55"]; 4341 [labelType="html" label="MapPartitionsRDD [4341]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster10213 { label="WholeStageCodegen (1)"; 4342 [labelType="html" label="MapPartitionsRDD [4342]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster10212 { label="DeserializeToObject"; 4343 [labelType="html" label="MapPartitionsRDD [4343]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster10218 { label="mapPartitions"; 4345 [labelType="html" label="MapPartitionsRDD [4345]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster10219 { label="map"; 4346 [labelType="html" label="MapPartitionsRDD [4346]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster10221 { label="WholeStageCodegen (1)"; 4347 [labelType="html" label="MapPartitionsRDD [4347]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster10220 { label="DeserializeToObject"; 4348 [labelType="html" label="MapPartitionsRDD [4348]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster10224 { label="mapPartitions"; 4350 [labelType="html" label="MapPartitionsRDD [4350]<br>jdbc at SqlDbWriter.java:111"]; } } 4340->4341; 4341->4342; 4342->4343; 4343->4344; 4344->4345; 4345->4346; 4346->4347; 4347->4348; 4348->4349; 4349->4350; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time