3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1408 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Process local: 2
Input Size / Records:
23.4 KiB / 420
Output Size / Records:
0.0 B / 420
Associated Job Ids:
940
DAG Visualization
digraph G { subgraph clusterstage_1408 { label="Stage 1408"; 4160 [labelType="html" label="SQLExecutionRDD [4160]<br>toJavaRDD at AbsExportExecutor.java:55"]; 4165 [labelType="html" label="SQLExecutionRDD [4165]<br>jdbc at SqlDbWriter.java:111"]; subgraph cluster9850 { label="Scan parquet "; 4156 [labelType="html" label="FileScanRDD [4156]<br>toJavaRDD at AbsExportExecutor.java:55"]; 4157 [labelType="html" label="MapPartitionsRDD [4157]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9846 { label="WholeStageCodegen (1)"; 4158 [labelType="html" label="MapPartitionsRDD [4158]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9845 { label="DeserializeToObject"; 4159 [labelType="html" label="MapPartitionsRDD [4159]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9851 { label="mapPartitions"; 4161 [labelType="html" label="MapPartitionsRDD [4161]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9852 { label="map"; 4162 [labelType="html" label="MapPartitionsRDD [4162]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster9854 { label="WholeStageCodegen (1)"; 4163 [labelType="html" label="MapPartitionsRDD [4163]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster9853 { label="DeserializeToObject"; 4164 [labelType="html" label="MapPartitionsRDD [4164]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster9857 { label="mapPartitions"; 4166 [labelType="html" label="MapPartitionsRDD [4166]<br>jdbc at SqlDbWriter.java:111"]; } } 4156->4157; 4157->4158; 4158->4159; 4159->4160; 4160->4161; 4161->4162; 4162->4163; 4163->4164; 4164->4165; 4165->4166; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time