3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 1712 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 2
Input Size / Records:
23.4 KiB / 420
Output Size / Records:
0.0 B / 420
Associated Job Ids:
1172
DAG Visualization
digraph G { subgraph clusterstage_1712 { label="Stage 1712"; 5248 [labelType="html" label="SQLExecutionRDD [5248]<br>toJavaRDD at AbsExportExecutor.java:55"]; 5253 [labelType="html" label="SQLExecutionRDD [5253]<br>jdbc at SqlDbWriter.java:111"]; subgraph cluster12242 { label="Scan parquet "; 5244 [labelType="html" label="FileScanRDD [5244]<br>toJavaRDD at AbsExportExecutor.java:55"]; 5245 [labelType="html" label="MapPartitionsRDD [5245]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster12238 { label="WholeStageCodegen (1)"; 5246 [labelType="html" label="MapPartitionsRDD [5246]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster12237 { label="DeserializeToObject"; 5247 [labelType="html" label="MapPartitionsRDD [5247]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster12243 { label="mapPartitions"; 5249 [labelType="html" label="MapPartitionsRDD [5249]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster12244 { label="map"; 5250 [labelType="html" label="MapPartitionsRDD [5250]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster12246 { label="WholeStageCodegen (1)"; 5251 [labelType="html" label="MapPartitionsRDD [5251]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster12245 { label="DeserializeToObject"; 5252 [labelType="html" label="MapPartitionsRDD [5252]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster12249 { label="mapPartitions"; 5254 [labelType="html" label="MapPartitionsRDD [5254]<br>jdbc at SqlDbWriter.java:111"]; } } 5244->5245; 5245->5246; 5246->5247; 5247->5248; 5248->5249; 5249->5250; 5250->5251; 5251->5252; 5252->5253; 5253->5254; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time