3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 27 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Any: 2
Output Size / Records:
0.0 B / 11307
Shuffle Read Size / Records:
2.2 MiB / 56111
Associated Job Ids:
18
DAG Visualization
digraph G { subgraph clusterstage_27 { label="Stage 27"; 113 [labelType="html" label="SQLExecutionRDD [113] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 118 [labelType="html" label="SQLExecutionRDD [118] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; subgraph cluster201 { label="AQEShuffleRead"; 106 [labelType="html" label="ShuffledRowRDD [106] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster198 { label="WholeStageCodegen (9)"; 107 [labelType="html" label="MapPartitionsRDD [107] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster206 { label="AQEShuffleRead"; 108 [labelType="html" label="ShuffledRowRDD [108] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster203 { label="WholeStageCodegen (10)"; 109 [labelType="html" label="MapPartitionsRDD [109] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster192 { label="WholeStageCodegen (11)"; 110 [labelType="html" label="ZippedPartitionsRDD2 [110] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 111 [labelType="html" label="MapPartitionsRDD [111] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster191 { label="DeserializeToObject"; 112 [labelType="html" label="MapPartitionsRDD [112] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster207 { label="mapPartitions"; 114 [labelType="html" label="MapPartitionsRDD [114] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster208 { label="map"; 115 [labelType="html" label="MapPartitionsRDD [115] [Unordered]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster210 { label="WholeStageCodegen (1)"; 116 [labelType="html" label="MapPartitionsRDD [116] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster209 { label="DeserializeToObject"; 117 [labelType="html" label="MapPartitionsRDD [117] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster213 { label="mapPartitions"; 119 [labelType="html" label="MapPartitionsRDD [119] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; } } 106->107; 108->109; 107->110; 109->110; 110->111; 111->112; 112->113; 113->114; 114->115; 115->116; 116->117; 117->118; 118->119; }
105,106
98,108
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time