3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 293 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
20 s
Locality Level Summary:
Process local: 1
Input Size / Records:
81.1 MiB / 1904713
Output Size / Records:
160.3 MiB / 870333
Associated Job Ids:
189
DAG Visualization
digraph G { subgraph clusterstage_293 { label="Stage 293"; 1074 [labelType="html" label="SQLExecutionRDD [1074]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster2210 { label="Scan parquet "; 1070 [labelType="html" label="FileScanRDD [1070]<br>toJavaRDD at AbsExportExecutor.java:55"]; 1071 [labelType="html" label="MapPartitionsRDD [1071]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2205 { label="WholeStageCodegen (1)"; 1072 [labelType="html" label="MapPartitionsRDD [1072]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2204 { label="DeserializeToObject"; 1073 [labelType="html" label="MapPartitionsRDD [1073]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2211 { label="mapPartitions"; 1075 [labelType="html" label="MapPartitionsRDD [1075]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2212 { label="map"; 1076 [labelType="html" label="MapPartitionsRDD [1076]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster2219 { label="WholeStageCodegen (1)"; 1081 [labelType="html" label="MapPartitionsRDD [1081]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster2218 { label="Coalesce"; 1082 [labelType="html" label="CoalescedRDD [1082]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster2217 { label="WriteFiles"; 1083 [labelType="html" label="MapPartitionsRDD [1083]<br>save at DataFrameCsvWriter.java:13"]; } } 1070->1071; 1071->1072; 1072->1073; 1073->1074; 1074->1075; 1075->1076; 1076->1081; 1081->1082; 1082->1083; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time