3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 6 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
24 s
Locality Level Summary:
Process local: 1
Input Size / Records:
88.9 MiB / 2401930
Output Size / Records:
104.0 MiB / 334650
Associated Job Ids:
5
DAG Visualization
digraph G { subgraph clusterstage_6 { label="Stage 6"; 38 [labelType="html" label="SQLExecutionRDD [38]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster68 { label="Scan parquet "; 34 [labelType="html" label="FileScanRDD [34]<br>toJavaRDD at AbsExportExecutor.java:55"]; 35 [labelType="html" label="MapPartitionsRDD [35]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster63 { label="WholeStageCodegen (1)"; 36 [labelType="html" label="MapPartitionsRDD [36]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster62 { label="DeserializeToObject"; 37 [labelType="html" label="MapPartitionsRDD [37]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster69 { label="mapPartitions"; 39 [labelType="html" label="MapPartitionsRDD [39]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster70 { label="map"; 40 [labelType="html" label="MapPartitionsRDD [40]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster77 { label="WholeStageCodegen (1)"; 45 [labelType="html" label="MapPartitionsRDD [45]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster76 { label="Coalesce"; 46 [labelType="html" label="CoalescedRDD [46]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster75 { label="WriteFiles"; 47 [labelType="html" label="MapPartitionsRDD [47]<br>save at DataFrameCsvWriter.java:13"]; } } 34->35; 35->36; 36->37; 37->38; 38->39; 39->40; 40->45; 45->46; 46->47; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time