3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 10 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
25 s
Locality Level Summary:
Process local: 1
Input Size / Records:
88.9 MiB / 2401930
Output Size / Records:
227.1 MiB / 1181464
Associated Job Ids:
9
DAG Visualization
digraph G { subgraph clusterstage_10 { label="Stage 10"; 70 [labelType="html" label="SQLExecutionRDD [70]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster132 { label="Scan parquet "; 66 [labelType="html" label="FileScanRDD [66]<br>toJavaRDD at AbsExportExecutor.java:55"]; 67 [labelType="html" label="MapPartitionsRDD [67]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster127 { label="WholeStageCodegen (1)"; 68 [labelType="html" label="MapPartitionsRDD [68]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster126 { label="DeserializeToObject"; 69 [labelType="html" label="MapPartitionsRDD [69]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster133 { label="mapPartitions"; 71 [labelType="html" label="MapPartitionsRDD [71]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster134 { label="map"; 72 [labelType="html" label="MapPartitionsRDD [72]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster141 { label="WholeStageCodegen (1)"; 77 [labelType="html" label="MapPartitionsRDD [77]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster140 { label="Coalesce"; 78 [labelType="html" label="CoalescedRDD [78]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster139 { label="WriteFiles"; 79 [labelType="html" label="MapPartitionsRDD [79]<br>save at DataFrameCsvWriter.java:13"]; } } 66->67; 67->68; 68->69; 69->70; 70->71; 71->72; 72->77; 77->78; 78->79; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time