3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 681 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
298.1 KiB / 5188
Shuffle Write Size / Records:
150.5 KiB / 5188
Associated Job Ids:
505
DAG Visualization
digraph G { subgraph clusterstage_681 { label="Stage 681"; 2897 [labelType="html" label="SQLExecutionRDD [2897]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster6145 { label="Scan csv "; 2893 [labelType="html" label="FileScanRDD [2893]<br>toJavaRDD at AbsExportExecutor.java:55"]; 2894 [labelType="html" label="MapPartitionsRDD [2894]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster6142 { label="WholeStageCodegen (1)"; 2895 [labelType="html" label="MapPartitionsRDD [2895]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster6141 { label="DeserializeToObject"; 2896 [labelType="html" label="MapPartitionsRDD [2896]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster6146 { label="mapPartitions"; 2898 [labelType="html" label="MapPartitionsRDD [2898]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster6147 { label="map"; 2899 [labelType="html" label="MapPartitionsRDD [2899]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster6153 { label="WholeStageCodegen (1)"; 2904 [labelType="html" label="MapPartitionsRDD [2904]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster6152 { label="Exchange"; 2905 [labelType="html" label="MapPartitionsRDD [2905]<br>save at DataFrameCsvWriter.java:13"]; } } 2893->2894; 2894->2895; 2895->2896; 2896->2897; 2897->2898; 2898->2899; 2899->2904; 2904->2905; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time