3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Process local: 1
Input Size / Records:
3.2 KiB / 4
Shuffle Write Size / Records:
1006.0 B / 4
Associated Job Ids:
4
DAG Visualization
digraph G { subgraph clusterstage_5 { label="Stage 5"; 23 [labelType="html" label="SQLExecutionRDD [23]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster42 { label="Scan csv "; 19 [labelType="html" label="FileScanRDD [19]<br>toJavaRDD at AbsExportExecutor.java:55"]; 20 [labelType="html" label="MapPartitionsRDD [20]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster38 { label="WholeStageCodegen (1)"; 21 [labelType="html" label="MapPartitionsRDD [21]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster37 { label="DeserializeToObject"; 22 [labelType="html" label="MapPartitionsRDD [22]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster43 { label="mapPartitions"; 24 [labelType="html" label="MapPartitionsRDD [24]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster44 { label="map"; 25 [labelType="html" label="MapPartitionsRDD [25]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster51 { label="WholeStageCodegen (1)"; 30 [labelType="html" label="MapPartitionsRDD [30]<br>toLocalIterator at ExcelFileSaver.scala:45"]; } subgraph cluster50 { label="Exchange"; 31 [labelType="html" label="MapPartitionsRDD [31]<br>toLocalIterator at ExcelFileSaver.scala:45"]; } } 19->20; 20->21; 21->22; 22->23; 23->24; 24->25; 25->30; 30->31; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time