3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 231 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
50 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
386.0 KiB / 3989
Shuffle Write Size / Records:
68.4 KiB / 797
Associated Job Ids:
144
DAG Visualization
digraph G { subgraph clusterstage_231 { label="Stage 231"; subgraph cluster2219 { label="Scan csv "; 1065 [labelType="html" label="FileScanRDD [1065]<br>toJavaRDD at AbsExportExecutor.java:55"]; 1066 [labelType="html" label="MapPartitionsRDD [1066]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2215 { label="WholeStageCodegen (3)"; 1067 [labelType="html" label="MapPartitionsRDD [1067]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2224 { label="Scan csv "; 1068 [labelType="html" label="FileScanRDD [1068]<br>toJavaRDD at AbsExportExecutor.java:55"]; 1069 [labelType="html" label="MapPartitionsRDD [1069]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2220 { label="WholeStageCodegen (4)"; 1070 [labelType="html" label="MapPartitionsRDD [1070]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2214 { label="Union"; 1071 [labelType="html" label="UnionRDD [1071]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2213 { label="Exchange"; 1072 [labelType="html" label="MapPartitionsRDD [1072]<br>toJavaRDD at AbsExportExecutor.java:55"]; } } 1065->1066; 1066->1067; 1068->1069; 1069->1070; 1067->1071; 1070->1071; 1071->1072; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time