3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 216 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
52 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
386.0 KiB / 3989
Shuffle Write Size / Records:
68.4 KiB / 797
Associated Job Ids:
135
DAG Visualization
digraph G { subgraph clusterstage_216 { label="Stage 216"; subgraph cluster2066 { label="Scan csv "; 990 [labelType="html" label="FileScanRDD [990]<br>toJavaRDD at AbsExportExecutor.java:55"]; 991 [labelType="html" label="MapPartitionsRDD [991]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2062 { label="WholeStageCodegen (3)"; 992 [labelType="html" label="MapPartitionsRDD [992]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2071 { label="Scan csv "; 993 [labelType="html" label="FileScanRDD [993]<br>toJavaRDD at AbsExportExecutor.java:55"]; 994 [labelType="html" label="MapPartitionsRDD [994]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2067 { label="WholeStageCodegen (4)"; 995 [labelType="html" label="MapPartitionsRDD [995]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2061 { label="Union"; 996 [labelType="html" label="UnionRDD [996]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2060 { label="Exchange"; 997 [labelType="html" label="MapPartitionsRDD [997]<br>toJavaRDD at AbsExportExecutor.java:55"]; } } 990->991; 991->992; 993->994; 994->995; 992->996; 995->996; 996->997; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time