3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 170 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Process local: 2
Input Size / Records:
147.3 KiB / 2002
Shuffle Write Size / Records:
166.6 KiB / 2002
Associated Job Ids:
107
DAG Visualization
digraph G { subgraph clusterstage_170 { label="Stage 170"; subgraph cluster1594 { label="Scan csv "; 757 [labelType="html" label="FileScanRDD [757]<br>toJavaRDD at AbsExportExecutor.java:55"]; 758 [labelType="html" label="MapPartitionsRDD [758]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1590 { label="WholeStageCodegen (1)"; 759 [labelType="html" label="MapPartitionsRDD [759]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1600 { label="Scan parquet "; 760 [labelType="html" label="FileScanRDD [760]<br>toJavaRDD at AbsExportExecutor.java:55"]; 761 [labelType="html" label="MapPartitionsRDD [761]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1595 { label="WholeStageCodegen (2)"; 762 [labelType="html" label="MapPartitionsRDD [762]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1589 { label="Union"; 763 [labelType="html" label="UnionRDD [763]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1588 { label="Exchange"; 764 [labelType="html" label="MapPartitionsRDD [764]<br>toJavaRDD at AbsExportExecutor.java:55"]; } } 757->758; 758->759; 760->761; 761->762; 759->763; 762->763; 763->764; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time