3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 185 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
40 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
147.3 KiB / 2002
Shuffle Write Size / Records:
166.6 KiB / 2002
Associated Job Ids:
116
DAG Visualization
digraph G { subgraph clusterstage_185 { label="Stage 185"; subgraph cluster1747 { label="Scan csv "; 832 [labelType="html" label="FileScanRDD [832]<br>toJavaRDD at AbsExportExecutor.java:55"]; 833 [labelType="html" label="MapPartitionsRDD [833]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1743 { label="WholeStageCodegen (1)"; 834 [labelType="html" label="MapPartitionsRDD [834]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1753 { label="Scan parquet "; 835 [labelType="html" label="FileScanRDD [835]<br>toJavaRDD at AbsExportExecutor.java:55"]; 836 [labelType="html" label="MapPartitionsRDD [836]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1748 { label="WholeStageCodegen (2)"; 837 [labelType="html" label="MapPartitionsRDD [837]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1742 { label="Union"; 838 [labelType="html" label="UnionRDD [838]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1741 { label="Exchange"; 839 [labelType="html" label="MapPartitionsRDD [839]<br>toJavaRDD at AbsExportExecutor.java:55"]; } } 832->833; 833->834; 835->836; 836->837; 834->838; 837->838; 838->839; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time