3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 324 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
34 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
147.3 KiB / 2002
Shuffle Write Size / Records:
166.6 KiB / 2002
Associated Job Ids:
201
DAG Visualization
digraph G { subgraph clusterstage_324 { label="Stage 324"; subgraph cluster3144 { label="Scan csv "; 1515 [labelType="html" label="FileScanRDD [1515]<br>toJavaRDD at AbsExportExecutor.java:55"]; 1516 [labelType="html" label="MapPartitionsRDD [1516]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster3140 { label="WholeStageCodegen (1)"; 1517 [labelType="html" label="MapPartitionsRDD [1517]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster3150 { label="Scan parquet "; 1518 [labelType="html" label="FileScanRDD [1518]<br>toJavaRDD at AbsExportExecutor.java:55"]; 1519 [labelType="html" label="MapPartitionsRDD [1519]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster3145 { label="WholeStageCodegen (2)"; 1520 [labelType="html" label="MapPartitionsRDD [1520]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster3139 { label="Union"; 1521 [labelType="html" label="UnionRDD [1521]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster3138 { label="Exchange"; 1522 [labelType="html" label="MapPartitionsRDD [1522]<br>toJavaRDD at AbsExportExecutor.java:55"]; } } 1515->1516; 1516->1517; 1518->1519; 1519->1520; 1517->1521; 1520->1521; 1521->1522; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time