3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 479 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
44 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
37.5 KiB / 25
Shuffle Write Size / Records:
115.0 B / 2
Associated Job Ids:
322
DAG Visualization
digraph G { subgraph clusterstage_479 { label="Stage 479"; subgraph cluster4391 { label="Scan csv "; 2065 [labelType="html" label="FileScanRDD [2065]<br>count at ColumnStatJob.java:47"]; 2066 [labelType="html" label="MapPartitionsRDD [2066]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4395 { label="Scan parquet "; 2067 [labelType="html" label="FileScanRDD [2067]<br>count at ColumnStatJob.java:47"]; 2068 [labelType="html" label="MapPartitionsRDD [2068]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4392 { label="WholeStageCodegen (1)"; 2069 [labelType="html" label="MapPartitionsRDD [2069]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4390 { label="Union"; 2070 [labelType="html" label="UnionRDD [2070]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4387 { label="WholeStageCodegen (2)"; 2071 [labelType="html" label="MapPartitionsRDD [2071]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4386 { label="Exchange"; 2072 [labelType="html" label="MapPartitionsRDD [2072]<br>count at ColumnStatJob.java:47"]; } } 2065->2066; 2067->2068; 2068->2069; 2066->2070; 2069->2070; 2070->2071; 2071->2072; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time