3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 530 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
13 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
37.5 KiB / 25
Shuffle Write Size / Records:
115.0 B / 2
Associated Job Ids:
367
DAG Visualization
digraph G { subgraph clusterstage_530 { label="Stage 530"; subgraph cluster4889 { label="Scan csv "; 2317 [labelType="html" label="FileScanRDD [2317]<br>count at ColumnStatJob.java:47"]; 2318 [labelType="html" label="MapPartitionsRDD [2318]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4893 { label="Scan parquet "; 2319 [labelType="html" label="FileScanRDD [2319]<br>count at ColumnStatJob.java:47"]; 2320 [labelType="html" label="MapPartitionsRDD [2320]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4890 { label="WholeStageCodegen (1)"; 2321 [labelType="html" label="MapPartitionsRDD [2321]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4888 { label="Union"; 2322 [labelType="html" label="UnionRDD [2322]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4885 { label="WholeStageCodegen (2)"; 2323 [labelType="html" label="MapPartitionsRDD [2323]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4884 { label="Exchange"; 2324 [labelType="html" label="MapPartitionsRDD [2324]<br>count at ColumnStatJob.java:47"]; } } 2317->2318; 2319->2320; 2320->2321; 2318->2322; 2321->2322; 2322->2323; 2323->2324; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time