3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 540 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
20 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
56.1 KiB / 36
Shuffle Write Size / Records:
174.0 B / 3
Associated Job Ids:
376
DAG Visualization
digraph G { subgraph clusterstage_540 { label="Stage 540"; subgraph cluster4980 { label="Scan csv "; 2362 [labelType="html" label="FileScanRDD [2362]<br>count at ColumnStatJob.java:47"]; 2363 [labelType="html" label="MapPartitionsRDD [2363]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4984 { label="Scan parquet "; 2364 [labelType="html" label="FileScanRDD [2364]<br>count at ColumnStatJob.java:47"]; 2365 [labelType="html" label="MapPartitionsRDD [2365]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4981 { label="WholeStageCodegen (1)"; 2366 [labelType="html" label="MapPartitionsRDD [2366]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4988 { label="Scan parquet "; 2367 [labelType="html" label="FileScanRDD [2367]<br>count at ColumnStatJob.java:47"]; 2368 [labelType="html" label="MapPartitionsRDD [2368]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4985 { label="WholeStageCodegen (2)"; 2369 [labelType="html" label="MapPartitionsRDD [2369]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4979 { label="Union"; 2370 [labelType="html" label="UnionRDD [2370]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4976 { label="WholeStageCodegen (3)"; 2371 [labelType="html" label="MapPartitionsRDD [2371]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4975 { label="Exchange"; 2372 [labelType="html" label="MapPartitionsRDD [2372]<br>count at ColumnStatJob.java:47"]; } } 2362->2363; 2364->2365; 2365->2366; 2367->2368; 2368->2369; 2363->2370; 2366->2370; 2369->2370; 2370->2371; 2371->2372; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time