3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 507 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
70 ms
Locality Level Summary:
Process local: 4
Input Size / Records:
104.9 KiB / 63
Shuffle Write Size / Records:
233.0 B / 4
Associated Job Ids:
347
DAG Visualization
digraph G { subgraph clusterstage_507 { label="Stage 507"; subgraph cluster4653 { label="Scan csv "; 2196 [labelType="html" label="FileScanRDD [2196]<br>count at ColumnStatJob.java:47"]; 2197 [labelType="html" label="MapPartitionsRDD [2197]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4657 { label="Scan parquet "; 2198 [labelType="html" label="FileScanRDD [2198]<br>count at ColumnStatJob.java:47"]; 2199 [labelType="html" label="MapPartitionsRDD [2199]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4654 { label="WholeStageCodegen (1)"; 2200 [labelType="html" label="MapPartitionsRDD [2200]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4661 { label="Scan parquet "; 2201 [labelType="html" label="FileScanRDD [2201]<br>count at ColumnStatJob.java:47"]; 2202 [labelType="html" label="MapPartitionsRDD [2202]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4658 { label="WholeStageCodegen (2)"; 2203 [labelType="html" label="MapPartitionsRDD [2203]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4665 { label="Scan parquet "; 2204 [labelType="html" label="FileScanRDD [2204]<br>count at ColumnStatJob.java:47"]; 2205 [labelType="html" label="MapPartitionsRDD [2205]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4662 { label="WholeStageCodegen (3)"; 2206 [labelType="html" label="MapPartitionsRDD [2206]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4652 { label="Union"; 2207 [labelType="html" label="UnionRDD [2207]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4649 { label="WholeStageCodegen (4)"; 2208 [labelType="html" label="MapPartitionsRDD [2208]<br>count at ColumnStatJob.java:47"]; } subgraph cluster4648 { label="Exchange"; 2209 [labelType="html" label="MapPartitionsRDD [2209]<br>count at ColumnStatJob.java:47"]; } } 2196->2197; 2198->2199; 2199->2200; 2201->2202; 2202->2203; 2204->2205; 2205->2206; 2197->2207; 2200->2207; 2203->2207; 2206->2207; 2207->2208; 2208->2209; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time