3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 381 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 5
Input Size / Records:
745.0 KiB / 72229
Shuffle Write Size / Records:
295.0 B / 5
Associated Job Ids:
374
DAG Visualization
digraph G { subgraph clusterstage_381 { label="Stage 381"; 2369 [labelType="html" label="JDBCRDD [2369]<br>count at ColumnStatJob.java:47"]; 2370 [labelType="html" label="JDBCRDD [2370]<br>count at ColumnStatJob.java:47"]; subgraph cluster5343 { label="Scan csv "; 2371 [labelType="html" label="FileScanRDD [2371]<br>count at ColumnStatJob.java:47"]; 2372 [labelType="html" label="MapPartitionsRDD [2372]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5344 { label="Scan csv "; 2373 [labelType="html" label="FileScanRDD [2373]<br>count at ColumnStatJob.java:47"]; 2374 [labelType="html" label="MapPartitionsRDD [2374]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5345 { label="WholeStageCodegen (1)"; 2375 [labelType="html" label="MapPartitionsRDD [2375]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5347 { label="WholeStageCodegen (2)"; 2376 [labelType="html" label="MapPartitionsRDD [2376]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5352 { label="Scan parquet "; 2377 [labelType="html" label="FileScanRDD [2377]<br>count at ColumnStatJob.java:47"]; 2378 [labelType="html" label="MapPartitionsRDD [2378]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5349 { label="WholeStageCodegen (3)"; 2379 [labelType="html" label="MapPartitionsRDD [2379]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5342 { label="Union"; 2380 [labelType="html" label="UnionRDD [2380]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5339 { label="WholeStageCodegen (4)"; 2381 [labelType="html" label="MapPartitionsRDD [2381]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5338 { label="Exchange"; 2382 [labelType="html" label="MapPartitionsRDD [2382]<br>count at ColumnStatJob.java:47"]; } } 2371->2372; 2373->2374; 2369->2375; 2370->2376; 2377->2378; 2378->2379; 2372->2380; 2374->2380; 2375->2380; 2376->2380; 2379->2380; 2380->2381; 2381->2382; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time