3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 389 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Process local: 5
Input Size / Records:
745.0 KiB / 72229
Shuffle Write Size / Records:
295.0 B / 5
Associated Job Ids:
381
DAG Visualization
digraph G { subgraph clusterstage_389 { label="Stage 389"; 2425 [labelType="html" label="JDBCRDD [2425]<br>count at ColumnStatJob.java:47"]; 2426 [labelType="html" label="JDBCRDD [2426]<br>count at ColumnStatJob.java:47"]; subgraph cluster5463 { label="Scan csv "; 2427 [labelType="html" label="FileScanRDD [2427]<br>count at ColumnStatJob.java:47"]; 2428 [labelType="html" label="MapPartitionsRDD [2428]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5464 { label="Scan csv "; 2429 [labelType="html" label="FileScanRDD [2429]<br>count at ColumnStatJob.java:47"]; 2430 [labelType="html" label="MapPartitionsRDD [2430]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5465 { label="WholeStageCodegen (1)"; 2431 [labelType="html" label="MapPartitionsRDD [2431]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5467 { label="WholeStageCodegen (2)"; 2432 [labelType="html" label="MapPartitionsRDD [2432]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5472 { label="Scan parquet "; 2433 [labelType="html" label="FileScanRDD [2433]<br>count at ColumnStatJob.java:47"]; 2434 [labelType="html" label="MapPartitionsRDD [2434]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5469 { label="WholeStageCodegen (3)"; 2435 [labelType="html" label="MapPartitionsRDD [2435]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5462 { label="Union"; 2436 [labelType="html" label="UnionRDD [2436]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5459 { label="WholeStageCodegen (4)"; 2437 [labelType="html" label="MapPartitionsRDD [2437]<br>count at ColumnStatJob.java:47"]; } subgraph cluster5458 { label="Exchange"; 2438 [labelType="html" label="MapPartitionsRDD [2438]<br>count at ColumnStatJob.java:47"]; } } 2427->2428; 2429->2430; 2425->2431; 2426->2432; 2433->2434; 2434->2435; 2428->2436; 2430->2436; 2431->2436; 2432->2436; 2435->2436; 2436->2437; 2437->2438; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time