3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 399 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 5
Input Size / Records:
821.8 KiB / 72229
Output Size / Records:
5.7 MiB / 72229
Associated Job Ids:
390
DAG Visualization
digraph G { subgraph clusterstage_399 { label="Stage 399"; 2518 [labelType="html" label="JDBCRDD [2518]<br>parquet at PersistJob.java:35"]; 2519 [labelType="html" label="JDBCRDD [2519]<br>parquet at PersistJob.java:35"]; subgraph cluster5636 { label="Scan csv "; 2520 [labelType="html" label="FileScanRDD [2520]<br>parquet at PersistJob.java:35"]; 2521 [labelType="html" label="MapPartitionsRDD [2521]<br>parquet at PersistJob.java:35"]; } subgraph cluster5632 { label="WholeStageCodegen (1)"; 2522 [labelType="html" label="MapPartitionsRDD [2522]<br>parquet at PersistJob.java:35"]; } subgraph cluster5641 { label="Scan csv "; 2523 [labelType="html" label="FileScanRDD [2523]<br>parquet at PersistJob.java:35"]; 2524 [labelType="html" label="MapPartitionsRDD [2524]<br>parquet at PersistJob.java:35"]; } subgraph cluster5637 { label="WholeStageCodegen (2)"; 2525 [labelType="html" label="MapPartitionsRDD [2525]<br>parquet at PersistJob.java:35"]; } subgraph cluster5642 { label="WholeStageCodegen (3)"; 2526 [labelType="html" label="MapPartitionsRDD [2526]<br>parquet at PersistJob.java:35"]; } subgraph cluster5646 { label="WholeStageCodegen (4)"; 2527 [labelType="html" label="MapPartitionsRDD [2527]<br>parquet at PersistJob.java:35"]; } subgraph cluster5654 { label="Scan parquet "; 2528 [labelType="html" label="FileScanRDD [2528]<br>parquet at PersistJob.java:35"]; 2529 [labelType="html" label="MapPartitionsRDD [2529]<br>parquet at PersistJob.java:35"]; } subgraph cluster5649 { label="WholeStageCodegen (5)"; 2530 [labelType="html" label="MapPartitionsRDD [2530]<br>parquet at PersistJob.java:35"]; } subgraph cluster5631 { label="Union"; 2531 [labelType="html" label="UnionRDD [2531]<br>parquet at PersistJob.java:35"]; } subgraph cluster5630 { label="WriteFiles"; 2532 [labelType="html" label="MapPartitionsRDD [2532]<br>parquet at PersistJob.java:35"]; } } 2520->2521; 2521->2522; 2523->2524; 2524->2525; 2518->2526; 2519->2527; 2528->2529; 2529->2530; 2522->2531; 2525->2531; 2526->2531; 2527->2531; 2530->2531; 2531->2532; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time