3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 3 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 9
Input Size / Records:
160.8 KiB / 30
Shuffle Write Size / Records:
58.0 KiB / 700
Associated Job Ids:
3
DAG Visualization
digraph G { subgraph clusterstage_3 { label="Stage 3"; subgraph cluster44 { label="Scan text "; 21 [labelType="html" label="FileScanRDD [21]<br>parquet at PersistJob.java:35"]; 22 [labelType="html" label="MapPartitionsRDD [22]<br>parquet at PersistJob.java:35"]; } subgraph cluster43 { label="Filter"; 23 [labelType="html" label="MapPartitionsRDD [23]<br>parquet at PersistJob.java:35"]; } subgraph cluster42 { label="Project"; 24 [labelType="html" label="MapPartitionsRDD [24]<br>parquet at PersistJob.java:35"]; } subgraph cluster39 { label="WholeStageCodegen (1)"; 25 [labelType="html" label="MapPartitionsRDD [25]<br>parquet at PersistJob.java:35"]; } subgraph cluster38 { label="Project"; 26 [labelType="html" label="MapPartitionsRDD [26]<br>parquet at PersistJob.java:35"]; } subgraph cluster35 { label="WholeStageCodegen (2)"; 27 [labelType="html" label="MapPartitionsRDD [27]<br>parquet at PersistJob.java:35"]; } subgraph cluster34 { label="Exchange"; 28 [labelType="html" label="MapPartitionsRDD [28]<br>parquet at PersistJob.java:35"]; } } 21->22; 22->23; 23->24; 24->25; 25->26; 26->27; 27->28; }
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time