3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1000 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 s
Locality Level Summary:
Process local: 1
Input Size / Records:
1476.4 KiB / 34041
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
753
DAG Visualization
digraph G { subgraph clusterstage_1000 { label="Stage 1000"; subgraph cluster7322 { label="Scan parquet "; 3107 [labelType="html" label="FileScanRDD [3107]<br>takeAsList at DataFrameCommonJob.java:143"]; 3108 [labelType="html" label="MapPartitionsRDD [3108]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7321 { label="Filter"; 3109 [labelType="html" label="MapPartitionsRDD [3109]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7320 { label="Project"; 3110 [labelType="html" label="MapPartitionsRDD [3110]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7317 { label="WholeStageCodegen (1)"; 3111 [labelType="html" label="MapPartitionsRDD [3111]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7316 { label="Exchange"; 3112 [labelType="html" label="MapPartitionsRDD [3112]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 3107->3108; 3108->3109; 3109->3110; 3110->3111; 3111->3112; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time