3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 971 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 1
Input Size / Records:
901.9 KiB / 23504
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
731
DAG Visualization
digraph G { subgraph clusterstage_971 { label="Stage 971"; subgraph cluster7138 { label="Scan parquet "; 3036 [labelType="html" label="FileScanRDD [3036]<br>takeAsList at DataFrameCommonJob.java:143"]; 3037 [labelType="html" label="MapPartitionsRDD [3037]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7137 { label="Filter"; 3038 [labelType="html" label="MapPartitionsRDD [3038]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7136 { label="Project"; 3039 [labelType="html" label="MapPartitionsRDD [3039]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7133 { label="WholeStageCodegen (1)"; 3040 [labelType="html" label="MapPartitionsRDD [3040]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster7132 { label="Exchange"; 3041 [labelType="html" label="MapPartitionsRDD [3041]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 3036->3037; 3037->3038; 3038->3039; 3039->3040; 3040->3041; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time