3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 3053 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 1
Input Size / Records:
81.6 KiB / 4034
Shuffle Write Size / Records:
1370.0 B / 1
Associated Job Ids:
2063
DAG Visualization
digraph G { subgraph clusterstage_3053 { label="Stage 3053"; 9098 [labelType="html" label="SQLExecutionRDD [9098]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster21138 { label="Scan parquet "; 9094 [labelType="html" label="FileScanRDD [9094]<br>toJavaRDD at AbsExportExecutor.java:55"]; 9095 [labelType="html" label="MapPartitionsRDD [9095]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster21133 { label="WholeStageCodegen (1)"; 9096 [labelType="html" label="MapPartitionsRDD [9096]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster21132 { label="DeserializeToObject"; 9097 [labelType="html" label="MapPartitionsRDD [9097]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster21139 { label="mapPartitions"; 9099 [labelType="html" label="MapPartitionsRDD [9099]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster21140 { label="map"; 9100 [labelType="html" label="MapPartitionsRDD [9100]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster21146 { label="WholeStageCodegen (1)"; 9105 [labelType="html" label="MapPartitionsRDD [9105]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster21145 { label="Exchange"; 9106 [labelType="html" label="MapPartitionsRDD [9106]<br>parquet at DataFrameParquetWriter.java:12"]; } } 9094->9095; 9095->9096; 9096->9097; 9097->9098; 9098->9099; 9099->9100; 9100->9105; 9105->9106; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time