3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1687 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
81.6 KiB / 4034
Shuffle Write Size / Records:
1337.0 B / 1
Associated Job Ids:
1198
DAG Visualization
digraph G { subgraph clusterstage_1687 { label="Stage 1687"; 4975 [labelType="html" label="SQLExecutionRDD [4975]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster12263 { label="Scan parquet "; 4971 [labelType="html" label="FileScanRDD [4971]<br>toJavaRDD at AbsExportExecutor.java:55"]; 4972 [labelType="html" label="MapPartitionsRDD [4972]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster12258 { label="WholeStageCodegen (1)"; 4973 [labelType="html" label="MapPartitionsRDD [4973]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster12257 { label="DeserializeToObject"; 4974 [labelType="html" label="MapPartitionsRDD [4974]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster12264 { label="mapPartitions"; 4976 [labelType="html" label="MapPartitionsRDD [4976]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster12265 { label="map"; 4977 [labelType="html" label="MapPartitionsRDD [4977]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster12271 { label="WholeStageCodegen (1)"; 4982 [labelType="html" label="MapPartitionsRDD [4982]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster12270 { label="Exchange"; 4983 [labelType="html" label="MapPartitionsRDD [4983]<br>parquet at DataFrameParquetWriter.java:12"]; } } 4971->4972; 4972->4973; 4973->4974; 4974->4975; 4975->4976; 4976->4977; 4977->4982; 4982->4983; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time