3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 3091 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
81.6 KiB / 4034
Shuffle Write Size / Records:
1349.0 B / 1
Associated Job Ids:
2098
DAG Visualization
digraph G { subgraph clusterstage_3091 { label="Stage 3091"; 9281 [labelType="html" label="SQLExecutionRDD [9281]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster21501 { label="Scan parquet "; 9277 [labelType="html" label="FileScanRDD [9277]<br>toJavaRDD at AbsExportExecutor.java:55"]; 9278 [labelType="html" label="MapPartitionsRDD [9278]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster21496 { label="WholeStageCodegen (1)"; 9279 [labelType="html" label="MapPartitionsRDD [9279]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster21495 { label="DeserializeToObject"; 9280 [labelType="html" label="MapPartitionsRDD [9280]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster21502 { label="mapPartitions"; 9282 [labelType="html" label="MapPartitionsRDD [9282]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster21503 { label="map"; 9283 [labelType="html" label="MapPartitionsRDD [9283]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster21509 { label="WholeStageCodegen (1)"; 9288 [labelType="html" label="MapPartitionsRDD [9288]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster21508 { label="Exchange"; 9289 [labelType="html" label="MapPartitionsRDD [9289]<br>parquet at DataFrameParquetWriter.java:12"]; } } 9277->9278; 9278->9279; 9279->9280; 9280->9281; 9281->9282; 9282->9283; 9283->9288; 9288->9289; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time