3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2344 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
81.6 KiB / 4034
Shuffle Write Size / Records:
1348.0 B / 1
Associated Job Ids:
1617
DAG Visualization
digraph G { subgraph clusterstage_2344 { label="Stage 2344"; 6941 [labelType="html" label="SQLExecutionRDD [6941]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster17655 { label="Scan parquet "; 6937 [labelType="html" label="FileScanRDD [6937]<br>toJavaRDD at AbsExportExecutor.java:55"]; 6938 [labelType="html" label="MapPartitionsRDD [6938]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster17650 { label="WholeStageCodegen (1)"; 6939 [labelType="html" label="MapPartitionsRDD [6939]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster17649 { label="DeserializeToObject"; 6940 [labelType="html" label="MapPartitionsRDD [6940]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster17656 { label="mapPartitions"; 6942 [labelType="html" label="MapPartitionsRDD [6942]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster17657 { label="map"; 6943 [labelType="html" label="MapPartitionsRDD [6943]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster17663 { label="WholeStageCodegen (1)"; 6948 [labelType="html" label="MapPartitionsRDD [6948]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster17662 { label="Exchange"; 6949 [labelType="html" label="MapPartitionsRDD [6949]<br>parquet at DataFrameParquetWriter.java:12"]; } } 6937->6938; 6938->6939; 6939->6940; 6940->6941; 6941->6942; 6942->6943; 6943->6948; 6948->6949; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time