3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 3335 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.4 s
Locality Level Summary:
Process local: 1
Input Size / Records:
81.6 KiB / 4034
Shuffle Write Size / Records:
1352.0 B / 1
Associated Job Ids:
2289
DAG Visualization
digraph G { subgraph clusterstage_3335 { label="Stage 3335"; 10324 [labelType="html" label="SQLExecutionRDD [10324]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster23553 { label="Scan parquet "; 10320 [labelType="html" label="FileScanRDD [10320]<br>toJavaRDD at AbsExportExecutor.java:55"]; 10321 [labelType="html" label="MapPartitionsRDD [10321]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster23548 { label="WholeStageCodegen (1)"; 10322 [labelType="html" label="MapPartitionsRDD [10322]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster23547 { label="DeserializeToObject"; 10323 [labelType="html" label="MapPartitionsRDD [10323]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster23554 { label="mapPartitions"; 10325 [labelType="html" label="MapPartitionsRDD [10325]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster23555 { label="map"; 10326 [labelType="html" label="MapPartitionsRDD [10326]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster23561 { label="WholeStageCodegen (1)"; 10331 [labelType="html" label="MapPartitionsRDD [10331]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster23560 { label="Exchange"; 10332 [labelType="html" label="MapPartitionsRDD [10332]<br>parquet at DataFrameParquetWriter.java:12"]; } } 10320->10321; 10321->10322; 10322->10323; 10323->10324; 10324->10325; 10325->10326; 10326->10331; 10331->10332; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time