3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2338 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
81.6 KiB / 4034
Shuffle Write Size / Records:
566.0 B / 1
Associated Job Ids:
1612
DAG Visualization
digraph G { subgraph clusterstage_2338 { label="Stage 2338"; 6911 [labelType="html" label="SQLExecutionRDD [6911]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster17590 { label="Scan parquet "; 6907 [labelType="html" label="FileScanRDD [6907]<br>toJavaRDD at AbsExportExecutor.java:55"]; 6908 [labelType="html" label="MapPartitionsRDD [6908]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster17585 { label="WholeStageCodegen (1)"; 6909 [labelType="html" label="MapPartitionsRDD [6909]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster17584 { label="DeserializeToObject"; 6910 [labelType="html" label="MapPartitionsRDD [6910]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster17591 { label="mapPartitions"; 6912 [labelType="html" label="MapPartitionsRDD [6912]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster17592 { label="map"; 6913 [labelType="html" label="MapPartitionsRDD [6913]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster17598 { label="WholeStageCodegen (1)"; 6918 [labelType="html" label="MapPartitionsRDD [6918]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster17597 { label="Exchange"; 6919 [labelType="html" label="MapPartitionsRDD [6919]<br>parquet at DataFrameParquetWriter.java:12"]; } } 6907->6908; 6908->6909; 6909->6910; 6910->6911; 6911->6912; 6912->6913; 6913->6918; 6918->6919; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time