3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 23 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 2
Input Size / Records:
30.8 KiB / 1454
Output Size / Records:
0.0 B / 1454
Associated Job Ids:
19
DAG Visualization
digraph G { subgraph clusterstage_23 { label="Stage 23"; 120 [labelType="html" label="SQLExecutionRDD [120]<br>toJavaRDD at AbsExportExecutor.java:55"]; 125 [labelType="html" label="SQLExecutionRDD [125]<br>jdbc at SqlDbWriter.java:111"]; subgraph cluster245 { label="Scan parquet "; 116 [labelType="html" label="FileScanRDD [116]<br>toJavaRDD at AbsExportExecutor.java:55"]; 117 [labelType="html" label="MapPartitionsRDD [117]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster241 { label="WholeStageCodegen (1)"; 118 [labelType="html" label="MapPartitionsRDD [118]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster240 { label="DeserializeToObject"; 119 [labelType="html" label="MapPartitionsRDD [119]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster246 { label="mapPartitions"; 121 [labelType="html" label="MapPartitionsRDD [121]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster247 { label="map"; 122 [labelType="html" label="MapPartitionsRDD [122]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster249 { label="WholeStageCodegen (1)"; 123 [labelType="html" label="MapPartitionsRDD [123]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster248 { label="DeserializeToObject"; 124 [labelType="html" label="MapPartitionsRDD [124]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster252 { label="mapPartitions"; 126 [labelType="html" label="MapPartitionsRDD [126]<br>jdbc at SqlDbWriter.java:111"]; } } 116->117; 117->118; 118->119; 119->120; 120->121; 121->122; 122->123; 123->124; 124->125; 125->126; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time