3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2342 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 2
Input Size / Records:
30.8 KiB / 1454
Output Size / Records:
0.0 B / 1454
Associated Job Ids:
1615
DAG Visualization
digraph G { subgraph clusterstage_2342 { label="Stage 2342"; 6928 [labelType="html" label="SQLExecutionRDD [6928]<br>toJavaRDD at AbsExportExecutor.java:55"]; 6933 [labelType="html" label="SQLExecutionRDD [6933]<br>jdbc at SqlDbWriter.java:111"]; subgraph cluster17624 { label="Scan parquet "; 6924 [labelType="html" label="FileScanRDD [6924]<br>toJavaRDD at AbsExportExecutor.java:55"]; 6925 [labelType="html" label="MapPartitionsRDD [6925]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster17620 { label="WholeStageCodegen (1)"; 6926 [labelType="html" label="MapPartitionsRDD [6926]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster17619 { label="DeserializeToObject"; 6927 [labelType="html" label="MapPartitionsRDD [6927]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster17625 { label="mapPartitions"; 6929 [labelType="html" label="MapPartitionsRDD [6929]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster17626 { label="map"; 6930 [labelType="html" label="MapPartitionsRDD [6930]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster17628 { label="WholeStageCodegen (1)"; 6931 [labelType="html" label="MapPartitionsRDD [6931]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster17627 { label="DeserializeToObject"; 6932 [labelType="html" label="MapPartitionsRDD [6932]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster17631 { label="mapPartitions"; 6934 [labelType="html" label="MapPartitionsRDD [6934]<br>jdbc at SqlDbWriter.java:111"]; } } 6924->6925; 6925->6926; 6926->6927; 6927->6928; 6928->6929; 6929->6930; 6930->6931; 6931->6932; 6932->6933; 6933->6934; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time