3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1176 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.9 s
Locality Level Summary:
Process local: 2
Input Size / Records:
4.4 MiB / 17658
Output Size / Records:
0.0 B / 17658
Associated Job Ids:
899
DAG Visualization
digraph G { subgraph clusterstage_1176 { label="Stage 1176"; 3605 [labelType="html" label="SQLExecutionRDD [3605]<br>toJavaRDD at AbsExportExecutor.java:55"]; 3610 [labelType="html" label="SQLExecutionRDD [3610]<br>jdbc at SqlDbWriter.java:111"]; subgraph cluster8610 { label="Scan parquet "; 3601 [labelType="html" label="FileScanRDD [3601]<br>toJavaRDD at AbsExportExecutor.java:55"]; 3602 [labelType="html" label="MapPartitionsRDD [3602]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8606 { label="WholeStageCodegen (1)"; 3603 [labelType="html" label="MapPartitionsRDD [3603]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8605 { label="DeserializeToObject"; 3604 [labelType="html" label="MapPartitionsRDD [3604]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8611 { label="mapPartitions"; 3606 [labelType="html" label="MapPartitionsRDD [3606]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8612 { label="map"; 3607 [labelType="html" label="MapPartitionsRDD [3607]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster8614 { label="WholeStageCodegen (1)"; 3608 [labelType="html" label="MapPartitionsRDD [3608]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster8613 { label="DeserializeToObject"; 3609 [labelType="html" label="MapPartitionsRDD [3609]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster8617 { label="mapPartitions"; 3611 [labelType="html" label="MapPartitionsRDD [3611]<br>jdbc at SqlDbWriter.java:111"]; } } 3601->3602; 3602->3603; 3603->3604; 3604->3605; 3605->3606; 3606->3607; 3607->3608; 3608->3609; 3609->3610; 3610->3611; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time