3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 418 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6 s
Locality Level Summary:
Process local: 3
Input Size / Records:
6.7 MiB / 72229
Output Size / Records:
0.0 B / 72229
Associated Job Ids:
406
DAG Visualization
digraph G { subgraph clusterstage_418 { label="Stage 418"; 2595 [labelType="html" label="SQLExecutionRDD [2595]<br>toJavaRDD at AbsExportExecutor.java:55"]; 2600 [labelType="html" label="SQLExecutionRDD [2600]<br>jdbc at SqlDbWriter.java:111"]; subgraph cluster5826 { label="Scan parquet "; 2591 [labelType="html" label="FileScanRDD [2591]<br>toJavaRDD at AbsExportExecutor.java:55"]; 2592 [labelType="html" label="MapPartitionsRDD [2592]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster5822 { label="WholeStageCodegen (1)"; 2593 [labelType="html" label="MapPartitionsRDD [2593]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster5821 { label="DeserializeToObject"; 2594 [labelType="html" label="MapPartitionsRDD [2594]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster5827 { label="mapPartitions"; 2596 [labelType="html" label="MapPartitionsRDD [2596]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster5828 { label="map"; 2597 [labelType="html" label="MapPartitionsRDD [2597]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster5830 { label="WholeStageCodegen (1)"; 2598 [labelType="html" label="MapPartitionsRDD [2598]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster5829 { label="DeserializeToObject"; 2599 [labelType="html" label="MapPartitionsRDD [2599]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster5833 { label="mapPartitions"; 2601 [labelType="html" label="MapPartitionsRDD [2601]<br>jdbc at SqlDbWriter.java:111"]; } } 2591->2592; 2592->2593; 2593->2594; 2594->2595; 2595->2596; 2596->2597; 2597->2598; 2598->2599; 2599->2600; 2600->2601; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time