3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1294 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Any: 2
Output Size / Records:
0.0 B / 13799
Shuffle Read Size / Records:
6.5 MiB / 37303
Associated Job Ids:
976
DAG Visualization
digraph G { subgraph clusterstage_1294 { label="Stage 1294"; 3905 [labelType="html" label="SQLExecutionRDD [3905] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 3910 [labelType="html" label="SQLExecutionRDD [3910] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; subgraph cluster9440 { label="AQEShuffleRead"; 3898 [labelType="html" label="ShuffledRowRDD [3898] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9437 { label="WholeStageCodegen (3)"; 3899 [labelType="html" label="MapPartitionsRDD [3899] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9445 { label="AQEShuffleRead"; 3900 [labelType="html" label="ShuffledRowRDD [3900] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9442 { label="WholeStageCodegen (4)"; 3901 [labelType="html" label="MapPartitionsRDD [3901] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9433 { label="WholeStageCodegen (5)"; 3902 [labelType="html" label="ZippedPartitionsRDD2 [3902] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 3903 [labelType="html" label="MapPartitionsRDD [3903] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9432 { label="DeserializeToObject"; 3904 [labelType="html" label="MapPartitionsRDD [3904] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9446 { label="mapPartitions"; 3906 [labelType="html" label="MapPartitionsRDD [3906] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9447 { label="map"; 3907 [labelType="html" label="MapPartitionsRDD [3907] [Unordered]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster9449 { label="WholeStageCodegen (1)"; 3908 [labelType="html" label="MapPartitionsRDD [3908] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster9448 { label="DeserializeToObject"; 3909 [labelType="html" label="MapPartitionsRDD [3909] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster9452 { label="mapPartitions"; 3911 [labelType="html" label="MapPartitionsRDD [3911] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; } } 3898->3899; 3900->3901; 3899->3902; 3901->3902; 3902->3903; 3903->3904; 3904->3905; 3905->3906; 3906->3907; 3907->3908; 3908->3909; 3909->3910; 3910->3911; }
3893,3898
3897,3900
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time