3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 1287 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
44 ms
Locality Level Summary:
Any: 1
Output Size / Records:
0.0 B / 4
Shuffle Read Size / Records:
2.4 KiB / 5
Associated Job Ids:
971
DAG Visualization
digraph G { subgraph clusterstage_1287 { label="Stage 1287"; 3879 [labelType="html" label="SQLExecutionRDD [3879] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 3884 [labelType="html" label="SQLExecutionRDD [3884] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; subgraph cluster9371 { label="AQEShuffleRead"; 3872 [labelType="html" label="ShuffledRowRDD [3872] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9368 { label="WholeStageCodegen (3)"; 3873 [labelType="html" label="MapPartitionsRDD [3873] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9376 { label="AQEShuffleRead"; 3874 [labelType="html" label="ShuffledRowRDD [3874] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9373 { label="WholeStageCodegen (4)"; 3875 [labelType="html" label="MapPartitionsRDD [3875] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9364 { label="WholeStageCodegen (5)"; 3876 [labelType="html" label="ZippedPartitionsRDD2 [3876] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 3877 [labelType="html" label="MapPartitionsRDD [3877] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9363 { label="DeserializeToObject"; 3878 [labelType="html" label="MapPartitionsRDD [3878] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9377 { label="mapPartitions"; 3880 [labelType="html" label="MapPartitionsRDD [3880] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster9378 { label="map"; 3881 [labelType="html" label="MapPartitionsRDD [3881] [Unordered]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster9380 { label="WholeStageCodegen (1)"; 3882 [labelType="html" label="MapPartitionsRDD [3882] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster9379 { label="DeserializeToObject"; 3883 [labelType="html" label="MapPartitionsRDD [3883] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster9383 { label="mapPartitions"; 3885 [labelType="html" label="MapPartitionsRDD [3885] [Unordered]<br>jdbc at SqlDbWriter.java:111"]; } } 3872->3873; 3874->3875; 3873->3876; 3875->3876; 3876->3877; 3877->3878; 3878->3879; 3879->3880; 3880->3881; 3881->3882; 3882->3883; 3883->3884; 3884->3885; }
3867,3872
3871,3874
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time