3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 3333 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 1
Output Size / Records:
24.5 MiB / 438506
Shuffle Read Size / Records:
5.4 MiB / 438537
Associated Job Ids:
2287
DAG Visualization
digraph G { subgraph clusterstage_3333 { label="Stage 3333"; 10308 [labelType="html" label="SQLExecutionRDD [10308] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster23505 { label="AQEShuffleRead"; 10301 [labelType="html" label="ShuffledRowRDD [10301] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster23502 { label="WholeStageCodegen (3)"; 10302 [labelType="html" label="MapPartitionsRDD [10302] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster23510 { label="AQEShuffleRead"; 10303 [labelType="html" label="ShuffledRowRDD [10303] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster23507 { label="WholeStageCodegen (4)"; 10304 [labelType="html" label="MapPartitionsRDD [10304] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster23498 { label="WholeStageCodegen (5)"; 10305 [labelType="html" label="ZippedPartitionsRDD2 [10305] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 10306 [labelType="html" label="MapPartitionsRDD [10306] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster23497 { label="DeserializeToObject"; 10307 [labelType="html" label="MapPartitionsRDD [10307] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster23511 { label="mapPartitions"; 10309 [labelType="html" label="MapPartitionsRDD [10309] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster23512 { label="map"; 10310 [labelType="html" label="MapPartitionsRDD [10310] [Unordered]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster23519 { label="WholeStageCodegen (1)"; 10315 [labelType="html" label="MapPartitionsRDD [10315] [Unordered]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster23518 { label="Coalesce"; 10316 [labelType="html" label="CoalescedRDD [10316] [Unordered]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster23517 { label="WriteFiles"; 10317 [labelType="html" label="MapPartitionsRDD [10317] [Unordered]<br>save at DataFrameCsvWriter.java:13"]; } } 10301->10302; 10303->10304; 10302->10305; 10304->10305; 10305->10306; 10306->10307; 10307->10308; 10308->10309; 10309->10310; 10310->10315; 10315->10316; 10316->10317; }
10296,10301
10300,10303
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time