3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2171 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
2.4 MiB / 47008
Shuffle Write Size / Records:
2.9 MiB / 47008
Associated Job Ids:
1488
DAG Visualization
digraph G { subgraph clusterstage_2171 { label="Stage 2171"; 6520 [labelType="html" label="SQLExecutionRDD [6520] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster16478 { label="AQEShuffleRead"; 6515 [labelType="html" label="ShuffledRowRDD [6515] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster16475 { label="WholeStageCodegen (3)"; 6516 [labelType="html" label="MapPartitionsRDD [6516] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster16474 { label="Window"; 6517 [labelType="html" label="MapPartitionsRDD [6517] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster16471 { label="WholeStageCodegen (4)"; 6518 [labelType="html" label="MapPartitionsRDD [6518] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster16470 { label="DeserializeToObject"; 6519 [labelType="html" label="MapPartitionsRDD [6519] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster16479 { label="mapPartitions"; 6521 [labelType="html" label="MapPartitionsRDD [6521] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster16480 { label="map"; 6522 [labelType="html" label="MapPartitionsRDD [6522] [Unordered]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster16486 { label="WholeStageCodegen (1)"; 6527 [labelType="html" label="MapPartitionsRDD [6527] [Unordered]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster16485 { label="Exchange"; 6528 [labelType="html" label="MapPartitionsRDD [6528] [Unordered]<br>save at DataFrameCsvWriter.java:13"]; } } 6515->6516; 6516->6517; 6517->6518; 6518->6519; 6519->6520; 6520->6521; 6521->6522; 6522->6527; 6527->6528; }
6514,6515
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time