3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 240 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Output Size / Records:
259.9 KiB / 11307
Shuffle Read Size / Records:
2.2 MiB / 56111
Associated Job Ids:
147
DAG Visualization
digraph G { subgraph clusterstage_240 { label="Stage 240"; 1089 [labelType="html" label="SQLExecutionRDD [1089] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster2253 { label="AQEShuffleRead"; 1082 [labelType="html" label="ShuffledRowRDD [1082] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2250 { label="WholeStageCodegen (9)"; 1083 [labelType="html" label="MapPartitionsRDD [1083] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2258 { label="AQEShuffleRead"; 1084 [labelType="html" label="ShuffledRowRDD [1084] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2255 { label="WholeStageCodegen (10)"; 1085 [labelType="html" label="MapPartitionsRDD [1085] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2244 { label="WholeStageCodegen (11)"; 1086 [labelType="html" label="ZippedPartitionsRDD2 [1086] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 1087 [labelType="html" label="MapPartitionsRDD [1087] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2243 { label="DeserializeToObject"; 1088 [labelType="html" label="MapPartitionsRDD [1088] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2259 { label="mapPartitions"; 1090 [labelType="html" label="MapPartitionsRDD [1090] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2260 { label="map"; 1091 [labelType="html" label="MapPartitionsRDD [1091] [Unordered]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster2267 { label="WholeStageCodegen (1)"; 1096 [labelType="html" label="MapPartitionsRDD [1096] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster2266 { label="Coalesce"; 1097 [labelType="html" label="CoalescedRDD [1097] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster2265 { label="WriteFiles"; 1098 [labelType="html" label="MapPartitionsRDD [1098] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } } 1082->1083; 1084->1085; 1083->1086; 1085->1086; 1086->1087; 1087->1088; 1088->1089; 1089->1090; 1090->1091; 1091->1096; 1096->1097; 1097->1098; }
1081,1082
1074,1084
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time