3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 271 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Output Size / Records:
259.9 KiB / 11307
Shuffle Read Size / Records:
2.2 MiB / 56111
Associated Job Ids:
166
DAG Visualization
digraph G { subgraph clusterstage_271 { label="Stage 271"; 1241 [labelType="html" label="SQLExecutionRDD [1241] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster2564 { label="AQEShuffleRead"; 1234 [labelType="html" label="ShuffledRowRDD [1234] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2561 { label="WholeStageCodegen (9)"; 1235 [labelType="html" label="MapPartitionsRDD [1235] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2569 { label="AQEShuffleRead"; 1236 [labelType="html" label="ShuffledRowRDD [1236] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2566 { label="WholeStageCodegen (10)"; 1237 [labelType="html" label="MapPartitionsRDD [1237] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2555 { label="WholeStageCodegen (11)"; 1238 [labelType="html" label="ZippedPartitionsRDD2 [1238] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 1239 [labelType="html" label="MapPartitionsRDD [1239] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2554 { label="DeserializeToObject"; 1240 [labelType="html" label="MapPartitionsRDD [1240] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2570 { label="mapPartitions"; 1242 [labelType="html" label="MapPartitionsRDD [1242] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster2571 { label="map"; 1243 [labelType="html" label="MapPartitionsRDD [1243] [Unordered]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster2578 { label="WholeStageCodegen (1)"; 1248 [labelType="html" label="MapPartitionsRDD [1248] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster2577 { label="Coalesce"; 1249 [labelType="html" label="CoalescedRDD [1249] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster2576 { label="WriteFiles"; 1250 [labelType="html" label="MapPartitionsRDD [1250] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } } 1234->1235; 1236->1237; 1235->1238; 1237->1238; 1238->1239; 1239->1240; 1240->1241; 1241->1242; 1242->1243; 1243->1248; 1248->1249; 1249->1250; }
1233,1234
1226,1236
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time