3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 160 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
43.2 KiB / 3330
Shuffle Write Size / Records:
47.9 KiB / 3264
Associated Job Ids:
101
DAG Visualization
digraph G { subgraph clusterstage_160 { label="Stage 160"; 713 [labelType="html" label="SQLExecutionRDD [713] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster1499 { label="AQEShuffleRead"; 706 [labelType="html" label="ShuffledRowRDD [706] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1496 { label="WholeStageCodegen (5)"; 707 [labelType="html" label="MapPartitionsRDD [707] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1504 { label="AQEShuffleRead"; 708 [labelType="html" label="ShuffledRowRDD [708] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1501 { label="WholeStageCodegen (6)"; 709 [labelType="html" label="MapPartitionsRDD [709] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1492 { label="WholeStageCodegen (7)"; 710 [labelType="html" label="ZippedPartitionsRDD2 [710] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 711 [labelType="html" label="MapPartitionsRDD [711] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1491 { label="DeserializeToObject"; 712 [labelType="html" label="MapPartitionsRDD [712] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1505 { label="mapPartitions"; 714 [labelType="html" label="MapPartitionsRDD [714] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1506 { label="map"; 715 [labelType="html" label="MapPartitionsRDD [715] [Unordered]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster1512 { label="WholeStageCodegen (1)"; 720 [labelType="html" label="MapPartitionsRDD [720] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster1511 { label="Exchange"; 721 [labelType="html" label="MapPartitionsRDD [721] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } } 706->707; 708->709; 707->710; 709->710; 710->711; 711->712; 712->713; 713->714; 714->715; 715->720; 720->721; }
705,706
700,708
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time