3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 370 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Any: 1
Output Size / Records:
259.9 KiB / 11307
Shuffle Read Size / Records:
2.2 MiB / 56111
Associated Job Ids:
228
DAG Visualization
digraph G { subgraph clusterstage_370 { label="Stage 370"; 1712 [labelType="html" label="SQLExecutionRDD [1712] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster3537 { label="AQEShuffleRead"; 1705 [labelType="html" label="ShuffledRowRDD [1705] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster3534 { label="WholeStageCodegen (9)"; 1706 [labelType="html" label="MapPartitionsRDD [1706] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster3542 { label="AQEShuffleRead"; 1707 [labelType="html" label="ShuffledRowRDD [1707] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster3539 { label="WholeStageCodegen (10)"; 1708 [labelType="html" label="MapPartitionsRDD [1708] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster3528 { label="WholeStageCodegen (11)"; 1709 [labelType="html" label="ZippedPartitionsRDD2 [1709] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 1710 [labelType="html" label="MapPartitionsRDD [1710] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster3527 { label="DeserializeToObject"; 1711 [labelType="html" label="MapPartitionsRDD [1711] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster3543 { label="mapPartitions"; 1713 [labelType="html" label="MapPartitionsRDD [1713] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster3544 { label="map"; 1714 [labelType="html" label="MapPartitionsRDD [1714] [Unordered]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster3551 { label="WholeStageCodegen (1)"; 1719 [labelType="html" label="MapPartitionsRDD [1719] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster3550 { label="Coalesce"; 1720 [labelType="html" label="CoalescedRDD [1720] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster3549 { label="WriteFiles"; 1721 [labelType="html" label="MapPartitionsRDD [1721] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } } 1705->1706; 1707->1708; 1706->1709; 1708->1709; 1709->1710; 1710->1711; 1711->1712; 1712->1713; 1713->1714; 1714->1719; 1719->1720; 1720->1721; }
1704,1705
1697,1707
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time