3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 180 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.8 s
Locality Level Summary:
Any: 1
Output Size / Records:
259.9 KiB / 11307
Shuffle Read Size / Records:
2.2 MiB / 56111
Associated Job Ids:
111
DAG Visualization
digraph G { subgraph clusterstage_180 { label="Stage 180"; 789 [labelType="html" label="SQLExecutionRDD [789] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster1641 { label="AQEShuffleRead"; 782 [labelType="html" label="ShuffledRowRDD [782] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1638 { label="WholeStageCodegen (9)"; 783 [labelType="html" label="MapPartitionsRDD [783] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1646 { label="AQEShuffleRead"; 784 [labelType="html" label="ShuffledRowRDD [784] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1643 { label="WholeStageCodegen (10)"; 785 [labelType="html" label="MapPartitionsRDD [785] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1632 { label="WholeStageCodegen (11)"; 786 [labelType="html" label="ZippedPartitionsRDD2 [786] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; 787 [labelType="html" label="MapPartitionsRDD [787] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1631 { label="DeserializeToObject"; 788 [labelType="html" label="MapPartitionsRDD [788] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1647 { label="mapPartitions"; 790 [labelType="html" label="MapPartitionsRDD [790] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster1648 { label="map"; 791 [labelType="html" label="MapPartitionsRDD [791] [Unordered]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster1655 { label="WholeStageCodegen (1)"; 796 [labelType="html" label="MapPartitionsRDD [796] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster1654 { label="Coalesce"; 797 [labelType="html" label="CoalescedRDD [797] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster1653 { label="WriteFiles"; 798 [labelType="html" label="MapPartitionsRDD [798] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } } 782->783; 784->785; 783->786; 785->786; 786->787; 787->788; 788->789; 789->790; 790->791; 791->796; 796->797; 797->798; }
781,782
774,784
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time