3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 400 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
47 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
87.6 KiB / 16
Associated Job Ids:
254
DAG Visualization
digraph G { subgraph clusterstage_400 { label="Stage 400"; subgraph cluster3786 { label="Scan parquet "; 1795 [labelType="html" label="FileScanRDD [1795]<br>takeAsList at DataFrameCommonJob.java:145"]; 1796 [labelType="html" label="MapPartitionsRDD [1796]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3781 { label="WholeStageCodegen (1)"; 1797 [labelType="html" label="MapPartitionsRDD [1797]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3792 { label="Scan parquet "; 1798 [labelType="html" label="FileScanRDD [1798]<br>takeAsList at DataFrameCommonJob.java:145"]; 1799 [labelType="html" label="MapPartitionsRDD [1799]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3787 { label="WholeStageCodegen (2)"; 1800 [labelType="html" label="MapPartitionsRDD [1800]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3798 { label="Scan parquet "; 1801 [labelType="html" label="FileScanRDD [1801]<br>takeAsList at DataFrameCommonJob.java:145"]; 1802 [labelType="html" label="MapPartitionsRDD [1802]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3793 { label="WholeStageCodegen (3)"; 1803 [labelType="html" label="MapPartitionsRDD [1803]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3780 { label="Union"; 1804 [labelType="html" label="UnionRDD [1804]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3799 { label="mapPartitionsInternal"; 1805 [labelType="html" label="MapPartitionsRDD [1805]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 1795->1796; 1796->1797; 1798->1799; 1799->1800; 1801->1802; 1802->1803; 1797->1804; 1800->1804; 1803->1804; 1804->1805; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time