3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 5826 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Process local: 4
Input Size / Records:
993.5 KiB / 7020
Shuffle Write Size / Records:
8.4 KiB / 400
Associated Job Ids:
3909
DAG Visualization
digraph G { subgraph clusterstage_5826 { label="Stage 5826"; subgraph cluster38897 { label="Scan parquet "; 16137 [labelType="html" label="FileScanRDD [16137]<br>takeAsList at DataFrameCommonJob.java:145"]; 16138 [labelType="html" label="MapPartitionsRDD [16138]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster38891 { label="WholeStageCodegen (1)"; 16139 [labelType="html" label="MapPartitionsRDD [16139]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster38890 { label="Exchange"; 16140 [labelType="html" label="MapPartitionsRDD [16140]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 16137->16138; 16138->16139; 16139->16140; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time