3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 587 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 2
Input Size / Records:
134.4 KiB / 36
Associated Job Ids:
417
DAG Visualization
digraph G { subgraph clusterstage_587 { label="Stage 587"; subgraph cluster5354 { label="Scan csv "; 2535 [labelType="html" label="FileScanRDD [2535]<br>takeAsList at DataFrameCommonJob.java:145"]; 2536 [labelType="html" label="MapPartitionsRDD [2536]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5350 { label="WholeStageCodegen (1)"; 2537 [labelType="html" label="MapPartitionsRDD [2537]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5360 { label="Scan parquet "; 2538 [labelType="html" label="FileScanRDD [2538]<br>takeAsList at DataFrameCommonJob.java:145"]; 2539 [labelType="html" label="MapPartitionsRDD [2539]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5355 { label="WholeStageCodegen (2)"; 2540 [labelType="html" label="MapPartitionsRDD [2540]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5366 { label="Scan parquet "; 2541 [labelType="html" label="FileScanRDD [2541]<br>takeAsList at DataFrameCommonJob.java:145"]; 2542 [labelType="html" label="MapPartitionsRDD [2542]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5361 { label="WholeStageCodegen (3)"; 2543 [labelType="html" label="MapPartitionsRDD [2543]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5349 { label="Union"; 2544 [labelType="html" label="UnionRDD [2544]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5367 { label="mapPartitionsInternal"; 2545 [labelType="html" label="MapPartitionsRDD [2545]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2535->2536; 2536->2537; 2538->2539; 2539->2540; 2541->2542; 2542->2543; 2537->2544; 2540->2544; 2543->2544; 2544->2545; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time