3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SP1
application UI
Details for Stage 978 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
49 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
27.5 KiB / 2246
Shuffle Write Size / Records:
88.0 B / 1
Associated Job Ids:
736
DAG Visualization
digraph G { subgraph clusterstage_978 { label="Stage 978"; subgraph cluster6414 { label="AQEShuffleRead"; 2535 [labelType="html" label="ShuffledRowRDD [2535] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6411 { label="WholeStageCodegen (5)"; 2536 [labelType="html" label="MapPartitionsRDD [2536] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6419 { label="AQEShuffleRead"; 2537 [labelType="html" label="ShuffledRowRDD [2537] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6416 { label="WholeStageCodegen (6)"; 2538 [labelType="html" label="MapPartitionsRDD [2538] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6406 { label="WholeStageCodegen (7)"; 2539 [labelType="html" label="ZippedPartitionsRDD2 [2539] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 2540 [labelType="html" label="MapPartitionsRDD [2540] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6405 { label="Exchange"; 2541 [labelType="html" label="MapPartitionsRDD [2541] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2535->2536; 2537->2538; 2536->2539; 2538->2539; 2539->2540; 2540->2541; }
2503,2535
2531,2537
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time