3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 466 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
7 s
Locality Level Summary:
Process local: 4
Input Size / Records:
10.1 MiB / 95008
Shuffle Write Size / Records:
14.4 MiB / 95008
Associated Job Ids:
444
DAG Visualization
digraph G { subgraph clusterstage_466 { label="Stage 466"; subgraph cluster6214 { label="Scan csv "; 2746 [labelType="html" label="FileScanRDD [2746]<br>takeAsList at DataFrameCommonJob.java:143"]; 2747 [labelType="html" label="MapPartitionsRDD [2747]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster6209 { label="WholeStageCodegen (1)"; 2748 [labelType="html" label="MapPartitionsRDD [2748]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster6220 { label="Scan csv "; 2749 [labelType="html" label="FileScanRDD [2749]<br>takeAsList at DataFrameCommonJob.java:143"]; 2750 [labelType="html" label="MapPartitionsRDD [2750]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster6215 { label="WholeStageCodegen (2)"; 2751 [labelType="html" label="MapPartitionsRDD [2751]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster6208 { label="Union"; 2752 [labelType="html" label="UnionRDD [2752]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster6205 { label="WholeStageCodegen (3)"; 2753 [labelType="html" label="MapPartitionsRDD [2753]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster6204 { label="Exchange"; 2754 [labelType="html" label="MapPartitionsRDD [2754]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 2746->2747; 2747->2748; 2749->2750; 2750->2751; 2748->2752; 2751->2752; 2752->2753; 2753->2754; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time