3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 464 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
30 s
Locality Level Summary:
Process local: 11
Input Size / Records:
104.7 MiB / 1073102
Shuffle Write Size / Records:
649.0 B / 11
Associated Job Ids:
442
DAG Visualization
digraph G { subgraph clusterstage_464 { label="Stage 464"; 2727 [labelType="html" label="JDBCRDD [2727]<br>takeAsList at DataFrameCommonJob.java:143"]; subgraph cluster6197 { label="Scan csv "; 2735 [labelType="html" label="FileScanRDD [2735]<br>takeAsList at DataFrameCommonJob.java:143"]; 2736 [labelType="html" label="MapPartitionsRDD [2736]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster6160 { label="WholeStageCodegen (1)"; 2737 [labelType="html" label="MapPartitionsRDD [2737]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster6198 { label="WholeStageCodegen (2)"; 2738 [labelType="html" label="MapPartitionsRDD [2738]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster6159 { label="Union"; 2740 [labelType="html" label="UnionRDD [2740]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster6156 { label="WholeStageCodegen (3)"; 2742 [labelType="html" label="MapPartitionsRDD [2742]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster6155 { label="Exchange"; 2743 [labelType="html" label="MapPartitionsRDD [2743]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 2735->2736; 2736->2737; 2727->2738; 2737->2740; 2738->2740; 2740->2742; 2742->2743; }
Event Timeline
Enable zooming
Tasks: 11. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time