3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2615 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Process local: 4
Input Size / Records:
10.1 MiB / 95008
Shuffle Write Size / Records:
14.4 MiB / 95008
Associated Job Ids:
1741
DAG Visualization
digraph G { subgraph clusterstage_2615 { label="Stage 2615"; subgraph cluster17745 { label="Scan csv "; 7500 [labelType="html" label="FileScanRDD [7500]<br>count at ColumnStatJob.java:47"]; 7502 [labelType="html" label="MapPartitionsRDD [7502]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17739 { label="WholeStageCodegen (3)"; 7504 [labelType="html" label="MapPartitionsRDD [7504]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17756 { label="Scan csv "; 7505 [labelType="html" label="FileScanRDD [7505]<br>count at ColumnStatJob.java:47"]; 7507 [labelType="html" label="MapPartitionsRDD [7507]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17751 { label="WholeStageCodegen (4)"; 7509 [labelType="html" label="MapPartitionsRDD [7509]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17738 { label="Union"; 7511 [labelType="html" label="UnionRDD [7511]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17735 { label="WholeStageCodegen (5)"; 7513 [labelType="html" label="MapPartitionsRDD [7513]<br>count at ColumnStatJob.java:47"]; } subgraph cluster17734 { label="Exchange"; 7514 [labelType="html" label="MapPartitionsRDD [7514]<br>count at ColumnStatJob.java:47"]; } } 7500->7502; 7502->7504; 7505->7507; 7507->7509; 7504->7511; 7509->7511; 7511->7513; 7513->7514; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time