3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2616 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 4
Input Size / Records:
10.1 MiB / 95008
Shuffle Write Size / Records:
14.4 MiB / 95008
Associated Job Ids:
1742
DAG Visualization
digraph G { subgraph clusterstage_2616 { label="Stage 2616"; subgraph cluster17744 { label="Scan csv "; 7499 [labelType="html" label="FileScanRDD [7499]<br>takeAsList at DataFrameCommonJob.java:143"]; 7501 [labelType="html" label="MapPartitionsRDD [7501]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17725 { label="WholeStageCodegen (3)"; 7503 [labelType="html" label="MapPartitionsRDD [7503]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17757 { label="Scan csv "; 7506 [labelType="html" label="FileScanRDD [7506]<br>takeAsList at DataFrameCommonJob.java:143"]; 7508 [labelType="html" label="MapPartitionsRDD [7508]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17746 { label="WholeStageCodegen (4)"; 7510 [labelType="html" label="MapPartitionsRDD [7510]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17724 { label="Union"; 7512 [labelType="html" label="UnionRDD [7512]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17714 { label="WholeStageCodegen (5)"; 7515 [labelType="html" label="MapPartitionsRDD [7515]<br>takeAsList at DataFrameCommonJob.java:143"]; } subgraph cluster17713 { label="Exchange"; 7516 [labelType="html" label="MapPartitionsRDD [7516]<br>takeAsList at DataFrameCommonJob.java:143"]; } } 7499->7501; 7501->7503; 7506->7508; 7508->7510; 7503->7512; 7510->7512; 7512->7515; 7515->7516; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time