3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 3202 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 1
Input Size / Records:
30.2 MiB / 438506
Output Size / Records:
25.6 MiB / 438506
Associated Job Ids:
2193
DAG Visualization
digraph G { subgraph clusterstage_3202 { label="Stage 3202"; 9767 [labelType="html" label="SQLExecutionRDD [9767]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster22466 { label="Scan csv "; 9763 [labelType="html" label="FileScanRDD [9763]<br>toJavaRDD at AbsExportExecutor.java:55"]; 9764 [labelType="html" label="MapPartitionsRDD [9764]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster22463 { label="WholeStageCodegen (1)"; 9765 [labelType="html" label="MapPartitionsRDD [9765]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster22462 { label="DeserializeToObject"; 9766 [labelType="html" label="MapPartitionsRDD [9766]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster22467 { label="mapPartitions"; 9768 [labelType="html" label="MapPartitionsRDD [9768]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster22468 { label="map"; 9769 [labelType="html" label="MapPartitionsRDD [9769]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster22475 { label="WholeStageCodegen (1)"; 9774 [labelType="html" label="MapPartitionsRDD [9774]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster22474 { label="Coalesce"; 9775 [labelType="html" label="CoalescedRDD [9775]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster22473 { label="WriteFiles"; 9776 [labelType="html" label="MapPartitionsRDD [9776]<br>save at DataFrameCsvWriter.java:13"]; } } 9763->9764; 9764->9765; 9765->9766; 9766->9767; 9767->9768; 9768->9769; 9769->9774; 9774->9775; 9775->9776; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time