3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 3186 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.3 s
Locality Level Summary:
Process local: 1
Input Size / Records:
116.4 KiB / 18958
Output Size / Records:
781.6 KiB / 18958
Associated Job Ids:
2179
DAG Visualization
digraph G { subgraph clusterstage_3186 { label="Stage 3186"; 9657 [labelType="html" label="SQLExecutionRDD [9657]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster22282 { label="Scan parquet "; 9653 [labelType="html" label="FileScanRDD [9653]<br>toJavaRDD at AbsExportExecutor.java:55"]; 9654 [labelType="html" label="MapPartitionsRDD [9654]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster22278 { label="WholeStageCodegen (1)"; 9655 [labelType="html" label="MapPartitionsRDD [9655]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster22277 { label="DeserializeToObject"; 9656 [labelType="html" label="MapPartitionsRDD [9656]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster22283 { label="mapPartitions"; 9658 [labelType="html" label="MapPartitionsRDD [9658]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster22284 { label="map"; 9659 [labelType="html" label="MapPartitionsRDD [9659]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster22291 { label="WholeStageCodegen (1)"; 9664 [labelType="html" label="MapPartitionsRDD [9664]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster22290 { label="Coalesce"; 9665 [labelType="html" label="CoalescedRDD [9665]<br>save at DataFrameCsvWriter.java:13"]; } subgraph cluster22289 { label="WriteFiles"; 9666 [labelType="html" label="MapPartitionsRDD [9666]<br>save at DataFrameCsvWriter.java:13"]; } } 9653->9654; 9654->9655; 9655->9656; 9656->9657; 9657->9658; 9658->9659; 9659->9664; 9664->9665; 9665->9666; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time