3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 3000 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
42.0 MiB / 11
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
2016
DAG Visualization
digraph G { subgraph clusterstage_3000 { label="Stage 3000"; subgraph cluster20668 { label="Scan json "; 8851 [labelType="html" label="FileScanRDD [8851]<br>count at CreateSubscriptionService.java:123"]; 8852 [labelType="html" label="MapPartitionsRDD [8852]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20663 { label="WholeStageCodegen (1)"; 8853 [labelType="html" label="MapPartitionsRDD [8853]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20669 { label="mapPartitionsInternal"; 8854 [labelType="html" label="MapPartitionsRDD [8854]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20670 { label="mapPartitionsInternal"; 8855 [labelType="html" label="*(1) Project [343cd3c5-4ab7-4163-9ed2-9f8d88c9077f#339002.geometry AS 3CA8F2B5_7A47_4F4C_8FEC_E207BE4F5E8D#339089, 343cd3c5-4ab7-4163-9ed2-9f8d88c9077f#339002.properties.code AS E22536DE_090D_4DC8_8C68_0115B901E4BE#339090, 343cd3c5-4ab7-4163-9ed2-9f8d88c9077f#339002.properties.nom AS 61B6FDFC_8690_42AE_9323_0BD93388D39D#339091]\n+- *(1) Generate explode(ffe737ef-26df-476f-a0ab-bf1ea7d7463c#338996), true, [343cd3c5-4ab7-4163-9ed2-9f8d88c9077f#339002]\n +- *(1) Project [features#338987 AS ffe737ef-26df-476f-a0ab-bf1ea7d7463c#338996]\n +- FileScan json [features#338987] Batched: false, DataFilters: [], Format: JSON, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/json/execution/188025A0_DDA0_4EDF_AD73_BCF1A7CE..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<features:array<struct<geometry:string,properties:struct<code:string,nom:string>,type:strin...\n [8855] [Cached]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20676 { label="InMemoryTableScan"; 8856 [labelType="html" label="MapPartitionsRDD [8856]<br>count at CreateSubscriptionService.java:123"]; 8857 [labelType="html" label="MapPartitionsRDD [8857]<br>count at CreateSubscriptionService.java:123"]; 8858 [labelType="html" label="MapPartitionsRDD [8858]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20672 { label="WholeStageCodegen (1)"; 8859 [labelType="html" label="MapPartitionsRDD [8859]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20671 { label="Exchange"; 8860 [labelType="html" label="MapPartitionsRDD [8860]<br>count at CreateSubscriptionService.java:123"]; } } 8851->8852; 8852->8853; 8853->8854; 8854->8855; 8855->8856; 8856->8857; 8857->8858; 8858->8859; 8859->8860; }
8855
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time