3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2984 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
3.3 MiB / 1
Associated Job Ids:
2003
DAG Visualization
digraph G { subgraph clusterstage_2984 { label="Stage 2984"; subgraph cluster20542 { label="Scan json "; 8800 [labelType="html" label="FileScanRDD [8800]<br>count at CreateSubscriptionService.java:123"]; 8801 [labelType="html" label="MapPartitionsRDD [8801]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20537 { label="WholeStageCodegen (1)"; 8802 [labelType="html" label="MapPartitionsRDD [8802]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20543 { label="mapPartitionsInternal"; 8803 [labelType="html" label="MapPartitionsRDD [8803]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20544 { label="mapPartitionsInternal"; 8804 [labelType="html" label="*(1) Project [dd46a5ad-faf5-4ebc-9892-f47eb5a7d1f1#338192.geometry AS FD101D31_C657_439C_A284_085511FA0D94#338279, dd46a5ad-faf5-4ebc-9892-f47eb5a7d1f1#338192.properties.code AS 5C943F9D_D5C2_45DE_993E_23A1210DE0D0#338280, dd46a5ad-faf5-4ebc-9892-f47eb5a7d1f1#338192.properties.nom AS 2F836F90_DCC5_4A8D_B273_DFFD62D2CC41#338281]\n+- *(1) Generate explode(711dd5e6-2106-47d9-a5b5-8fbe472034f9#338186), true, [dd46a5ad-faf5-4ebc-9892-f47eb5a7d1f1#338192]\n +- *(1) Project [features#338177 AS 711dd5e6-2106-47d9-a5b5-8fbe472034f9#338186]\n +- FileScan json [features#338177] Batched: false, DataFilters: [], Format: JSON, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/json/execution/0A476A12_2BFF_4FD8_AC75_C83E2134..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<features:array<struct<geometry:string,properties:struct<code:string,nom:string>,type:strin...\n [8804] [Cached]<br>count at CreateSubscriptionService.java:123"]; } } 8800->8801; 8801->8802; 8802->8803; 8803->8804; }
8804
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time