3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 2979 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
83 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
1418.3 KiB / 1
Associated Job Ids:
1999
DAG Visualization
digraph G { subgraph clusterstage_2979 { label="Stage 2979"; subgraph cluster20500 { label="Scan json "; 8783 [labelType="html" label="FileScanRDD [8783]<br>count at CreateSubscriptionService.java:123"]; 8784 [labelType="html" label="MapPartitionsRDD [8784]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20495 { label="WholeStageCodegen (1)"; 8785 [labelType="html" label="MapPartitionsRDD [8785]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20501 { label="mapPartitionsInternal"; 8786 [labelType="html" label="MapPartitionsRDD [8786]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20502 { label="mapPartitionsInternal"; 8787 [labelType="html" label="*(1) Project [80a3576a-b2c4-46c7-8133-c3bc467016b7#337922.geometry AS 0434CA56_A5BE_4ABA_89B9_69FE884166CD#338009, 80a3576a-b2c4-46c7-8133-c3bc467016b7#337922.properties.code AS 7A483F46_8F71_4845_A643_4CD4E6C9D52C#338010, 80a3576a-b2c4-46c7-8133-c3bc467016b7#337922.properties.nom AS F46CAE2F_E976_41EA_992C_FC7E976A1B56#338011]\n+- *(1) Generate explode(f7b40229-896d-4133-9e1b-0513e620bf59#337916), true, [80a3576a-b2c4-46c7-8133-c3bc467016b7#337922]\n +- *(1) Project [features#337907 AS f7b40229-896d-4133-9e1b-0513e620bf59#337916]\n +- FileScan json [features#337907] Batched: false, DataFilters: [], Format: JSON, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/json/execution/0B11148E_00BE_4484_B27D_E8083071..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<features:array<struct<geometry:string,properties:struct<code:string,nom:string>,type:strin...\n [8787] [Cached]<br>count at CreateSubscriptionService.java:123"]; } } 8783->8784; 8784->8785; 8785->8786; 8786->8787; }
8787
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time