3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 3008 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
39 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
1943.8 KiB / 1
Output Size / Records:
931.3 KiB / 18
Associated Job Ids:
2022
DAG Visualization
digraph G { subgraph clusterstage_3008 { label="Stage 3008"; subgraph cluster20710 { label="Scan json "; 8868 [labelType="html" label="FileScanRDD [8868]<br>count at CreateSubscriptionService.java:123"]; 8869 [labelType="html" label="MapPartitionsRDD [8869]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20705 { label="WholeStageCodegen (1)"; 8870 [labelType="html" label="MapPartitionsRDD [8870]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20711 { label="mapPartitionsInternal"; 8871 [labelType="html" label="MapPartitionsRDD [8871]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20712 { label="mapPartitionsInternal"; 8872 [labelType="html" label="*(1) Project [e31c362b-b0fe-4410-abc0-8b7e6356c2a7#339272.geometry AS E247BEFE_AB5C_4D81_8B64_BF95A647085F#339359, e31c362b-b0fe-4410-abc0-8b7e6356c2a7#339272.properties.code AS A515BFE0_7BF2_4BBC_A2A9_3A92231555D3#339360, e31c362b-b0fe-4410-abc0-8b7e6356c2a7#339272.properties.nom AS 22BB782D_3E3A_4289_ACEA_1D9E2504DA26#339361]\n+- *(1) Generate explode(8219b6ce-db7d-4597-b08a-f163015ed190#339266), true, [e31c362b-b0fe-4410-abc0-8b7e6356c2a7#339272]\n +- *(1) Project [features#339257 AS 8219b6ce-db7d-4597-b08a-f163015ed190#339266]\n +- FileScan json [features#339257] Batched: false, DataFilters: [], Format: JSON, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/json/execution/C47DDBBA_8DEB_4565_9D59_420A0217..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<features:array<struct<geometry:string,properties:struct<code:string,nom:string>,type:strin...\n [8872] [Cached]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20741 { label="InMemoryTableScan"; 8881 [labelType="html" label="MapPartitionsRDD [8881]<br>parquet at CreateSubscriptionService.java:124"]; 8882 [labelType="html" label="MapPartitionsRDD [8882]<br>parquet at CreateSubscriptionService.java:124"]; 8883 [labelType="html" label="MapPartitionsRDD [8883]<br>parquet at CreateSubscriptionService.java:124"]; } subgraph cluster20739 { label="WriteFiles"; 8884 [labelType="html" label="MapPartitionsRDD [8884]<br>parquet at CreateSubscriptionService.java:124"]; } } 8868->8869; 8869->8870; 8870->8871; 8871->8872; 8872->8881; 8881->8882; 8882->8883; 8883->8884; }
8872
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time