3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 3005 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
1943.8 KiB / 1
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
2020
DAG Visualization
digraph G { subgraph clusterstage_3005 { label="Stage 3005"; subgraph cluster20710 { label="Scan json "; 8868 [labelType="html" label="FileScanRDD [8868]<br>count at CreateSubscriptionService.java:123"]; 8869 [labelType="html" label="MapPartitionsRDD [8869]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20705 { label="WholeStageCodegen (1)"; 8870 [labelType="html" label="MapPartitionsRDD [8870]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20711 { label="mapPartitionsInternal"; 8871 [labelType="html" label="MapPartitionsRDD [8871]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20712 { label="mapPartitionsInternal"; 8872 [labelType="html" label="*(1) Project [e31c362b-b0fe-4410-abc0-8b7e6356c2a7#339272.geometry AS E247BEFE_AB5C_4D81_8B64_BF95A647085F#339359, e31c362b-b0fe-4410-abc0-8b7e6356c2a7#339272.properties.code AS A515BFE0_7BF2_4BBC_A2A9_3A92231555D3#339360, e31c362b-b0fe-4410-abc0-8b7e6356c2a7#339272.properties.nom AS 22BB782D_3E3A_4289_ACEA_1D9E2504DA26#339361]\n+- *(1) Generate explode(8219b6ce-db7d-4597-b08a-f163015ed190#339266), true, [e31c362b-b0fe-4410-abc0-8b7e6356c2a7#339272]\n +- *(1) Project [features#339257 AS 8219b6ce-db7d-4597-b08a-f163015ed190#339266]\n +- FileScan json [features#339257] Batched: false, DataFilters: [], Format: JSON, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/json/execution/C47DDBBA_8DEB_4565_9D59_420A0217..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<features:array<struct<geometry:string,properties:struct<code:string,nom:string>,type:strin...\n [8872] [Cached]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20718 { label="InMemoryTableScan"; 8873 [labelType="html" label="MapPartitionsRDD [8873]<br>count at CreateSubscriptionService.java:123"]; 8874 [labelType="html" label="MapPartitionsRDD [8874]<br>count at CreateSubscriptionService.java:123"]; 8875 [labelType="html" label="MapPartitionsRDD [8875]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20714 { label="WholeStageCodegen (1)"; 8876 [labelType="html" label="MapPartitionsRDD [8876]<br>count at CreateSubscriptionService.java:123"]; } subgraph cluster20713 { label="Exchange"; 8877 [labelType="html" label="MapPartitionsRDD [8877]<br>count at CreateSubscriptionService.java:123"]; } } 8868->8869; 8869->8870; 8870->8871; 8871->8872; 8872->8873; 8873->8874; 8874->8875; 8875->8876; 8876->8877; }
8872
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time