hdh-spark-job - Details for Query 1267

Submitted Time: 2026/10/27 14:59:22
Duration: 0.5 s
Succeeded Jobs: 1197 1198 1199 1200 1201 1202 1203 1204

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (14)\n \nduration: 1 ms"; 2 [labelType="html" label="HashAggregate spill size: 0.0 B time in aggregation build: 0 ms peak memory: 64.2 MiB number of output rows: 1 number of sort fallback tasks: 0 avg hash probes per key: 1"]; } 3 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 72.0 B number of coalesced partitions: 1"]; 4 [labelType="html" label="Exchange shuffle records written: 1 local merged chunks fetched: 0 shuffle write time: 0 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 1 local bytes read: 68.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 24.0 B local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 68.0 B"]; subgraph cluster5 { isCluster="true"; label="WholeStageCodegen (13)\n \nduration: 30 ms"; 6 [labelType="html" label="HashAggregate spill size: 0.0 B time in aggregation build: 26 ms peak memory: 256.0 KiB number of output rows: 1 number of sort fallback tasks: 0 avg hash probes per key: 0"]; 7 [labelType="html" label=" Project "]; 8 [labelType="html" label="SortMergeJoin number of output rows: 1 spill size: 0.0 B"]; } subgraph cluster9 { isCluster="true"; label="WholeStageCodegen (11)\n \nduration: 44 ms"; 10 [labelType="html" label="Sort sort time: 0 ms peak memory: 64.1 MiB spill size: 0.0 B"]; } 11 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 88.0 B number of coalesced partitions: 1"]; 12 [labelType="html" label="Exchange shuffle records written: 1 local merged chunks fetched: 0 shuffle write time: 0 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 1 local bytes read: 82.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 48.0 B local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 82.0 B"]; subgraph cluster13 { isCluster="true"; label="WholeStageCodegen (10)\n \nduration: 3 ms"; 14 [labelType="html" label=" Project "]; 15 [labelType="html" label="Filter number of output rows: 1"]; 16 [labelType="html" label="SortMergeJoin number of output rows: 445 spill size: 0.0 B"]; } subgraph cluster17 { isCluster="true"; label="WholeStageCodegen (8)\n \nduration: 18 ms"; 18 [labelType="html" label="Sort sort time: 0 ms peak memory: 64.1 MiB spill size: 0.0 B"]; } 19 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 15.3 KiB number of coalesced partitions: 1"]; 20 [labelType="html" label="Exchange shuffle records written: 445 local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 445 local bytes read: 14.7 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 51.8 KiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 14.7 KiB"]; subgraph cluster21 { isCluster="true"; label="WholeStageCodegen (7)\n \nduration: 28 ms"; 22 [labelType="html" label=" Project "]; 23 [labelType="html" label="SortMergeJoin number of output rows: 445 spill size: 0.0 B"]; } subgraph cluster24 { isCluster="true"; label="WholeStageCodegen (5)\n \nduration: 0 ms"; 25 [labelType="html" label="Sort sort time: 10 ms peak memory: 64.5 MiB spill size: 0.0 B"]; } 26 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 416.5 KiB number of coalesced partitions: 1"]; 27 [labelType="html" label="Exchange shuffle records written: 21,121 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 6 ms (1 ms, 2 ms, 2 ms (stage 1907.0: task 1564)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 21,121 local bytes read: 398.4 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 3 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 2.1 MiB (67.3 KiB, 1038.9 KiB, 1038.9 KiB (stage 1907.0: task 1564)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 398.4 KiB (13.9 KiB, 192.2 KiB, 192.3 KiB (stage 1907.0: task 1565))"]; subgraph cluster28 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: total (min, med, max (stageId: taskId))\n197 ms (9 ms, 94 ms, 94 ms (stage 1907.0: task 1564))"; 29 [labelType="html" label=" Project "]; 30 [labelType="html" label="Filter number of output rows: 21,121"]; } 31 [labelType="html" label="Scan csv number of output rows: 21,121 number of files read: 1 metadata time: 0 ms size of files read: 8.3 MiB"]; subgraph cluster32 { isCluster="true"; label="WholeStageCodegen (6)\n \nduration: 36 ms"; 33 [labelType="html" label="Sort sort time: 0 ms peak memory: 64.1 MiB spill size: 0.0 B"]; 34 [labelType="html" label="Filter number of output rows: 445"]; } 35 [labelType="html" label="ObjectHashAggregate number of output rows: 445 time in aggregation build: 6 ms spill size: 0.0 B number of sort fallback tasks: 1"]; 36 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 18.6 KiB number of coalesced partitions: 1"]; 37 [labelType="html" label="Exchange shuffle records written: 445 local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 445 local bytes read: 17.7 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 53.8 KiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 17.7 KiB"]; 38 [labelType="html" label="ObjectHashAggregate number of output rows: 445 time in aggregation build: 14 ms spill size: 0.0 B number of sort fallback tasks: 1"]; subgraph cluster39 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: 14 ms"; 40 [labelType="html" label=" Project "]; } 41 [labelType="html" label="Scan csv number of output rows: 1,216 number of files read: 1 metadata time: 0 ms size of files read: 111.6 KiB"]; subgraph cluster42 { isCluster="true"; label="WholeStageCodegen (9)\n \nduration: 0 ms"; 43 [labelType="html" label="Sort sort time: 0 ms peak memory: 64.1 MiB spill size: 0.0 B"]; } 44 [labelType="html" label="ObjectHashAggregate number of output rows: 464 time in aggregation build: 5 ms spill size: 0.0 B number of sort fallback tasks: 1"]; 45 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 9.6 KiB number of coalesced partitions: 1"]; 46 [labelType="html" label="Exchange shuffle records written: 464 local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 464 local bytes read: 9.1 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 43.8 KiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 9.1 KiB"]; 47 [labelType="html" label="ObjectHashAggregate number of output rows: 464 time in aggregation build: 12 ms spill size: 0.0 B number of sort fallback tasks: 1"]; subgraph cluster48 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: 12 ms"; 49 [labelType="html" label=" Project "]; 50 [labelType="html" label="Filter number of output rows: 486"]; } 51 [labelType="html" label="Scan csv number of output rows: 486 number of files read: 1 metadata time: 0 ms size of files read: 50.8 KiB"]; subgraph cluster52 { isCluster="true"; label="WholeStageCodegen (12)\n \nduration: 0 ms"; 53 [labelType="html" label="Sort sort time: 9 ms peak memory: 65.0 MiB spill size: 0.0 B"]; } 54 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 154.7 KiB number of coalesced partitions: 1"]; 55 [labelType="html" label="Exchange shuffle records written: 26,044 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 4 ms (1 ms, 1 ms, 1 ms (stage 1910.0: task 1569)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 26,044 local bytes read: 147.6 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 3 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 1017.3 KiB (7.0 KiB, 492.0 KiB, 518.3 KiB (stage 1910.0: task 1570)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 147.6 KiB (1883.0 B, 70.6 KiB, 75.1 KiB (stage 1910.0: task 1570))"]; subgraph cluster56 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: total (min, med, max (stageId: taskId))\n164 ms (4 ms, 77 ms, 83 ms (stage 1910.0: task 1570))"; 57 [labelType="html" label=" Project "]; 58 [labelType="html" label="Filter number of output rows: 26,044"]; } 59 [labelType="html" label="Scan csv number of output rows: 26,044 number of files read: 1 metadata time: 0 ms size of files read: 8.0 MiB"]; 2->0; 3->2; 4->3; 6->4; 7->6; 8->7; 10->8; 11->10; 12->11; 14->12; 15->14; 16->15; 18->16; 19->18; 20->19; 22->20; 23->22; 25->23; 26->25; 27->26; 29->27; 30->29; 31->30; 33->23; 34->33; 35->34; 36->35; 37->36; 38->37; 40->38; 41->40; 43->16; 44->43; 45->44; 46->45; 47->46; 49->47; 50->49; 51->50; 53->8; 54->53; 55->54; 57->55; 58->57; 59->58; }

AdaptiveSparkPlan isFinalPlan=true

HashAggregate(keys=[COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335], functions=[count(1)])

WholeStageCodegen (14)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, 10), ENSURE_REQUIREMENTS, [plan_id=47689]

HashAggregate(keys=[knownfloatingpointnormalized(normalizenanandzero(COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335)) AS COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335], functions=[partial_count(1)])

Project [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]

SortMergeJoin [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212], [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539], LeftOuter

WholeStageCodegen (13)

Sort [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212 ASC NULLS FIRST], false, 0

WholeStageCodegen (11)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, 10), ENSURE_REQUIREMENTS, [plan_id=47601]

Project [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]

Filter (((isnull(COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211) OR isnotnull(COL_059961D5_87D2_4745_B270_05C29151B074#463338)) OR isnotnull(MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#463361)) AND (((isnotnull(MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359) AND (COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218 <=> 0.0)) AND NOT (MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359 <=> 0.0)) OR (((COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219 <=> 0.0) AND isnotnull(COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335)) AND NOT (COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335 <=> 0.0))))

SortMergeJoin [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221], [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358], LeftOuter

WholeStageCodegen (10)

Sort [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221 ASC NULLS FIRST], false, 0

WholeStageCodegen (8)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, 10), ENSURE_REQUIREMENTS, [plan_id=47388]

Project [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238 AS COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#463240 AS COL_059961D5_87D2_4745_B270_05C29151B074#463338]

SortMergeJoin [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221], [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237], RightOuter

WholeStageCodegen (7)

Sort [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221 ASC NULLS FIRST], false, 0

WholeStageCodegen (5)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, 10), ENSURE_REQUIREMENTS, [plan_id=47124]

Project [FINESS#459210 AS COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, NO_RSS#459211 AS COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, str_to_dec(MNT_MON#459352, ##.##) AS COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, str_to_dec(MNT_DMI#459353, ##.##) AS COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, str_remove_space(NO_ADMIN#459212, ALL) AS COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221]

Filter isnotnull(str_remove_space(NO_ADMIN#459212, ALL))

WholeStageCodegen (1)

FileScan csv [FINESS#459210,NO_RSS#459211,NO_ADMIN#459212,MNT_MON#459352,MNT_DMI#459353] Batched: false, DataFilters: [isnotnull(str_remove_space(NO_ADMIN#459212, ALL))], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/VISUALVALOSEJOU_440300/420780652.2025.1..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<FINESS:string,NO_RSS:string,NO_ADMIN:string,MNT_MON:string,MNT_DMI:string>

Sort [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237 ASC NULLS FIRST], false, 0

Filter isnotnull(01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238)

WholeStageCodegen (6)

ObjectHashAggregate(keys=[COL_C898C1FE_14C4_493A_878B_315EB757695B#460826], functions=[sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832), collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, 0, 0)])

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, 10), ENSURE_REQUIREMENTS, [plan_id=47139]

ObjectHashAggregate(keys=[COL_C898C1FE_14C4_493A_878B_315EB757695B#460826], functions=[partial_sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832), partial_collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, 0, 0)])

Project [str_remove_space(str_extract_middle(_c0#460721, 12, 20), ALL) AS COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, str_remove_space(str_extract_middle(_c0#460721, 58, 15), ALL) AS COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, round(str_to_dec(str_join(array(str_extract_middle(_c0#460721, 83, 7), str_extract_middle(_c0#460721, 90, 3)), .), ##.##), 2) AS COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832]

WholeStageCodegen (2)

FileScan csv [_c0#460721] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/DMI_M12_2025_440461/DMI-M12-2025 - BIS...., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<_c0:string>

Sort [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358 ASC NULLS FIRST], false, 0

WholeStageCodegen (9)

ObjectHashAggregate(keys=[COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054], functions=[sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061), collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, 0, 0)])

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, 10), ENSURE_REQUIREMENTS, [plan_id=47161]

ObjectHashAggregate(keys=[COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054], functions=[partial_sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061), partial_collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, 0, 0)])

Project [str_remove_space(str_extract_middle(_c0#460920, 12, 20), ALL) AS COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, str_remove_space(str_extract_middle(_c0#460920, 40, 15), ALL) AS COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, str_to_dec(str_join(array(str_extract_middle(_c0#460920, 65, 7), str_extract_middle(_c0#460920, 72, 3)), .), ##.##) AS COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061]

Filter isnotnull(str_remove_space(str_extract_middle(_c0#460920, 12, 20), ALL))

WholeStageCodegen (3)

FileScan csv [_c0#460920] Batched: false, DataFilters: [isnotnull(str_remove_space(str_extract_middle(_c0#460920, 12, 20), ALL))], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/MOLECULES_ONERE_440457/MO-M12-2025.txt], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<_c0:string>

Sort [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539 ASC NULLS FIRST], false, 0

WholeStageCodegen (12)

AQEShuffleRead coalesced

Exchange hashpartitioning(RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539, 10), ENSURE_REQUIREMENTS, [plan_id=47184]

Project [str_extract_middle(_c0#461142, 28, 20) AS RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539]

Filter isnotnull(str_extract_middle(_c0#461142, 28, 20))

WholeStageCodegen (4)

FileScan csv [_c0#461142] Batched: false, DataFilters: [isnotnull(str_extract_middle(_c0#461142, 28, 20))], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/RSS_M12_2025_440462/RSS- 420780652.txt], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<_c0:string>

Details

== Physical Plan ==
AdaptiveSparkPlan (88)
+- == Final Plan ==
   * HashAggregate (52)
   +- AQEShuffleRead (51)
      +- ShuffleQueryStage (50), Statistics(sizeInBytes=24.0 B, rowCount=1)
         +- Exchange (49)
            +- * HashAggregate (48)
               +- * Project (47)
                  +- * SortMergeJoin LeftOuter (46)
                     :- * Sort (38)
                     :  +- AQEShuffleRead (37)
                     :     +- ShuffleQueryStage (36), Statistics(sizeInBytes=48.0 B, rowCount=1)
                     :        +- Exchange (35)
                     :           +- * Project (34)
                     :              +- * Filter (33)
                     :                 +- * SortMergeJoin LeftOuter (32)
                     :                    :- * Sort (22)
                     :                    :  +- AQEShuffleRead (21)
                     :                    :     +- ShuffleQueryStage (20), Statistics(sizeInBytes=51.8 KiB, rowCount=445)
                     :                    :        +- Exchange (19)
                     :                    :           +- * Project (18)
                     :                    :              +- * SortMergeJoin RightOuter (17)
                     :                    :                 :- * Sort (7)
                     :                    :                 :  +- AQEShuffleRead (6)
                     :                    :                 :     +- ShuffleQueryStage (5), Statistics(sizeInBytes=2.1 MiB, rowCount=2.11E+4)
                     :                    :                 :        +- Exchange (4)
                     :                    :                 :           +- * Project (3)
                     :                    :                 :              +- * Filter (2)
                     :                    :                 :                 +- Scan csv  (1)
                     :                    :                 +- * Sort (16)
                     :                    :                    +- * Filter (15)
                     :                    :                       +- ObjectHashAggregate (14)
                     :                    :                          +- AQEShuffleRead (13)
                     :                    :                             +- ShuffleQueryStage (12), Statistics(sizeInBytes=53.8 KiB, rowCount=445)
                     :                    :                                +- Exchange (11)
                     :                    :                                   +- ObjectHashAggregate (10)
                     :                    :                                      +- * Project (9)
                     :                    :                                         +- Scan csv  (8)
                     :                    +- * Sort (31)
                     :                       +- ObjectHashAggregate (30)
                     :                          +- AQEShuffleRead (29)
                     :                             +- ShuffleQueryStage (28), Statistics(sizeInBytes=43.8 KiB, rowCount=464)
                     :                                +- Exchange (27)
                     :                                   +- ObjectHashAggregate (26)
                     :                                      +- * Project (25)
                     :                                         +- * Filter (24)
                     :                                            +- Scan csv  (23)
                     +- * Sort (45)
                        +- AQEShuffleRead (44)
                           +- ShuffleQueryStage (43), Statistics(sizeInBytes=1017.3 KiB, rowCount=2.60E+4)
                              +- Exchange (42)
                                 +- * Project (41)
                                    +- * Filter (40)
                                       +- Scan csv  (39)
+- == Initial Plan ==
   TakeOrderedAndProject (87)
   +- HashAggregate (86)
      +- Exchange (85)
         +- HashAggregate (84)
            +- Project (83)
               +- SortMergeJoin LeftOuter (82)
                  :- Sort (77)
                  :  +- Exchange (76)
                  :     +- Project (75)
                  :        +- Filter (74)
                  :           +- SortMergeJoin LeftOuter (73)
                  :              :- Sort (66)
                  :              :  +- Exchange (65)
                  :              :     +- Project (64)
                  :              :        +- SortMergeJoin RightOuter (63)
                  :              :           :- Sort (56)
                  :              :           :  +- Exchange (55)
                  :              :           :     +- Project (54)
                  :              :           :        +- Filter (53)
                  :              :           :           +- Scan csv  (1)
                  :              :           +- Sort (62)
                  :              :              +- Filter (61)
                  :              :                 +- ObjectHashAggregate (60)
                  :              :                    +- Exchange (59)
                  :              :                       +- ObjectHashAggregate (58)
                  :              :                          +- Project (57)
                  :              :                             +- Scan csv  (8)
                  :              +- Sort (72)
                  :                 +- ObjectHashAggregate (71)
                  :                    +- Exchange (70)
                  :                       +- ObjectHashAggregate (69)
                  :                          +- Project (68)
                  :                             +- Filter (67)
                  :                                +- Scan csv  (23)
                  +- Sort (81)
                     +- Exchange (80)
                        +- Project (79)
                           +- Filter (78)
                              +- Scan csv  (39)


(1) Scan csv 
Output [5]: [FINESS#459210, NO_RSS#459211, NO_ADMIN#459212, MNT_MON#459352, MNT_DMI#459353]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/VISUALVALOSEJOU_440300/420780652.2025.12.MCO.VisualValoSejours.csv]
ReadSchema: struct<FINESS:string,NO_RSS:string,NO_ADMIN:string,MNT_MON:string,MNT_DMI:string>

(2) Filter [codegen id : 1]
Input [5]: [FINESS#459210, NO_RSS#459211, NO_ADMIN#459212, MNT_MON#459352, MNT_DMI#459353]
Condition : isnotnull(str_remove_space(NO_ADMIN#459212, ALL))

(3) Project [codegen id : 1]
Output [5]: [FINESS#459210 AS COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, NO_RSS#459211 AS COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, str_to_dec(MNT_MON#459352, ##.##) AS COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, str_to_dec(MNT_DMI#459353, ##.##) AS COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, str_remove_space(NO_ADMIN#459212, ALL) AS COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221]
Input [5]: [FINESS#459210, NO_RSS#459211, NO_ADMIN#459212, MNT_MON#459352, MNT_DMI#459353]

(4) Exchange
Input [5]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221]
Arguments: hashpartitioning(COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, 10), ENSURE_REQUIREMENTS, [plan_id=47124]

(5) ShuffleQueryStage
Output [5]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221]
Arguments: 0

(6) AQEShuffleRead
Input [5]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221]
Arguments: coalesced

(7) Sort [codegen id : 5]
Input [5]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221]
Arguments: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221 ASC NULLS FIRST], false, 0

(8) Scan csv 
Output [1]: [_c0#460721]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/DMI_M12_2025_440461/DMI-M12-2025 - BIS.txt]
ReadSchema: struct<_c0:string>

(9) Project [codegen id : 2]
Output [3]: [str_remove_space(str_extract_middle(_c0#460721, 12, 20), ALL) AS COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, str_remove_space(str_extract_middle(_c0#460721, 58, 15), ALL) AS COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, round(str_to_dec(str_join(array(str_extract_middle(_c0#460721, 83, 7), str_extract_middle(_c0#460721, 90, 3)), .), ##.##), 2) AS COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832]
Input [1]: [_c0#460721]

(10) ObjectHashAggregate
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832]
Keys [1]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826]
Functions [2]: [partial_sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832), partial_collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, 0, 0)]
Aggregate Attributes [2]: [sum#464116, buf#464117]
Results [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, sum#464118, buf#464119]

(11) Exchange
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, sum#464118, buf#464119]
Arguments: hashpartitioning(COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, 10), ENSURE_REQUIREMENTS, [plan_id=47139]

(12) ShuffleQueryStage
Output [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, sum#464118, buf#464119]
Arguments: 1

(13) AQEShuffleRead
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, sum#464118, buf#464119]
Arguments: coalesced

(14) ObjectHashAggregate
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, sum#464118, buf#464119]
Keys [1]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826]
Functions [2]: [sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832), collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, 0, 0)]
Aggregate Attributes [2]: [sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832)#460854, collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, 0, 0)#460856]
Results [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826 AS 01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237, round(sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832)#460854, 2) AS 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238, size(collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, 0, 0)#460856, true) AS 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#463240]

(15) Filter [codegen id : 6]
Input [3]: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#463240]
Condition : isnotnull(01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238)

(16) Sort [codegen id : 6]
Input [3]: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#463240]
Arguments: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237 ASC NULLS FIRST], false, 0

(17) SortMergeJoin [codegen id : 7]
Left keys [1]: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221]
Right keys [1]: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237]
Join type: RightOuter
Join condition: None

(18) Project [codegen id : 7]
Output [7]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238 AS COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#463240 AS COL_059961D5_87D2_4745_B270_05C29151B074#463338]
Input [8]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, 01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#463240]

(19) Exchange
Input [7]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, COL_059961D5_87D2_4745_B270_05C29151B074#463338]
Arguments: hashpartitioning(COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, 10), ENSURE_REQUIREMENTS, [plan_id=47388]

(20) ShuffleQueryStage
Output [7]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, COL_059961D5_87D2_4745_B270_05C29151B074#463338]
Arguments: 4

(21) AQEShuffleRead
Input [7]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, COL_059961D5_87D2_4745_B270_05C29151B074#463338]
Arguments: coalesced

(22) Sort [codegen id : 8]
Input [7]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, COL_059961D5_87D2_4745_B270_05C29151B074#463338]
Arguments: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221 ASC NULLS FIRST], false, 0

(23) Scan csv 
Output [1]: [_c0#460920]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/MOLECULES_ONERE_440457/MO-M12-2025.txt]
ReadSchema: struct<_c0:string>

(24) Filter [codegen id : 3]
Input [1]: [_c0#460920]
Condition : isnotnull(str_remove_space(str_extract_middle(_c0#460920, 12, 20), ALL))

(25) Project [codegen id : 3]
Output [3]: [str_remove_space(str_extract_middle(_c0#460920, 12, 20), ALL) AS COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, str_remove_space(str_extract_middle(_c0#460920, 40, 15), ALL) AS COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, str_to_dec(str_join(array(str_extract_middle(_c0#460920, 65, 7), str_extract_middle(_c0#460920, 72, 3)), .), ##.##) AS COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061]
Input [1]: [_c0#460920]

(26) ObjectHashAggregate
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061]
Keys [1]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054]
Functions [2]: [partial_sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061), partial_collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, 0, 0)]
Aggregate Attributes [2]: [sum#464120, buf#464121]
Results [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, sum#464122, buf#464123]

(27) Exchange
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, sum#464122, buf#464123]
Arguments: hashpartitioning(COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, 10), ENSURE_REQUIREMENTS, [plan_id=47161]

(28) ShuffleQueryStage
Output [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, sum#464122, buf#464123]
Arguments: 2

(29) AQEShuffleRead
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, sum#464122, buf#464123]
Arguments: coalesced

(30) ObjectHashAggregate
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, sum#464122, buf#464123]
Keys [1]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054]
Functions [2]: [sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061), collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, 0, 0)]
Aggregate Attributes [2]: [sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061)#461088, collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, 0, 0)#461090]
Results [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054 AS MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358, round(sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061)#461088, 2) AS MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359, size(collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, 0, 0)#461090, true) AS MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#463361]

(31) Sort [codegen id : 9]
Input [3]: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#463361]
Arguments: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358 ASC NULLS FIRST], false, 0

(32) SortMergeJoin [codegen id : 10]
Left keys [1]: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221]
Right keys [1]: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358]
Join type: LeftOuter
Join condition: None

(33) Filter [codegen id : 10]
Input [10]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, COL_059961D5_87D2_4745_B270_05C29151B074#463338, MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#463361]
Condition : (((isnull(COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211) OR isnotnull(COL_059961D5_87D2_4745_B270_05C29151B074#463338)) OR isnotnull(MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#463361)) AND (((isnotnull(MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359) AND (COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218 <=> 0.0)) AND NOT (MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359 <=> 0.0)) OR (((COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219 <=> 0.0) AND isnotnull(COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335)) AND NOT (COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335 <=> 0.0))))

(34) Project [codegen id : 10]
Output [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Input [10]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, COL_059961D5_87D2_4745_B270_05C29151B074#463338, MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#463361]

(35) Exchange
Input [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Arguments: hashpartitioning(COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, 10), ENSURE_REQUIREMENTS, [plan_id=47601]

(36) ShuffleQueryStage
Output [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Arguments: 5

(37) AQEShuffleRead
Input [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Arguments: coalesced

(38) Sort [codegen id : 11]
Input [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Arguments: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212 ASC NULLS FIRST], false, 0

(39) Scan csv 
Output [1]: [_c0#461142]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/RSS_M12_2025_440462/RSS- 420780652.txt]
ReadSchema: struct<_c0:string>

(40) Filter [codegen id : 4]
Input [1]: [_c0#461142]
Condition : isnotnull(str_extract_middle(_c0#461142, 28, 20))

(41) Project [codegen id : 4]
Output [1]: [str_extract_middle(_c0#461142, 28, 20) AS RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539]
Input [1]: [_c0#461142]

(42) Exchange
Input [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539]
Arguments: hashpartitioning(RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539, 10), ENSURE_REQUIREMENTS, [plan_id=47184]

(43) ShuffleQueryStage
Output [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539]
Arguments: 3

(44) AQEShuffleRead
Input [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539]
Arguments: coalesced

(45) Sort [codegen id : 12]
Input [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539]
Arguments: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539 ASC NULLS FIRST], false, 0

(46) SortMergeJoin [codegen id : 13]
Left keys [1]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212]
Right keys [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539]
Join type: LeftOuter
Join condition: None

(47) Project [codegen id : 13]
Output [1]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Input [3]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539]

(48) HashAggregate [codegen id : 13]
Input [1]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Keys [1]: [knownfloatingpointnormalized(normalizenanandzero(COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335)) AS COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#464114L]
Results [2]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, count#464115L]

(49) Exchange
Input [2]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, count#464115L]
Arguments: hashpartitioning(COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, 10), ENSURE_REQUIREMENTS, [plan_id=47689]

(50) ShuffleQueryStage
Output [2]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, count#464115L]
Arguments: 6

(51) AQEShuffleRead
Input [2]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, count#464115L]
Arguments: coalesced

(52) HashAggregate [codegen id : 14]
Input [2]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, count#464115L]
Keys [1]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#464105L]
Results [2]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335 AS COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC41#464080, count(1)#464105L AS COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC42#464107L]

(53) Filter
Input [5]: [FINESS#459210, NO_RSS#459211, NO_ADMIN#459212, MNT_MON#459352, MNT_DMI#459353]
Condition : isnotnull(str_remove_space(NO_ADMIN#459212, ALL))

(54) Project
Output [5]: [FINESS#459210 AS COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, NO_RSS#459211 AS COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, str_to_dec(MNT_MON#459352, ##.##) AS COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, str_to_dec(MNT_DMI#459353, ##.##) AS COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, str_remove_space(NO_ADMIN#459212, ALL) AS COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221]
Input [5]: [FINESS#459210, NO_RSS#459211, NO_ADMIN#459212, MNT_MON#459352, MNT_DMI#459353]

(55) Exchange
Input [5]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221]
Arguments: hashpartitioning(COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, 10), ENSURE_REQUIREMENTS, [plan_id=47020]

(56) Sort
Input [5]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221]
Arguments: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221 ASC NULLS FIRST], false, 0

(57) Project
Output [3]: [str_remove_space(str_extract_middle(_c0#460721, 12, 20), ALL) AS COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, str_remove_space(str_extract_middle(_c0#460721, 58, 15), ALL) AS COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, round(str_to_dec(str_join(array(str_extract_middle(_c0#460721, 83, 7), str_extract_middle(_c0#460721, 90, 3)), .), ##.##), 2) AS COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832]
Input [1]: [_c0#460721]

(58) ObjectHashAggregate
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832]
Keys [1]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826]
Functions [2]: [partial_sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832), partial_collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, 0, 0)]
Aggregate Attributes [2]: [sum#464116, buf#464117]
Results [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, sum#464118, buf#464119]

(59) Exchange
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, sum#464118, buf#464119]
Arguments: hashpartitioning(COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, 10), ENSURE_REQUIREMENTS, [plan_id=47015]

(60) ObjectHashAggregate
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826, sum#464118, buf#464119]
Keys [1]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826]
Functions [2]: [sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832), collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, 0, 0)]
Aggregate Attributes [2]: [sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832)#460854, collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, 0, 0)#460856]
Results [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#460826 AS 01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237, round(sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#460832)#460854, 2) AS 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238, size(collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#460828, 0, 0)#460856, true) AS 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#463240]

(61) Filter
Input [3]: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#463240]
Condition : isnotnull(01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238)

(62) Sort
Input [3]: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#463240]
Arguments: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237 ASC NULLS FIRST], false, 0

(63) SortMergeJoin
Left keys [1]: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221]
Right keys [1]: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237]
Join type: RightOuter
Join condition: None

(64) Project
Output [7]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238 AS COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#463240 AS COL_059961D5_87D2_4745_B270_05C29151B074#463338]
Input [8]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, 01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#463237, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#463238, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#463240]

(65) Exchange
Input [7]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, COL_059961D5_87D2_4745_B270_05C29151B074#463338]
Arguments: hashpartitioning(COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, 10), ENSURE_REQUIREMENTS, [plan_id=47029]

(66) Sort
Input [7]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, COL_059961D5_87D2_4745_B270_05C29151B074#463338]
Arguments: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221 ASC NULLS FIRST], false, 0

(67) Filter
Input [1]: [_c0#460920]
Condition : isnotnull(str_remove_space(str_extract_middle(_c0#460920, 12, 20), ALL))

(68) Project
Output [3]: [str_remove_space(str_extract_middle(_c0#460920, 12, 20), ALL) AS COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, str_remove_space(str_extract_middle(_c0#460920, 40, 15), ALL) AS COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, str_to_dec(str_join(array(str_extract_middle(_c0#460920, 65, 7), str_extract_middle(_c0#460920, 72, 3)), .), ##.##) AS COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061]
Input [1]: [_c0#460920]

(69) ObjectHashAggregate
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061]
Keys [1]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054]
Functions [2]: [partial_sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061), partial_collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, 0, 0)]
Aggregate Attributes [2]: [sum#464120, buf#464121]
Results [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, sum#464122, buf#464123]

(70) Exchange
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, sum#464122, buf#464123]
Arguments: hashpartitioning(COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, 10), ENSURE_REQUIREMENTS, [plan_id=47025]

(71) ObjectHashAggregate
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054, sum#464122, buf#464123]
Keys [1]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054]
Functions [2]: [sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061), collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, 0, 0)]
Aggregate Attributes [2]: [sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061)#461088, collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, 0, 0)#461090]
Results [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#461054 AS MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358, round(sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#461061)#461088, 2) AS MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359, size(collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#461056, 0, 0)#461090, true) AS MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#463361]

(72) Sort
Input [3]: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#463361]
Arguments: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358 ASC NULLS FIRST], false, 0

(73) SortMergeJoin
Left keys [1]: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221]
Right keys [1]: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358]
Join type: LeftOuter
Join condition: None

(74) Filter
Input [10]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, COL_059961D5_87D2_4745_B270_05C29151B074#463338, MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#463361]
Condition : (((isnull(COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211) OR isnotnull(COL_059961D5_87D2_4745_B270_05C29151B074#463338)) OR isnotnull(MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#463361)) AND (((isnotnull(MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359) AND (COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218 <=> 0.0)) AND NOT (MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359 <=> 0.0)) OR (((COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219 <=> 0.0) AND isnotnull(COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335)) AND NOT (COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335 <=> 0.0))))

(75) Project
Output [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Input [10]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#463211, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#463218, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#463219, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#463221, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, COL_059961D5_87D2_4745_B270_05C29151B074#463338, MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#463358, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#463359, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#463361]

(76) Exchange
Input [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Arguments: hashpartitioning(COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, 10), ENSURE_REQUIREMENTS, [plan_id=47039]

(77) Sort
Input [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Arguments: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212 ASC NULLS FIRST], false, 0

(78) Filter
Input [1]: [_c0#461142]
Condition : isnotnull(str_extract_middle(_c0#461142, 28, 20))

(79) Project
Output [1]: [str_extract_middle(_c0#461142, 28, 20) AS RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539]
Input [1]: [_c0#461142]

(80) Exchange
Input [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539]
Arguments: hashpartitioning(RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539, 10), ENSURE_REQUIREMENTS, [plan_id=47040]

(81) Sort
Input [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539]
Arguments: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539 ASC NULLS FIRST], false, 0

(82) SortMergeJoin
Left keys [1]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212]
Right keys [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539]
Join type: LeftOuter
Join condition: None

(83) Project
Output [1]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Input [3]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#463212, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#463539]

(84) HashAggregate
Input [1]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Keys [1]: [knownfloatingpointnormalized(normalizenanandzero(COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335)) AS COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#464114L]
Results [2]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, count#464115L]

(85) Exchange
Input [2]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, count#464115L]
Arguments: hashpartitioning(COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, 10), ENSURE_REQUIREMENTS, [plan_id=47047]

(86) HashAggregate
Input [2]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335, count#464115L]
Keys [1]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335]
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#464105L]
Results [2]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#463335 AS COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC41#464080, count(1)#464105L AS COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC42#464107L]

(87) TakeOrderedAndProject
Input [2]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC41#464080, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC42#464107L]
Arguments: 10, [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC42#464107L DESC NULLS LAST], [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC41#464080, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC42#464107L]

(88) AdaptiveSparkPlan
Output [2]: [COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC41#464080, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC42#464107L]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet