hdh-spark-job - Details for Query 1243

Submitted Time: 2026/10/27 14:58:54
Duration: 0.6 s
Succeeded Jobs: 1174 1175 1176 1177 1178 1179 1180

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; 1 [labelType="html" label=" TakeOrderedAndProject "]; subgraph cluster2 { isCluster="true"; label="WholeStageCodegen (13)\n \nduration: 2 ms"; 3 [labelType="html" label="HashAggregate spill size: 0.0 B time in aggregation build: 0 ms peak memory: 64.2 MiB number of output rows: 5 number of sort fallback tasks: 0 avg hash probes per key: 1"]; } 4 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 296.0 B number of coalesced partitions: 1"]; 5 [labelType="html" label="Exchange shuffle records written: 5 local merged chunks fetched: 0 shuffle write time: 0 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 5 local bytes read: 284.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 120.0 B local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 284.0 B"]; subgraph cluster6 { isCluster="true"; label="WholeStageCodegen (12)\n \nduration: 41 ms"; 7 [labelType="html" label="HashAggregate spill size: 0.0 B time in aggregation build: 26 ms peak memory: 256.0 KiB number of output rows: 5 number of sort fallback tasks: 0 avg hash probes per key: 0"]; 8 [labelType="html" label=" Project "]; 9 [labelType="html" label="SortMergeJoin number of output rows: 247 spill size: 0.0 B"]; } subgraph cluster10 { isCluster="true"; label="WholeStageCodegen (10)\n \nduration: 54 ms"; 11 [labelType="html" label="Sort sort time: 0 ms peak memory: 64.1 MiB spill size: 0.0 B"]; } 12 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 3.4 KiB number of coalesced partitions: 1"]; 13 [labelType="html" label="Exchange shuffle records written: 247 local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 247 local bytes read: 3.2 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 11.6 KiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 3.2 KiB"]; subgraph cluster14 { isCluster="true"; label="WholeStageCodegen (9)\n \nduration: 58 ms"; 15 [labelType="html" label=" Project "]; 16 [labelType="html" label="Filter number of output rows: 247"]; 17 [labelType="html" label="SortMergeJoin number of output rows: 464 spill size: 0.0 B"]; } subgraph cluster18 { isCluster="true"; label="WholeStageCodegen (7)\n \nduration: 0 ms"; 19 [labelType="html" label=" Project "]; 20 [labelType="html" label="SortMergeJoin number of output rows: 21,121 spill size: 0.0 B"]; } subgraph cluster21 { isCluster="true"; label="WholeStageCodegen (5)\n \nduration: 0 ms"; 22 [labelType="html" label="Sort sort time: 10 ms peak memory: 64.5 MiB spill size: 0.0 B"]; } 23 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 416.5 KiB number of coalesced partitions: 1"]; 24 [labelType="html" label="Exchange shuffle records written: 21,121 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 5 ms (1 ms, 1 ms, 1 ms (stage 1851.0: task 1533)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 21,121 local bytes read: 398.4 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 3 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 2.1 MiB (67.3 KiB, 1038.9 KiB, 1038.9 KiB (stage 1851.0: task 1534)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 398.4 KiB (13.9 KiB, 192.2 KiB, 192.3 KiB (stage 1851.0: task 1534))"]; subgraph cluster25 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: total (min, med, max (stageId: taskId))\n232 ms (10 ms, 109 ms, 113 ms (stage 1851.0: task 1533))"; 26 [labelType="html" label=" Project "]; 27 [labelType="html" label="Filter number of output rows: 21,121"]; } 28 [labelType="html" label="Scan csv number of output rows: 21,121 number of files read: 1 metadata time: 0 ms size of files read: 8.3 MiB"]; subgraph cluster29 { isCluster="true"; label="WholeStageCodegen (6)\n \nduration: 1.6 m"; 30 [labelType="html" label="Sort sort time: 0 ms peak memory: 64.1 MiB spill size: 0.0 B"]; } 31 [labelType="html" label="ObjectHashAggregate number of output rows: 445 time in aggregation build: 5 ms spill size: 0.0 B number of sort fallback tasks: 1"]; 32 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 18.6 KiB number of coalesced partitions: 1"]; 33 [labelType="html" label="Exchange shuffle records written: 445 local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 445 local bytes read: 17.7 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 53.8 KiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 17.7 KiB"]; 34 [labelType="html" label="ObjectHashAggregate number of output rows: 445 time in aggregation build: 14 ms spill size: 0.0 B number of sort fallback tasks: 1"]; subgraph cluster35 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: 14 ms"; 36 [labelType="html" label=" Project "]; } 37 [labelType="html" label="Scan csv number of output rows: 1,216 number of files read: 1 metadata time: 0 ms size of files read: 111.6 KiB"]; subgraph cluster38 { isCluster="true"; label="WholeStageCodegen (8)\n \nduration: 81 ms"; 39 [labelType="html" label="Sort sort time: 0 ms peak memory: 64.1 MiB spill size: 0.0 B"]; 40 [labelType="html" label="Filter number of output rows: 464"]; } 41 [labelType="html" label="ObjectHashAggregate number of output rows: 464 time in aggregation build: 6 ms spill size: 0.0 B number of sort fallback tasks: 1"]; 42 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 9.6 KiB number of coalesced partitions: 1"]; 43 [labelType="html" label="Exchange shuffle records written: 464 local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 464 local bytes read: 9.1 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 43.8 KiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 9.1 KiB"]; 44 [labelType="html" label="ObjectHashAggregate number of output rows: 464 time in aggregation build: 10 ms spill size: 0.0 B number of sort fallback tasks: 1"]; subgraph cluster45 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: 10 ms"; 46 [labelType="html" label=" Project "]; } 47 [labelType="html" label="Scan csv number of output rows: 486 number of files read: 1 metadata time: 0 ms size of files read: 50.8 KiB"]; subgraph cluster48 { isCluster="true"; label="WholeStageCodegen (11)\n \nduration: 0 ms"; 49 [labelType="html" label="Sort sort time: 9 ms peak memory: 65.0 MiB spill size: 0.0 B"]; } 50 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 154.7 KiB number of coalesced partitions: 1"]; 51 [labelType="html" label="Exchange shuffle records written: 26,044 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 4 ms (1 ms, 1 ms, 1 ms (stage 1854.0: task 1539)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 26,044 local bytes read: 147.6 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 3 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 1017.3 KiB (7.0 KiB, 492.0 KiB, 518.3 KiB (stage 1854.0: task 1539)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 147.6 KiB (1883.0 B, 70.6 KiB, 75.1 KiB (stage 1854.0: task 1539))"]; subgraph cluster52 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: total (min, med, max (stageId: taskId))\n169 ms (5 ms, 82 ms, 82 ms (stage 1854.0: task 1538))"; 53 [labelType="html" label=" Project "]; 54 [labelType="html" label="Filter number of output rows: 26,044"]; } 55 [labelType="html" label="Scan csv number of output rows: 26,044 number of files read: 1 metadata time: 0 ms size of files read: 8.0 MiB"]; 1->0; 3->1; 4->3; 5->4; 7->5; 8->7; 9->8; 11->9; 12->11; 13->12; 15->13; 16->15; 17->16; 19->17; 20->19; 22->20; 23->22; 24->23; 26->24; 27->26; 28->27; 30->20; 31->30; 32->31; 33->32; 34->33; 36->34; 37->36; 39->17; 40->39; 41->40; 42->41; 43->42; 44->43; 46->44; 47->46; 49->9; 50->49; 51->50; 53->51; 54->53; 55->54; }

AdaptiveSparkPlan isFinalPlan=true

TakeOrderedAndProject(limit=10, orderBy=[COL_C41A4DA6_55E8_44C6_8652_24471CDC29402#454017L DESC NULLS LAST], output=[COL_C41A4DA6_55E8_44C6_8652_24471CDC29401#453990,COL_C41A4DA6_55E8_44C6_8652_24471CDC29402#454017L])

HashAggregate(keys=[COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363], functions=[count(1)])

WholeStageCodegen (13)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363, 10), ENSURE_REQUIREMENTS, [plan_id=45976]

HashAggregate(keys=[knownfloatingpointnormalized(normalizenanandzero(COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363)) AS COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363], functions=[partial_count(1)])

Project [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]

SortMergeJoin [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016], [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425], LeftOuter

WholeStageCodegen (12)

Sort [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016 ASC NULLS FIRST], false, 0

WholeStageCodegen (10)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, 10), ENSURE_REQUIREMENTS, [plan_id=45846]

Project [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245 AS COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]

Filter (((isnull(COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015) OR isnotnull(COL_059961D5_87D2_4745_B270_05C29151B074#453142)) OR isnotnull(MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#453247)) AND (((isnotnull(MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245) AND (COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022 <=> 0.0)) AND NOT (MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245 <=> 0.0)) OR (((COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023 <=> 0.0) AND isnotnull(COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#453139)) AND NOT (COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#453139 <=> 0.0))))

SortMergeJoin [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025], [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244], RightOuter

WholeStageCodegen (9)

Project [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#453042 AS COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#453139, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#453044 AS COL_059961D5_87D2_4745_B270_05C29151B074#453142]

SortMergeJoin [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025], [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#453041], LeftOuter

WholeStageCodegen (7)

Sort [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025 ASC NULLS FIRST], false, 0

WholeStageCodegen (5)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025, 10), ENSURE_REQUIREMENTS, [plan_id=45519]

Project [FINESS#447976 AS COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, NO_RSS#447977 AS COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, str_to_dec(MNT_MON#448118, ##.##) AS COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, str_to_dec(MNT_DMI#448119, ##.##) AS COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, str_remove_space(NO_ADMIN#447978, ALL) AS COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025]

Filter isnotnull(str_remove_space(NO_ADMIN#447978, ALL))

WholeStageCodegen (1)

FileScan csv [FINESS#447976,NO_RSS#447977,NO_ADMIN#447978,MNT_MON#448118,MNT_DMI#448119] Batched: false, DataFilters: [isnotnull(str_remove_space(NO_ADMIN#447978, ALL))], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/VISUALVALOSEJOU_440300/420780652.2025.1..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<FINESS:string,NO_RSS:string,NO_ADMIN:string,MNT_MON:string,MNT_DMI:string>

Sort [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#453041 ASC NULLS FIRST], false, 0

WholeStageCodegen (6)

ObjectHashAggregate(keys=[COL_C898C1FE_14C4_493A_878B_315EB757695B#450164], functions=[sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170), collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, 0, 0)])

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, 10), ENSURE_REQUIREMENTS, [plan_id=45534]

ObjectHashAggregate(keys=[COL_C898C1FE_14C4_493A_878B_315EB757695B#450164], functions=[partial_sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170), partial_collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, 0, 0)])

Project [str_remove_space(str_extract_middle(_c0#449990, 12, 20), ALL) AS COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, str_remove_space(str_extract_middle(_c0#449990, 58, 15), ALL) AS COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, round(str_to_dec(str_join(array(str_extract_middle(_c0#449990, 83, 7), str_extract_middle(_c0#449990, 90, 3)), .), ##.##), 2) AS COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170]

WholeStageCodegen (2)

FileScan csv [_c0#449990] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/DMI_M12_2025_440461/DMI-M12-2025 - BIS...., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<_c0:string>

Sort [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244 ASC NULLS FIRST], false, 0

Filter isnotnull(MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245)

WholeStageCodegen (8)

ObjectHashAggregate(keys=[COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622], functions=[sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629), collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, 0, 0)])

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, 10), ENSURE_REQUIREMENTS, [plan_id=45552]

ObjectHashAggregate(keys=[COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622], functions=[partial_sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629), partial_collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, 0, 0)])

Project [str_remove_space(str_extract_middle(_c0#450488, 12, 20), ALL) AS COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, str_remove_space(str_extract_middle(_c0#450488, 40, 15), ALL) AS COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, str_to_dec(str_join(array(str_extract_middle(_c0#450488, 65, 7), str_extract_middle(_c0#450488, 72, 3)), .), ##.##) AS COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629]

WholeStageCodegen (3)

FileScan csv [_c0#450488] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/MOLECULES_ONERE_440457/MO-M12-2025.txt], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<_c0:string>

Sort [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425 ASC NULLS FIRST], false, 0

WholeStageCodegen (11)

AQEShuffleRead coalesced

Exchange hashpartitioning(RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425, 10), ENSURE_REQUIREMENTS, [plan_id=45574]

Project [str_extract_middle(_c0#450897, 28, 20) AS RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425]

Filter isnotnull(str_extract_middle(_c0#450897, 28, 20))

WholeStageCodegen (4)

FileScan csv [_c0#450897] Batched: false, DataFilters: [isnotnull(str_extract_middle(_c0#450897, 28, 20))], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/RSS_M12_2025_440462/RSS- 420780652.txt], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<_c0:string>

Details

== Physical Plan ==
AdaptiveSparkPlan (81)
+- == Final Plan ==
   TakeOrderedAndProject (48)
   +- * HashAggregate (47)
      +- AQEShuffleRead (46)
         +- ShuffleQueryStage (45), Statistics(sizeInBytes=120.0 B, rowCount=5)
            +- Exchange (44)
               +- * HashAggregate (43)
                  +- * Project (42)
                     +- * SortMergeJoin LeftOuter (41)
                        :- * Sort (33)
                        :  +- AQEShuffleRead (32)
                        :     +- ShuffleQueryStage (31), Statistics(sizeInBytes=11.6 KiB, rowCount=247)
                        :        +- Exchange (30)
                        :           +- * Project (29)
                        :              +- * Filter (28)
                        :                 +- * SortMergeJoin RightOuter (27)
                        :                    :- * Project (17)
                        :                    :  +- * SortMergeJoin LeftOuter (16)
                        :                    :     :- * Sort (7)
                        :                    :     :  +- AQEShuffleRead (6)
                        :                    :     :     +- ShuffleQueryStage (5), Statistics(sizeInBytes=2.1 MiB, rowCount=2.11E+4)
                        :                    :     :        +- Exchange (4)
                        :                    :     :           +- * Project (3)
                        :                    :     :              +- * Filter (2)
                        :                    :     :                 +- Scan csv  (1)
                        :                    :     +- * Sort (15)
                        :                    :        +- ObjectHashAggregate (14)
                        :                    :           +- AQEShuffleRead (13)
                        :                    :              +- ShuffleQueryStage (12), Statistics(sizeInBytes=53.8 KiB, rowCount=445)
                        :                    :                 +- Exchange (11)
                        :                    :                    +- ObjectHashAggregate (10)
                        :                    :                       +- * Project (9)
                        :                    :                          +- Scan csv  (8)
                        :                    +- * Sort (26)
                        :                       +- * Filter (25)
                        :                          +- ObjectHashAggregate (24)
                        :                             +- AQEShuffleRead (23)
                        :                                +- ShuffleQueryStage (22), Statistics(sizeInBytes=43.8 KiB, rowCount=464)
                        :                                   +- Exchange (21)
                        :                                      +- ObjectHashAggregate (20)
                        :                                         +- * Project (19)
                        :                                            +- Scan csv  (18)
                        +- * Sort (40)
                           +- AQEShuffleRead (39)
                              +- ShuffleQueryStage (38), Statistics(sizeInBytes=1017.3 KiB, rowCount=2.60E+4)
                                 +- Exchange (37)
                                    +- * Project (36)
                                       +- * Filter (35)
                                          +- Scan csv  (34)
+- == Initial Plan ==
   TakeOrderedAndProject (80)
   +- HashAggregate (79)
      +- Exchange (78)
         +- HashAggregate (77)
            +- Project (76)
               +- SortMergeJoin LeftOuter (75)
                  :- Sort (70)
                  :  +- Exchange (69)
                  :     +- Project (68)
                  :        +- Filter (67)
                  :           +- SortMergeJoin RightOuter (66)
                  :              :- Project (59)
                  :              :  +- SortMergeJoin LeftOuter (58)
                  :              :     :- Sort (52)
                  :              :     :  +- Exchange (51)
                  :              :     :     +- Project (50)
                  :              :     :        +- Filter (49)
                  :              :     :           +- Scan csv  (1)
                  :              :     +- Sort (57)
                  :              :        +- ObjectHashAggregate (56)
                  :              :           +- Exchange (55)
                  :              :              +- ObjectHashAggregate (54)
                  :              :                 +- Project (53)
                  :              :                    +- Scan csv  (8)
                  :              +- Sort (65)
                  :                 +- Filter (64)
                  :                    +- ObjectHashAggregate (63)
                  :                       +- Exchange (62)
                  :                          +- ObjectHashAggregate (61)
                  :                             +- Project (60)
                  :                                +- Scan csv  (18)
                  +- Sort (74)
                     +- Exchange (73)
                        +- Project (72)
                           +- Filter (71)
                              +- Scan csv  (34)


(1) Scan csv 
Output [5]: [FINESS#447976, NO_RSS#447977, NO_ADMIN#447978, MNT_MON#448118, MNT_DMI#448119]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/VISUALVALOSEJOU_440300/420780652.2025.12.MCO.VisualValoSejours.csv]
ReadSchema: struct<FINESS:string,NO_RSS:string,NO_ADMIN:string,MNT_MON:string,MNT_DMI:string>

(2) Filter [codegen id : 1]
Input [5]: [FINESS#447976, NO_RSS#447977, NO_ADMIN#447978, MNT_MON#448118, MNT_DMI#448119]
Condition : isnotnull(str_remove_space(NO_ADMIN#447978, ALL))

(3) Project [codegen id : 1]
Output [5]: [FINESS#447976 AS COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, NO_RSS#447977 AS COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, str_to_dec(MNT_MON#448118, ##.##) AS COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, str_to_dec(MNT_DMI#448119, ##.##) AS COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, str_remove_space(NO_ADMIN#447978, ALL) AS COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025]
Input [5]: [FINESS#447976, NO_RSS#447977, NO_ADMIN#447978, MNT_MON#448118, MNT_DMI#448119]

(4) Exchange
Input [5]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025]
Arguments: hashpartitioning(COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025, 10), ENSURE_REQUIREMENTS, [plan_id=45519]

(5) ShuffleQueryStage
Output [5]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025]
Arguments: 0

(6) AQEShuffleRead
Input [5]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025]
Arguments: coalesced

(7) Sort [codegen id : 5]
Input [5]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025]
Arguments: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025 ASC NULLS FIRST], false, 0

(8) Scan csv 
Output [1]: [_c0#449990]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/DMI_M12_2025_440461/DMI-M12-2025 - BIS.txt]
ReadSchema: struct<_c0:string>

(9) Project [codegen id : 2]
Output [3]: [str_remove_space(str_extract_middle(_c0#449990, 12, 20), ALL) AS COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, str_remove_space(str_extract_middle(_c0#449990, 58, 15), ALL) AS COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, round(str_to_dec(str_join(array(str_extract_middle(_c0#449990, 83, 7), str_extract_middle(_c0#449990, 90, 3)), .), ##.##), 2) AS COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170]
Input [1]: [_c0#449990]

(10) ObjectHashAggregate
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170]
Keys [1]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164]
Functions [2]: [partial_sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170), partial_collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, 0, 0)]
Aggregate Attributes [2]: [sum#454026, buf#454027]
Results [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, sum#454028, buf#454029]

(11) Exchange
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, sum#454028, buf#454029]
Arguments: hashpartitioning(COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, 10), ENSURE_REQUIREMENTS, [plan_id=45534]

(12) ShuffleQueryStage
Output [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, sum#454028, buf#454029]
Arguments: 1

(13) AQEShuffleRead
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, sum#454028, buf#454029]
Arguments: coalesced

(14) ObjectHashAggregate
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, sum#454028, buf#454029]
Keys [1]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164]
Functions [2]: [sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170), collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, 0, 0)]
Aggregate Attributes [2]: [sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170)#450192, collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, 0, 0)#450194]
Results [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164 AS 01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#453041, round(sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170)#450192, 2) AS 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#453042, size(collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, 0, 0)#450194, true) AS 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#453044]

(15) Sort [codegen id : 6]
Input [3]: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#453041, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#453042, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#453044]
Arguments: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#453041 ASC NULLS FIRST], false, 0

(16) SortMergeJoin [codegen id : 7]
Left keys [1]: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025]
Right keys [1]: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#453041]
Join type: LeftOuter
Join condition: None

(17) Project [codegen id : 7]
Output [7]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#453042 AS COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#453139, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#453044 AS COL_059961D5_87D2_4745_B270_05C29151B074#453142]
Input [8]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025, 01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#453041, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#453042, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#453044]

(18) Scan csv 
Output [1]: [_c0#450488]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/MOLECULES_ONERE_440457/MO-M12-2025.txt]
ReadSchema: struct<_c0:string>

(19) Project [codegen id : 3]
Output [3]: [str_remove_space(str_extract_middle(_c0#450488, 12, 20), ALL) AS COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, str_remove_space(str_extract_middle(_c0#450488, 40, 15), ALL) AS COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, str_to_dec(str_join(array(str_extract_middle(_c0#450488, 65, 7), str_extract_middle(_c0#450488, 72, 3)), .), ##.##) AS COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629]
Input [1]: [_c0#450488]

(20) ObjectHashAggregate
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629]
Keys [1]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622]
Functions [2]: [partial_sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629), partial_collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, 0, 0)]
Aggregate Attributes [2]: [sum#454030, buf#454031]
Results [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, sum#454032, buf#454033]

(21) Exchange
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, sum#454032, buf#454033]
Arguments: hashpartitioning(COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, 10), ENSURE_REQUIREMENTS, [plan_id=45552]

(22) ShuffleQueryStage
Output [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, sum#454032, buf#454033]
Arguments: 2

(23) AQEShuffleRead
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, sum#454032, buf#454033]
Arguments: coalesced

(24) ObjectHashAggregate
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, sum#454032, buf#454033]
Keys [1]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622]
Functions [2]: [sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629), collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, 0, 0)]
Aggregate Attributes [2]: [sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629)#450656, collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, 0, 0)#450658]
Results [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622 AS MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244, round(sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629)#450656, 2) AS MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245, size(collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, 0, 0)#450658, true) AS MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#453247]

(25) Filter [codegen id : 8]
Input [3]: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#453247]
Condition : isnotnull(MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245)

(26) Sort [codegen id : 8]
Input [3]: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#453247]
Arguments: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244 ASC NULLS FIRST], false, 0

(27) SortMergeJoin [codegen id : 9]
Left keys [1]: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025]
Right keys [1]: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244]
Join type: RightOuter
Join condition: None

(28) Filter [codegen id : 9]
Input [10]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#453139, COL_059961D5_87D2_4745_B270_05C29151B074#453142, MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#453247]
Condition : (((isnull(COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015) OR isnotnull(COL_059961D5_87D2_4745_B270_05C29151B074#453142)) OR isnotnull(MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#453247)) AND (((isnotnull(MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245) AND (COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022 <=> 0.0)) AND NOT (MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245 <=> 0.0)) OR (((COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023 <=> 0.0) AND isnotnull(COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#453139)) AND NOT (COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#453139 <=> 0.0))))

(29) Project [codegen id : 9]
Output [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245 AS COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Input [10]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#453139, COL_059961D5_87D2_4745_B270_05C29151B074#453142, MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#453247]

(30) Exchange
Input [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Arguments: hashpartitioning(COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, 10), ENSURE_REQUIREMENTS, [plan_id=45846]

(31) ShuffleQueryStage
Output [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Arguments: 4

(32) AQEShuffleRead
Input [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Arguments: coalesced

(33) Sort [codegen id : 10]
Input [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Arguments: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016 ASC NULLS FIRST], false, 0

(34) Scan csv 
Output [1]: [_c0#450897]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/RSS_M12_2025_440462/RSS- 420780652.txt]
ReadSchema: struct<_c0:string>

(35) Filter [codegen id : 4]
Input [1]: [_c0#450897]
Condition : isnotnull(str_extract_middle(_c0#450897, 28, 20))

(36) Project [codegen id : 4]
Output [1]: [str_extract_middle(_c0#450897, 28, 20) AS RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425]
Input [1]: [_c0#450897]

(37) Exchange
Input [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425]
Arguments: hashpartitioning(RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425, 10), ENSURE_REQUIREMENTS, [plan_id=45574]

(38) ShuffleQueryStage
Output [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425]
Arguments: 3

(39) AQEShuffleRead
Input [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425]
Arguments: coalesced

(40) Sort [codegen id : 11]
Input [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425]
Arguments: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425 ASC NULLS FIRST], false, 0

(41) SortMergeJoin [codegen id : 12]
Left keys [1]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016]
Right keys [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425]
Join type: LeftOuter
Join condition: None

(42) Project [codegen id : 12]
Output [1]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Input [3]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363, RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425]

(43) HashAggregate [codegen id : 12]
Input [1]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Keys [1]: [knownfloatingpointnormalized(normalizenanandzero(COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363)) AS COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#454024L]
Results [2]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363, count#454025L]

(44) Exchange
Input [2]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363, count#454025L]
Arguments: hashpartitioning(COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363, 10), ENSURE_REQUIREMENTS, [plan_id=45976]

(45) ShuffleQueryStage
Output [2]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363, count#454025L]
Arguments: 5

(46) AQEShuffleRead
Input [2]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363, count#454025L]
Arguments: coalesced

(47) HashAggregate [codegen id : 13]
Input [2]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363, count#454025L]
Keys [1]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#454015L]
Results [2]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363 AS COL_C41A4DA6_55E8_44C6_8652_24471CDC29401#453990, count(1)#454015L AS COL_C41A4DA6_55E8_44C6_8652_24471CDC29402#454017L]

(48) TakeOrderedAndProject
Input [2]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC29401#453990, COL_C41A4DA6_55E8_44C6_8652_24471CDC29402#454017L]
Arguments: 10, [COL_C41A4DA6_55E8_44C6_8652_24471CDC29402#454017L DESC NULLS LAST], [COL_C41A4DA6_55E8_44C6_8652_24471CDC29401#453990, COL_C41A4DA6_55E8_44C6_8652_24471CDC29402#454017L]

(49) Filter
Input [5]: [FINESS#447976, NO_RSS#447977, NO_ADMIN#447978, MNT_MON#448118, MNT_DMI#448119]
Condition : isnotnull(str_remove_space(NO_ADMIN#447978, ALL))

(50) Project
Output [5]: [FINESS#447976 AS COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, NO_RSS#447977 AS COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, str_to_dec(MNT_MON#448118, ##.##) AS COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, str_to_dec(MNT_DMI#448119, ##.##) AS COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, str_remove_space(NO_ADMIN#447978, ALL) AS COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025]
Input [5]: [FINESS#447976, NO_RSS#447977, NO_ADMIN#447978, MNT_MON#448118, MNT_DMI#448119]

(51) Exchange
Input [5]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025]
Arguments: hashpartitioning(COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025, 10), ENSURE_REQUIREMENTS, [plan_id=45422]

(52) Sort
Input [5]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025]
Arguments: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025 ASC NULLS FIRST], false, 0

(53) Project
Output [3]: [str_remove_space(str_extract_middle(_c0#449990, 12, 20), ALL) AS COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, str_remove_space(str_extract_middle(_c0#449990, 58, 15), ALL) AS COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, round(str_to_dec(str_join(array(str_extract_middle(_c0#449990, 83, 7), str_extract_middle(_c0#449990, 90, 3)), .), ##.##), 2) AS COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170]
Input [1]: [_c0#449990]

(54) ObjectHashAggregate
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170]
Keys [1]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164]
Functions [2]: [partial_sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170), partial_collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, 0, 0)]
Aggregate Attributes [2]: [sum#454026, buf#454027]
Results [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, sum#454028, buf#454029]

(55) Exchange
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, sum#454028, buf#454029]
Arguments: hashpartitioning(COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, 10), ENSURE_REQUIREMENTS, [plan_id=45418]

(56) ObjectHashAggregate
Input [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164, sum#454028, buf#454029]
Keys [1]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164]
Functions [2]: [sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170), collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, 0, 0)]
Aggregate Attributes [2]: [sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170)#450192, collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, 0, 0)#450194]
Results [3]: [COL_C898C1FE_14C4_493A_878B_315EB757695B#450164 AS 01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#453041, round(sum(COL_50B93A8F_2FAC_42DA_862D_B1ADBEF5479D#450170)#450192, 2) AS 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#453042, size(collect_list(COL_4F5EF121_C9BA_4BCB_BC00_75827CB8EDA5#450166, 0, 0)#450194, true) AS 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#453044]

(57) Sort
Input [3]: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#453041, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#453042, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#453044]
Arguments: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#453041 ASC NULLS FIRST], false, 0

(58) SortMergeJoin
Left keys [1]: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025]
Right keys [1]: [01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#453041]
Join type: LeftOuter
Join condition: None

(59) Project
Output [7]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#453042 AS COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#453139, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#453044 AS COL_059961D5_87D2_4745_B270_05C29151B074#453142]
Input [8]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025, 01_DMI_DECOUPAG_440467_COL_7CC70679_D8A9_4AFA_853C_0B83772BB57F#453041, 01_DMI_DECOUPAG_440467_COL_09C9C0C9_12D2_4B88_AA5D_EE56C4B13EED#453042, 01_DMI_DECOUPAG_440467_COL_0BE82637_88B2_4D38_AB56_F261497B0D57#453044]

(60) Project
Output [3]: [str_remove_space(str_extract_middle(_c0#450488, 12, 20), ALL) AS COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, str_remove_space(str_extract_middle(_c0#450488, 40, 15), ALL) AS COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, str_to_dec(str_join(array(str_extract_middle(_c0#450488, 65, 7), str_extract_middle(_c0#450488, 72, 3)), .), ##.##) AS COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629]
Input [1]: [_c0#450488]

(61) ObjectHashAggregate
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629]
Keys [1]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622]
Functions [2]: [partial_sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629), partial_collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, 0, 0)]
Aggregate Attributes [2]: [sum#454030, buf#454031]
Results [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, sum#454032, buf#454033]

(62) Exchange
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, sum#454032, buf#454033]
Arguments: hashpartitioning(COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, 10), ENSURE_REQUIREMENTS, [plan_id=45427]

(63) ObjectHashAggregate
Input [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622, sum#454032, buf#454033]
Keys [1]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622]
Functions [2]: [sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629), collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, 0, 0)]
Aggregate Attributes [2]: [sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629)#450656, collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, 0, 0)#450658]
Results [3]: [COL_9979D704_E827_4785_AA6A_46B46DBF4847#450622 AS MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244, round(sum(COL_83950E9E_E1A2_40D0_8B87_BED2FABAA685#450629)#450656, 2) AS MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245, size(collect_list(COL_88F0CE42_F8A7_4281_8763_D8933C024F46#450624, 0, 0)#450658, true) AS MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#453247]

(64) Filter
Input [3]: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#453247]
Condition : isnotnull(MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245)

(65) Sort
Input [3]: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#453247]
Arguments: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244 ASC NULLS FIRST], false, 0

(66) SortMergeJoin
Left keys [1]: [COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025]
Right keys [1]: [MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244]
Join type: RightOuter
Join condition: None

(67) Filter
Input [10]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#453139, COL_059961D5_87D2_4745_B270_05C29151B074#453142, MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#453247]
Condition : (((isnull(COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015) OR isnotnull(COL_059961D5_87D2_4745_B270_05C29151B074#453142)) OR isnotnull(MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#453247)) AND (((isnotnull(MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245) AND (COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022 <=> 0.0)) AND NOT (MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245 <=> 0.0)) OR (((COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023 <=> 0.0) AND isnotnull(COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#453139)) AND NOT (COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#453139 <=> 0.0))))

(68) Project
Output [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245 AS COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Input [10]: [COL_439A37D8_DFEE_4DF0_A4A3_80E3EF97FAD9#453015, COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_1951BB46_DAA1_41AE_95E1_5D8AF0DDC5FE#453022, COL_DB68A28C_38CD_4B37_8BFB_36C0ED5BFF25#453023, COL_AA2A4EC8_3B37_49D4_8E9E_4D9406083A09#453025, COL_9AC6AF0B_628B_42CB_AD38_5FA9E8E4EEC4#453139, COL_059961D5_87D2_4745_B270_05C29151B074#453142, MOLECULES_ONERE_440476_COL_F1D11223_61B6_416F_B9C1_A2E3B5D0A062#453244, MOLECULES_ONERE_440476_COL_7FE83AB2_FE45_4E07_ABE2_B7A44F323A8F#453245, MOLECULES_ONERE_440476_COL_0E667C51_6C84_403A_9D26_666830EFDC70#453247]

(69) Exchange
Input [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Arguments: hashpartitioning(COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, 10), ENSURE_REQUIREMENTS, [plan_id=45440]

(70) Sort
Input [2]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Arguments: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016 ASC NULLS FIRST], false, 0

(71) Filter
Input [1]: [_c0#450897]
Condition : isnotnull(str_extract_middle(_c0#450897, 28, 20))

(72) Project
Output [1]: [str_extract_middle(_c0#450897, 28, 20) AS RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425]
Input [1]: [_c0#450897]

(73) Exchange
Input [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425]
Arguments: hashpartitioning(RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425, 10), ENSURE_REQUIREMENTS, [plan_id=45441]

(74) Sort
Input [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425]
Arguments: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425 ASC NULLS FIRST], false, 0

(75) SortMergeJoin
Left keys [1]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016]
Right keys [1]: [RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425]
Join type: LeftOuter
Join condition: None

(76) Project
Output [1]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Input [3]: [COL_B0421838_B608_4AA6_AA2E_38FAEED1F891#453016, COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363, RSS_DECOUPAGE_440487_COL_4E5BCDED_FFA3_4620_99A4_CB56AB972321#453425]

(77) HashAggregate
Input [1]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Keys [1]: [knownfloatingpointnormalized(normalizenanandzero(COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363)) AS COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#454024L]
Results [2]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363, count#454025L]

(78) Exchange
Input [2]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363, count#454025L]
Arguments: hashpartitioning(COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363, 10), ENSURE_REQUIREMENTS, [plan_id=45448]

(79) HashAggregate
Input [2]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363, count#454025L]
Keys [1]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363]
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#454015L]
Results [2]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC2940#453363 AS COL_C41A4DA6_55E8_44C6_8652_24471CDC29401#453990, count(1)#454015L AS COL_C41A4DA6_55E8_44C6_8652_24471CDC29402#454017L]

(80) TakeOrderedAndProject
Input [2]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC29401#453990, COL_C41A4DA6_55E8_44C6_8652_24471CDC29402#454017L]
Arguments: 10, [COL_C41A4DA6_55E8_44C6_8652_24471CDC29402#454017L DESC NULLS LAST], [COL_C41A4DA6_55E8_44C6_8652_24471CDC29401#453990, COL_C41A4DA6_55E8_44C6_8652_24471CDC29402#454017L]

(81) AdaptiveSparkPlan
Output [2]: [COL_C41A4DA6_55E8_44C6_8652_24471CDC29401#453990, COL_C41A4DA6_55E8_44C6_8652_24471CDC29402#454017L]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet