SP1 - Details for Query 577

Submitted Time: 2026/08/28 12:16:47
Duration: 35 s
Succeeded Jobs: 672 673 676 678 679 690

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; 1 [labelType="html" label=" TakeOrderedAndProject "]; subgraph cluster2 { isCluster="true"; label="WholeStageCodegen (11)\n \nduration: 4 ms"; 3 [labelType="html" label="HashAggregate spill size: 0.0 B time in aggregation build: 0 ms peak memory: 16.3 MiB number of output rows: 6 number of sort fallback tasks: 0 avg hash probes per key: 1"]; } 4 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 862.0 B number of coalesced partitions: 1"]; 5 [labelType="html" label="Exchange shuffle records written: 6 local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 6 local bytes read: 830.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 672.0 B local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 830.0 B"]; subgraph cluster6 { isCluster="true"; label="WholeStageCodegen (10)\n \nduration: 28.7 s"; 7 [labelType="html" label="HashAggregate spill size: 0.0 B time in aggregation build: 28.7 s peak memory: 256.0 KiB number of output rows: 6 number of sort fallback tasks: 0 avg hash probes per key: 0"]; 8 [labelType="html" label=" Project "]; 9 [labelType="html" label="Filter number of output rows: 602,093"]; } 10 [labelType="html" label="Window spill size: 0.0 B"]; subgraph cluster11 { isCluster="true"; label="WholeStageCodegen (9)\n \nduration: 29.0 s"; 12 [labelType="html" label="Sort sort time: 50 ms peak memory: 48.0 MiB spill size: 0.0 B"]; } 13 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 688.3 KiB number of coalesced partitions: 1"]; 14 [labelType="html" label="Exchange shuffle records written: 602,754 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 19 ms (1 ms, 2 ms, 2 ms (stage 1070.0: task 1411)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 602,754 local bytes read: 653.5 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 10 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 16.2 MiB (1643.0 KiB, 1659.6 KiB, 1670.6 KiB (stage 1070.0: task 1412)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 653.5 KiB (64.0 KiB, 65.5 KiB, 66.2 KiB (stage 1070.0: task 1409))"]; subgraph cluster15 { isCluster="true"; label="WholeStageCodegen (8)\n \nduration: total (min, med, max (stageId: taskId))\n3.4 s (334 ms, 336 ms, 346 ms (stage 1070.0: task 1410))"; 16 [labelType="html" label=" Project "]; 17 [labelType="html" label="SortMergeJoin number of output rows: 602,754 spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1070.0: task 1406))"]; } subgraph cluster18 { isCluster="true"; label="WholeStageCodegen (5)\n \nduration: total (min, med, max (stageId: taskId))\n3.4 s (342 ms, 344 ms, 353 ms (stage 1070.0: task 1410))"; 19 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 113 ms (11 ms, 11 ms, 12 ms (stage 1070.0: task 1411)) peak memory total (min, med, max (stageId: taskId)) 180.0 MiB (18.0 MiB, 18.0 MiB, 18.0 MiB (stage 1070.0: task 1406)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1070.0: task 1406))"]; } 20 [labelType="html" label="Exchange shuffle records written: 602,754 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 57 ms (5 ms, 5 ms, 6 ms (stage 1061.0: task 1403)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 602,754 local bytes read total (min, med, max (stageId: taskId)) 15.3 MiB (1557.8 KiB, 1571.2 KiB, 1579.4 KiB (stage 1070.0: task 1412)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1070.0: task 1406)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 100 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 51.3 MiB (5.1 MiB, 5.1 MiB, 5.2 MiB (stage 1061.0: task 1404)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 15.3 MiB (1557.0 KiB, 1571.4 KiB, 1578.9 KiB (stage 1061.0: task 1396))"]; subgraph cluster21 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: total (min, med, max (stageId: taskId))\n3.3 s (311 ms, 320 ms, 402 ms (stage 1061.0: task 1398))"; 22 [labelType="html" label=" Project "]; 23 [labelType="html" label="Filter number of output rows: 602,754"]; } 24 [labelType="html" label="Window spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1061.0: task 1395))"]; subgraph cluster25 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: total (min, med, max (stageId: taskId))\n4.7 s (431 ms, 466 ms, 552 ms (stage 1061.0: task 1398))"; 26 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 161 ms (14 ms, 14 ms, 23 ms (stage 1061.0: task 1396)) peak memory total (min, med, max (stageId: taskId)) 400.0 MiB (40.0 MiB, 40.0 MiB, 40.0 MiB (stage 1061.0: task 1395)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1061.0: task 1395))"]; } 27 [labelType="html" label="Exchange shuffle records written: 2,996,009 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 96 ms (15 ms, 81 ms, 81 ms (stage 1052.0: task 1367)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 2,996,009 local bytes read total (min, med, max (stageId: taskId)) 30.6 MiB (3.0 MiB, 3.1 MiB, 3.1 MiB (stage 1061.0: task 1404)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1061.0: task 1395)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 20 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 262.3 MiB (39.0 MiB, 223.2 MiB, 223.2 MiB (stage 1052.0: task 1367)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 30.6 MiB (4.6 MiB, 26.0 MiB, 26.0 MiB (stage 1052.0: task 1367))"]; subgraph cluster28 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: total (min, med, max (stageId: taskId))\n5.6 s (3 ms, 5 ms, 4.5 s (stage 1052.0: task 1367))"; 29 [labelType="html" label=" Project "]; 30 [labelType="html" label="ColumnarToRow number of output rows: 2,996,009 number of input batches: 732"]; } 31 [labelType="html" label="Scan parquet number of files read: 1 scan time total (min, med, max (stageId: taskId)) 1.3 s (2 ms, 4 ms, 1.1 s (stage 1052.0: task 1367)) metadata time: 0 ms size of files read: 150.9 MiB number of output rows: 2,996,009"]; subgraph cluster32 { isCluster="true"; label="WholeStageCodegen (7)\n \nduration: 0 ms"; 33 [labelType="html" label=" Project "]; 34 [labelType="html" label="Filter number of output rows: 88,203"]; } 35 [labelType="html" label="Window spill size: 0.0 B"]; subgraph cluster36 { isCluster="true"; label="WholeStageCodegen (6)\n \nduration: 0 ms"; 37 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1070.0: task 1406)) peak memory total (min, med, max (stageId: taskId)) 162.5 MiB (16.3 MiB, 16.3 MiB, 16.3 MiB (stage 1070.0: task 1406)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1070.0: task 1406))"]; } 38 [labelType="html" label="Exchange shuffle records written: 93,005 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 5 ms (2 ms, 2 ms, 2 ms (stage 1053.0: task 1374)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 93,005 local bytes read total (min, med, max (stageId: taskId)) 1057.6 KiB (103.1 KiB, 106.2 KiB, 107.8 KiB (stage 1070.0: task 1412)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1070.0: task 1406)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 20 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 6.3 MiB (2.6 MiB, 3.7 MiB, 3.7 MiB (stage 1053.0: task 1373)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 1057.6 KiB (437.9 KiB, 619.8 KiB, 619.8 KiB (stage 1053.0: task 1373))"]; subgraph cluster39 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: total (min, med, max (stageId: taskId))\n215 ms (96 ms, 119 ms, 119 ms (stage 1053.0: task 1373))"; 40 [labelType="html" label=" Project "]; 41 [labelType="html" label="Filter number of output rows: 93,005"]; } 42 [labelType="html" label="Scan csv number of output rows: 93,005 number of files read: 1 metadata time: 0 ms size of files read: 6.4 MiB"]; 1->0; 3->1; 4->3; 5->4; 7->5; 8->7; 9->8; 10->9; 12->10; 13->12; 14->13; 16->14; 17->16; 19->17; 20->19; 22->20; 23->22; 24->23; 26->24; 27->26; 29->27; 30->29; 31->30; 33->17; 34->33; 35->34; 37->35; 38->37; 40->38; 41->40; 42->41; }

AdaptiveSparkPlan isFinalPlan=true

TakeOrderedAndProject(limit=10, orderBy=[COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C2#100849L DESC NULLS LAST], output=[COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C1#100820,COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C2#100849L])

HashAggregate(keys=[COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792], functions=[count(1)])

WholeStageCodegen (11)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792, 10), ENSURE_REQUIREMENTS, [plan_id=27171]

HashAggregate(keys=[COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792], functions=[partial_count(1)])

Project [str_list_as_str(COL_87E64838_3BAB_4526_BF3E_008427D11600#100494) AS COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792]

Filter isnotnull(str_list_as_str(COL_87E64838_3BAB_4526_BF3E_008427D11600#100494))

WholeStageCodegen (10)

Window [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275, 0, 0) windowspecdefinition(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_87E64838_3BAB_4526_BF3E_008427D11600#100494], [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443], [1 DESC NULLS LAST]

Sort [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

WholeStageCodegen (9)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, 10), ENSURE_REQUIREMENTS, [plan_id=27082]

Project [str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982, [SAS]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#100139, ) AS COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#100139 AS COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275]

SortMergeJoin [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929], [00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#100138], LeftOuter

WholeStageCodegen (8)

Sort [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929 ASC NULLS FIRST], false, 0

WholeStageCodegen (5)

Exchange hashpartitioning(COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, 10), ENSURE_REQUIREMENTS, [plan_id=26905]

Project [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982]

Filter (COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926 <=> A)

WholeStageCodegen (4)

Window [collect_set(COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949, 0, 0) windowspecdefinition(COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982], [COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927], [1 DESC NULLS LAST]

Sort [COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

WholeStageCodegen (3)

Exchange hashpartitioning(COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, 10), ENSURE_REQUIREMENTS, [plan_id=26471]

Project [COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822 AS COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#99823 AS COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#99825 AS COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, str_remove_space(str_if_with_rule(((COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822 <=> B) OR (COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822 <=> C)), str_extract_middle(COL_B706A975_F287_4DC9_B631_A35735FE936F#99819, 78, 5), null), ONLY_ONE) AS COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949]

ColumnarToRow

WholeStageCodegen (1)

FileScan parquet [COL_B706A975_F287_4DC9_B631_A35735FE936F#99819,COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822,COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#99823,COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#99825] Batched: true, DataFilters: [], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/output/cache/parquet/datablock/00_A_LIGNES_RSF_345253], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<COL_B706A975_F287_4DC9_B631_A35735FE936F:string,COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38:s...

Project [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763 AS 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#100138, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764 AS 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#100139]

Filter (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#99779 <=> 1)

WholeStageCodegen (7)

Window [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#99779], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763], [1 DESC NULLS LAST]

Sort [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

WholeStageCodegen (6)

Exchange hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, 10), ENSURE_REQUIREMENTS, [plan_id=26490]

Project [Numéro Séjour#99642 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, UF#99643 AS COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764]

Filter (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#99642, #)) THEN false ELSE StartsWith(Numéro Séjour#99642, #) END AND isnotnull(Numéro Séjour#99642))

WholeStageCodegen (2)

FileScan csv [Numéro Séjour#99642,UF#99643] Batched: false, DataFilters: [NOT CASE WHEN isnull(StartsWith(Numéro Séjour#99642, #)) THEN false ELSE StartsWith(Numéro Séjou..., Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/02_PASSAGE_PATI_344985/passage_pationt_..., PartitionFilters: [], PushedFilters: [IsNotNull(Numéro Séjour)], ReadSchema: struct<Numéro Séjour:string,UF:string>

Details

== Physical Plan ==
AdaptiveSparkPlan (63)
+- == Final Plan ==
   TakeOrderedAndProject (36)
   +- * HashAggregate (35)
      +- AQEShuffleRead (34)
         +- ShuffleQueryStage (33), Statistics(sizeInBytes=672.0 B, rowCount=6)
            +- Exchange (32)
               +- * HashAggregate (31)
                  +- * Project (30)
                     +- * Filter (29)
                        +- Window (28)
                           +- * Sort (27)
                              +- AQEShuffleRead (26)
                                 +- ShuffleQueryStage (25), Statistics(sizeInBytes=16.2 MiB, rowCount=6.03E+5)
                                    +- Exchange (24)
                                       +- * Project (23)
                                          +- * SortMergeJoin LeftOuter (22)
                                             :- * Sort (12)
                                             :  +- ShuffleQueryStage (11), Statistics(sizeInBytes=51.3 MiB, rowCount=6.03E+5)
                                             :     +- Exchange (10)
                                             :        +- * Project (9)
                                             :           +- * Filter (8)
                                             :              +- Window (7)
                                             :                 +- * Sort (6)
                                             :                    +- ShuffleQueryStage (5), Statistics(sizeInBytes=262.3 MiB, rowCount=3.00E+6)
                                             :                       +- Exchange (4)
                                             :                          +- * Project (3)
                                             :                             +- * ColumnarToRow (2)
                                             :                                +- Scan parquet  (1)
                                             +- * Project (21)
                                                +- * Filter (20)
                                                   +- Window (19)
                                                      +- * Sort (18)
                                                         +- ShuffleQueryStage (17), Statistics(sizeInBytes=6.3 MiB, rowCount=9.30E+4)
                                                            +- Exchange (16)
                                                               +- * Project (15)
                                                                  +- * Filter (14)
                                                                     +- Scan csv  (13)
+- == Initial Plan ==
   TakeOrderedAndProject (62)
   +- HashAggregate (61)
      +- Exchange (60)
         +- HashAggregate (59)
            +- Project (58)
               +- Filter (57)
                  +- Window (56)
                     +- Sort (55)
                        +- Exchange (54)
                           +- Project (53)
                              +- SortMergeJoin LeftOuter (52)
                                 :- Sort (44)
                                 :  +- Exchange (43)
                                 :     +- Project (42)
                                 :        +- Filter (41)
                                 :           +- Window (40)
                                 :              +- Sort (39)
                                 :                 +- Exchange (38)
                                 :                    +- Project (37)
                                 :                       +- Scan parquet  (1)
                                 +- Project (51)
                                    +- Filter (50)
                                       +- Window (49)
                                          +- Sort (48)
                                             +- Exchange (47)
                                                +- Project (46)
                                                   +- Filter (45)
                                                      +- Scan csv  (13)


(1) Scan parquet 
Output [4]: [COL_B706A975_F287_4DC9_B631_A35735FE936F#99819, COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#99823, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#99825]
Batched: true
Location: InMemoryFileIndex [file:/data/output/cache/parquet/datablock/00_A_LIGNES_RSF_345253]
ReadSchema: struct<COL_B706A975_F287_4DC9_B631_A35735FE936F:string,COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38:string,COL_0767075F_6D90_4406_A1C5_BC087A39F7CE:string,COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D:string>

(2) ColumnarToRow [codegen id : 1]
Input [4]: [COL_B706A975_F287_4DC9_B631_A35735FE936F#99819, COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#99823, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#99825]

(3) Project [codegen id : 1]
Output [4]: [COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822 AS COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#99823 AS COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#99825 AS COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, str_remove_space(str_if_with_rule(((COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822 <=> B) OR (COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822 <=> C)), str_extract_middle(COL_B706A975_F287_4DC9_B631_A35735FE936F#99819, 78, 5), null), ONLY_ONE) AS COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949]
Input [4]: [COL_B706A975_F287_4DC9_B631_A35735FE936F#99819, COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#99823, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#99825]

(4) Exchange
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949]
Arguments: hashpartitioning(COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, 10), ENSURE_REQUIREMENTS, [plan_id=26471]

(5) ShuffleQueryStage
Output [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949]
Arguments: 0

(6) Sort [codegen id : 3]
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949]
Arguments: [COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(7) Window
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949]
Arguments: [collect_set(COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949, 0, 0) windowspecdefinition(COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982], [COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927], [1 DESC NULLS LAST]

(8) Filter [codegen id : 4]
Input [5]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982]
Condition : (COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926 <=> A)

(9) Project [codegen id : 4]
Output [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982]
Input [5]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982]

(10) Exchange
Input [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982]
Arguments: hashpartitioning(COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, 10), ENSURE_REQUIREMENTS, [plan_id=26905]

(11) ShuffleQueryStage
Output [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982]
Arguments: 2

(12) Sort [codegen id : 5]
Input [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982]
Arguments: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929 ASC NULLS FIRST], false, 0

(13) Scan csv 
Output [2]: [Numéro Séjour#99642, UF#99643]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/02_PASSAGE_PATI_344985/passage_pationt_09122025.csv]
PushedFilters: [IsNotNull(Numéro Séjour)]
ReadSchema: struct<Numéro Séjour:string,UF:string>

(14) Filter [codegen id : 2]
Input [2]: [Numéro Séjour#99642, UF#99643]
Condition : (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#99642, #)) THEN false ELSE StartsWith(Numéro Séjour#99642, #) END AND isnotnull(Numéro Séjour#99642))

(15) Project [codegen id : 2]
Output [2]: [Numéro Séjour#99642 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, UF#99643 AS COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764]
Input [2]: [Numéro Séjour#99642, UF#99643]

(16) Exchange
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764]
Arguments: hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, 10), ENSURE_REQUIREMENTS, [plan_id=26490]

(17) ShuffleQueryStage
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764]
Arguments: 1

(18) Sort [codegen id : 6]
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764]
Arguments: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(19) Window
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764]
Arguments: [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#99779], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763], [1 DESC NULLS LAST]

(20) Filter [codegen id : 7]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#99779]
Condition : (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#99779 <=> 1)

(21) Project [codegen id : 7]
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763 AS 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#100138, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764 AS 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#100139]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#99779]

(22) SortMergeJoin [codegen id : 8]
Left keys [1]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929]
Right keys [1]: [00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#100138]
Join type: LeftOuter
Join condition: None

(23) Project [codegen id : 8]
Output [2]: [str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982, [SAS]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#100139, ) AS COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#100139 AS COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275]
Input [4]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982, 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#100138, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#100139]

(24) Exchange
Input [2]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275]
Arguments: hashpartitioning(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, 10), ENSURE_REQUIREMENTS, [plan_id=27082]

(25) ShuffleQueryStage
Output [2]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275]
Arguments: 3

(26) AQEShuffleRead
Input [2]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275]
Arguments: coalesced

(27) Sort [codegen id : 9]
Input [2]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275]
Arguments: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(28) Window
Input [2]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275]
Arguments: [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275, 0, 0) windowspecdefinition(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_87E64838_3BAB_4526_BF3E_008427D11600#100494], [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443], [1 DESC NULLS LAST]

(29) Filter [codegen id : 10]
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275, COL_87E64838_3BAB_4526_BF3E_008427D11600#100494]
Condition : isnotnull(str_list_as_str(COL_87E64838_3BAB_4526_BF3E_008427D11600#100494))

(30) Project [codegen id : 10]
Output [1]: [str_list_as_str(COL_87E64838_3BAB_4526_BF3E_008427D11600#100494) AS COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792]
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275, COL_87E64838_3BAB_4526_BF3E_008427D11600#100494]

(31) HashAggregate [codegen id : 10]
Input [1]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792]
Keys [1]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792]
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#100856L]
Results [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792, count#100857L]

(32) Exchange
Input [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792, count#100857L]
Arguments: hashpartitioning(COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792, 10), ENSURE_REQUIREMENTS, [plan_id=27171]

(33) ShuffleQueryStage
Output [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792, count#100857L]
Arguments: 4

(34) AQEShuffleRead
Input [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792, count#100857L]
Arguments: coalesced

(35) HashAggregate [codegen id : 11]
Input [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792, count#100857L]
Keys [1]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792]
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#100847L]
Results [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792 AS COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C1#100820, count(1)#100847L AS COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C2#100849L]

(36) TakeOrderedAndProject
Input [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C1#100820, COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C2#100849L]
Arguments: 10, [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C2#100849L DESC NULLS LAST], [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C1#100820, COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C2#100849L]

(37) Project
Output [4]: [COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822 AS COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#99823 AS COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#99825 AS COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, str_remove_space(str_if_with_rule(((COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822 <=> B) OR (COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822 <=> C)), str_extract_middle(COL_B706A975_F287_4DC9_B631_A35735FE936F#99819, 78, 5), null), ONLY_ONE) AS COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949]
Input [4]: [COL_B706A975_F287_4DC9_B631_A35735FE936F#99819, COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#99822, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#99823, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#99825]

(38) Exchange
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949]
Arguments: hashpartitioning(COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, 10), ENSURE_REQUIREMENTS, [plan_id=26387]

(39) Sort
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949]
Arguments: [COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(40) Window
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949]
Arguments: [collect_set(COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949, 0, 0) windowspecdefinition(COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982], [COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927], [1 DESC NULLS LAST]

(41) Filter
Input [5]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982]
Condition : (COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926 <=> A)

(42) Project
Output [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982]
Input [5]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#99926, COL_86264515_64DE_4F5A_B65C_1F224369C11E#99927, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#99949, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982]

(43) Exchange
Input [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982]
Arguments: hashpartitioning(COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, 10), ENSURE_REQUIREMENTS, [plan_id=26399]

(44) Sort
Input [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982]
Arguments: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929 ASC NULLS FIRST], false, 0

(45) Filter
Input [2]: [Numéro Séjour#99642, UF#99643]
Condition : (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#99642, #)) THEN false ELSE StartsWith(Numéro Séjour#99642, #) END AND isnotnull(Numéro Séjour#99642))

(46) Project
Output [2]: [Numéro Séjour#99642 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, UF#99643 AS COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764]
Input [2]: [Numéro Séjour#99642, UF#99643]

(47) Exchange
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764]
Arguments: hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, 10), ENSURE_REQUIREMENTS, [plan_id=26392]

(48) Sort
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764]
Arguments: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(49) Window
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764]
Arguments: [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#99779], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763], [1 DESC NULLS LAST]

(50) Filter
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#99779]
Condition : (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#99779 <=> 1)

(51) Project
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763 AS 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#100138, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764 AS 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#100139]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#99763, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#99764, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#99779]

(52) SortMergeJoin
Left keys [1]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929]
Right keys [1]: [00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#100138]
Join type: LeftOuter
Join condition: None

(53) Project
Output [2]: [str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982, [SAS]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#100139, ) AS COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#100139 AS COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275]
Input [4]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#99929, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#99982, 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#100138, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#100139]

(54) Exchange
Input [2]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275]
Arguments: hashpartitioning(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, 10), ENSURE_REQUIREMENTS, [plan_id=26404]

(55) Sort
Input [2]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275]
Arguments: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(56) Window
Input [2]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275]
Arguments: [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275, 0, 0) windowspecdefinition(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_87E64838_3BAB_4526_BF3E_008427D11600#100494], [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443], [1 DESC NULLS LAST]

(57) Filter
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275, COL_87E64838_3BAB_4526_BF3E_008427D11600#100494]
Condition : isnotnull(str_list_as_str(COL_87E64838_3BAB_4526_BF3E_008427D11600#100494))

(58) Project
Output [1]: [str_list_as_str(COL_87E64838_3BAB_4526_BF3E_008427D11600#100494) AS COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792]
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#100443, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#100275, COL_87E64838_3BAB_4526_BF3E_008427D11600#100494]

(59) HashAggregate
Input [1]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792]
Keys [1]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792]
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#100856L]
Results [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792, count#100857L]

(60) Exchange
Input [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792, count#100857L]
Arguments: hashpartitioning(COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792, 10), ENSURE_REQUIREMENTS, [plan_id=26411]

(61) HashAggregate
Input [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792, count#100857L]
Keys [1]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792]
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#100847L]
Results [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#100792 AS COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C1#100820, count(1)#100847L AS COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C2#100849L]

(62) TakeOrderedAndProject
Input [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C1#100820, COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C2#100849L]
Arguments: 10, [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C2#100849L DESC NULLS LAST], [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C1#100820, COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C2#100849L]

(63) AdaptiveSparkPlan
Output [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C1#100820, COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C2#100849L]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet