SP1 - Details for Query 582

Submitted Time: 2026/08/28 12:17:17
Duration: 23 s
Succeeded Jobs: 683 684 689 691 692 693 698

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (13)\n \nduration: 0 ms"; 2 [labelType="html" label="HashAggregate time in aggregation build: 0 ms number of output rows: 1"]; } 3 [labelType="html" label="Exchange shuffle records written: 1 local merged chunks fetched: 0 shuffle write time: 0 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 1 local bytes read: 59.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 16.0 B local merged bytes read: 0.0 B number of partitions: 1 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 59.0 B"]; subgraph cluster4 { isCluster="true"; label="WholeStageCodegen (12)\n \nduration: 15.1 s"; 5 [labelType="html" label="HashAggregate time in aggregation build: 15.1 s number of output rows: 1"]; 6 [labelType="html" label=" Project "]; 7 [labelType="html" label="Filter number of output rows: 602,529"]; } 8 [labelType="html" label="Window spill size: 0.0 B"]; subgraph cluster9 { isCluster="true"; label="WholeStageCodegen (11)\n \nduration: 16.0 s"; 10 [labelType="html" label="Sort sort time: 106 ms peak memory: 304.0 MiB spill size: 0.0 B"]; } 11 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 5.5 MiB number of coalesced partitions: 1"]; 12 [labelType="html" label="Exchange shuffle records written: 602,754 local merged chunks fetched: 0 shuffle write time: 17 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 602,754 local bytes read: 5.4 MiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 285.1 MiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 5.4 MiB"]; subgraph cluster13 { isCluster="true"; label="WholeStageCodegen (10)\n \nduration: 933 ms"; 14 [labelType="html" label=" Project "]; } 15 [labelType="html" label="Window spill size: 0.0 B"]; subgraph cluster16 { isCluster="true"; label="WholeStageCodegen (9)\n \nduration: 1.2 s"; 17 [labelType="html" label="Sort sort time: 52 ms peak memory: 48.0 MiB spill size: 0.0 B"]; } 18 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 939.2 KiB number of coalesced partitions: 1"]; 19 [labelType="html" label="Exchange shuffle records written: 602,754 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 18 ms (1 ms, 1 ms, 3 ms (stage 1101.0: task 1464)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 602,754 local bytes read: 911.1 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 10 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 21.5 MiB (2.1 MiB, 2.2 MiB, 2.2 MiB (stage 1101.0: task 1463)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 911.1 KiB (89.7 KiB, 91.3 KiB, 92.2 KiB (stage 1101.0: task 1463))"]; subgraph cluster20 { isCluster="true"; label="WholeStageCodegen (8)\n \nduration: total (min, med, max (stageId: taskId))\n5.5 s (511 ms, 539 ms, 600 ms (stage 1101.0: task 1457))"; 21 [labelType="html" label=" Project "]; 22 [labelType="html" label="SortMergeJoin number of output rows: 602,754 spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1101.0: task 1459))"]; } subgraph cluster23 { isCluster="true"; label="WholeStageCodegen (5)\n \nduration: total (min, med, max (stageId: taskId))\n5.7 s (538 ms, 567 ms, 626 ms (stage 1101.0: task 1457))"; 24 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 152 ms (11 ms, 13 ms, 20 ms (stage 1101.0: task 1460)) peak memory total (min, med, max (stageId: taskId)) 180.0 MiB (18.0 MiB, 18.0 MiB, 18.0 MiB (stage 1101.0: task 1459)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1101.0: task 1459))"]; } 25 [labelType="html" label="Exchange shuffle records written: 602,754 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 66 ms (5 ms, 6 ms, 10 ms (stage 1091.0: task 1448)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 602,754 local bytes read total (min, med, max (stageId: taskId)) 15.3 MiB (1557.8 KiB, 1571.2 KiB, 1579.4 KiB (stage 1101.0: task 1463)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1101.0: task 1459)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 100 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 51.3 MiB (5.1 MiB, 5.1 MiB, 5.2 MiB (stage 1091.0: task 1455)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 15.3 MiB (1557.0 KiB, 1571.4 KiB, 1578.9 KiB (stage 1091.0: task 1447))"]; subgraph cluster26 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: total (min, med, max (stageId: taskId))\n3.4 s (325 ms, 340 ms, 353 ms (stage 1091.0: task 1455))"; 27 [labelType="html" label=" Project "]; 28 [labelType="html" label="Filter number of output rows: 602,754"]; } 29 [labelType="html" label="Window spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1091.0: task 1446))"]; subgraph cluster30 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: total (min, med, max (stageId: taskId))\n4.8 s (430 ms, 476 ms, 525 ms (stage 1091.0: task 1450))"; 31 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 160 ms (14 ms, 15 ms, 27 ms (stage 1091.0: task 1448)) peak memory total (min, med, max (stageId: taskId)) 400.0 MiB (40.0 MiB, 40.0 MiB, 40.0 MiB (stage 1091.0: task 1446)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1091.0: task 1446))"]; } 32 [labelType="html" label="Exchange shuffle records written: 2,996,009 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 91 ms (14 ms, 77 ms, 77 ms (stage 1084.0: task 1424)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 2,996,009 local bytes read total (min, med, max (stageId: taskId)) 30.6 MiB (3.0 MiB, 3.1 MiB, 3.1 MiB (stage 1091.0: task 1455)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1091.0: task 1446)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 20 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 262.3 MiB (39.0 MiB, 223.2 MiB, 223.2 MiB (stage 1084.0: task 1424)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 30.6 MiB (4.6 MiB, 26.0 MiB, 26.0 MiB (stage 1084.0: task 1424))"]; subgraph cluster33 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: total (min, med, max (stageId: taskId))\n5.5 s (2 ms, 4 ms, 4.6 s (stage 1084.0: task 1424))"; 34 [labelType="html" label=" Project "]; 35 [labelType="html" label="ColumnarToRow number of output rows: 2,996,009 number of input batches: 732"]; } 36 [labelType="html" label="Scan parquet number of files read: 1 scan time total (min, med, max (stageId: taskId)) 1.3 s (2 ms, 3 ms, 1.1 s (stage 1084.0: task 1424)) metadata time: 0 ms size of files read: 150.9 MiB number of output rows: 2,996,009"]; subgraph cluster37 { isCluster="true"; label="WholeStageCodegen (7)\n \nduration: 0 ms"; 38 [labelType="html" label=" Project "]; 39 [labelType="html" label="Filter number of output rows: 88,203"]; } 40 [labelType="html" label="Window spill size: 0.0 B"]; subgraph cluster41 { isCluster="true"; label="WholeStageCodegen (6)\n \nduration: 0 ms"; 42 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1101.0: task 1459)) peak memory total (min, med, max (stageId: taskId)) 162.5 MiB (16.3 MiB, 16.3 MiB, 16.3 MiB (stage 1101.0: task 1459)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1101.0: task 1459))"]; } 43 [labelType="html" label="Exchange shuffle records written: 93,005 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 7 ms (3 ms, 4 ms, 4 ms (stage 1085.0: task 1430)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 93,005 local bytes read total (min, med, max (stageId: taskId)) 1057.6 KiB (103.1 KiB, 106.2 KiB, 107.8 KiB (stage 1101.0: task 1463)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1101.0: task 1459)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 20 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 6.3 MiB (2.6 MiB, 3.7 MiB, 3.7 MiB (stage 1085.0: task 1430)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 1057.6 KiB (437.9 KiB, 619.8 KiB, 619.8 KiB (stage 1085.0: task 1430))"]; subgraph cluster44 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: total (min, med, max (stageId: taskId))\n271 ms (133 ms, 138 ms, 138 ms (stage 1085.0: task 1430))"; 45 [labelType="html" label=" Project "]; 46 [labelType="html" label="Filter number of output rows: 93,005"]; } 47 [labelType="html" label="Scan csv number of output rows: 93,005 number of files read: 1 metadata time: 0 ms size of files read: 6.4 MiB"]; 2->0; 3->2; 5->3; 6->5; 7->6; 8->7; 10->8; 11->10; 12->11; 14->12; 15->14; 17->15; 18->17; 19->18; 21->19; 22->21; 24->22; 25->24; 27->25; 28->27; 29->28; 31->29; 32->31; 34->32; 35->34; 36->35; 38->22; 39->38; 40->39; 42->40; 43->42; 45->43; 46->45; 47->46; }

AdaptiveSparkPlan isFinalPlan=true

HashAggregate(keys=[], functions=[count(1)])

WholeStageCodegen (13)

Exchange SinglePartition, ENSURE_REQUIREMENTS, [plan_id=28273]

HashAggregate(keys=[], functions=[partial_count(1)])

Project

Filter (isnotnull(str_list_as_str(COL_87E64838_3BAB_4526_BF3E_008427D11600#101784)) OR isnotnull(str_list_as_str(COL_2094C447_FD18_4EDD_AB41_506CB04536E3#101859)))

WholeStageCodegen (12)

Window [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, 0, 0) windowspecdefinition(COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_2094C447_FD18_4EDD_AB41_506CB04536E3#101859], [COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735], [1 DESC NULLS LAST]

Sort [COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

WholeStageCodegen (11)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, 10), ENSURE_REQUIREMENTS, [plan_id=28202]

Project [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784]

WholeStageCodegen (10)

Window [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, 0, 0) windowspecdefinition(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_87E64838_3BAB_4526_BF3E_008427D11600#101784], [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733], [1 DESC NULLS LAST]

Sort [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

WholeStageCodegen (9)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, 10), ENSURE_REQUIREMENTS, [plan_id=28100]

Project [str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272, [SAS]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429, ) AS COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429 AS COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272, [SUN,SUF]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429, ) AS COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735]

SortMergeJoin [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219], [00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101428], LeftOuter

WholeStageCodegen (8)

Sort [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219 ASC NULLS FIRST], false, 0

WholeStageCodegen (5)

Exchange hashpartitioning(COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, 10), ENSURE_REQUIREMENTS, [plan_id=27952]

Project [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272]

Filter (COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216 <=> A)

WholeStageCodegen (4)

Window [collect_set(COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239, 0, 0) windowspecdefinition(COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272], [COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217], [1 DESC NULLS LAST]

Sort [COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

WholeStageCodegen (3)

Exchange hashpartitioning(COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, 10), ENSURE_REQUIREMENTS, [plan_id=27388]

Project [COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112 AS COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#101113 AS COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#101115 AS COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, str_remove_space(str_if_with_rule(((COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112 <=> B) OR (COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112 <=> C)), str_extract_middle(COL_B706A975_F287_4DC9_B631_A35735FE936F#101109, 78, 5), null), ONLY_ONE) AS COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239]

ColumnarToRow

WholeStageCodegen (1)

FileScan parquet [COL_B706A975_F287_4DC9_B631_A35735FE936F#101109,COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112,COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#101113,COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#101115] Batched: true, DataFilters: [], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/output/cache/parquet/datablock/00_A_LIGNES_RSF_345253], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<COL_B706A975_F287_4DC9_B631_A35735FE936F:string,COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38:s...

Project [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053 AS 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101428, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054 AS 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429]

Filter (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#101069 <=> 1)

WholeStageCodegen (7)

Window [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#101069], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053], [1 DESC NULLS LAST]

Sort [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

WholeStageCodegen (6)

Exchange hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, 10), ENSURE_REQUIREMENTS, [plan_id=27407]

Project [Numéro Séjour#100932 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, UF#100933 AS COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054]

Filter (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#100932, #)) THEN false ELSE StartsWith(Numéro Séjour#100932, #) END AND isnotnull(Numéro Séjour#100932))

WholeStageCodegen (2)

FileScan csv [Numéro Séjour#100932,UF#100933] Batched: false, DataFilters: [NOT CASE WHEN isnull(StartsWith(Numéro Séjour#100932, #)) THEN false ELSE StartsWith(Numéro Séjo..., Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/02_PASSAGE_PATI_344985/passage_pationt_..., PartitionFilters: [], PushedFilters: [IsNotNull(Numéro Séjour)], ReadSchema: struct<Numéro Séjour:string,UF:string>

Details

== Physical Plan ==
AdaptiveSparkPlan (70)
+- == Final Plan ==
   * HashAggregate (40)
   +- ShuffleQueryStage (39), Statistics(sizeInBytes=16.0 B, rowCount=1)
      +- Exchange (38)
         +- * HashAggregate (37)
            +- * Project (36)
               +- * Filter (35)
                  +- Window (34)
                     +- * Sort (33)
                        +- AQEShuffleRead (32)
                           +- ShuffleQueryStage (31), Statistics(sizeInBytes=285.1 MiB, rowCount=6.03E+5)
                              +- Exchange (30)
                                 +- * Project (29)
                                    +- Window (28)
                                       +- * Sort (27)
                                          +- AQEShuffleRead (26)
                                             +- ShuffleQueryStage (25), Statistics(sizeInBytes=21.5 MiB, rowCount=6.03E+5)
                                                +- Exchange (24)
                                                   +- * Project (23)
                                                      +- * SortMergeJoin LeftOuter (22)
                                                         :- * Sort (12)
                                                         :  +- ShuffleQueryStage (11), Statistics(sizeInBytes=51.3 MiB, rowCount=6.03E+5)
                                                         :     +- Exchange (10)
                                                         :        +- * Project (9)
                                                         :           +- * Filter (8)
                                                         :              +- Window (7)
                                                         :                 +- * Sort (6)
                                                         :                    +- ShuffleQueryStage (5), Statistics(sizeInBytes=262.3 MiB, rowCount=3.00E+6)
                                                         :                       +- Exchange (4)
                                                         :                          +- * Project (3)
                                                         :                             +- * ColumnarToRow (2)
                                                         :                                +- Scan parquet  (1)
                                                         +- * Project (21)
                                                            +- * Filter (20)
                                                               +- Window (19)
                                                                  +- * Sort (18)
                                                                     +- ShuffleQueryStage (17), Statistics(sizeInBytes=6.3 MiB, rowCount=9.30E+4)
                                                                        +- Exchange (16)
                                                                           +- * Project (15)
                                                                              +- * Filter (14)
                                                                                 +- Scan csv  (13)
+- == Initial Plan ==
   HashAggregate (69)
   +- Exchange (68)
      +- HashAggregate (67)
         +- Project (66)
            +- Filter (65)
               +- Window (64)
                  +- Sort (63)
                     +- Exchange (62)
                        +- Project (61)
                           +- Window (60)
                              +- Sort (59)
                                 +- Exchange (58)
                                    +- Project (57)
                                       +- SortMergeJoin LeftOuter (56)
                                          :- Sort (48)
                                          :  +- Exchange (47)
                                          :     +- Project (46)
                                          :        +- Filter (45)
                                          :           +- Window (44)
                                          :              +- Sort (43)
                                          :                 +- Exchange (42)
                                          :                    +- Project (41)
                                          :                       +- Scan parquet  (1)
                                          +- Project (55)
                                             +- Filter (54)
                                                +- Window (53)
                                                   +- Sort (52)
                                                      +- Exchange (51)
                                                         +- Project (50)
                                                            +- Filter (49)
                                                               +- Scan csv  (13)


(1) Scan parquet 
Output [4]: [COL_B706A975_F287_4DC9_B631_A35735FE936F#101109, COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#101113, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#101115]
Batched: true
Location: InMemoryFileIndex [file:/data/output/cache/parquet/datablock/00_A_LIGNES_RSF_345253]
ReadSchema: struct<COL_B706A975_F287_4DC9_B631_A35735FE936F:string,COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38:string,COL_0767075F_6D90_4406_A1C5_BC087A39F7CE:string,COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D:string>

(2) ColumnarToRow [codegen id : 1]
Input [4]: [COL_B706A975_F287_4DC9_B631_A35735FE936F#101109, COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#101113, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#101115]

(3) Project [codegen id : 1]
Output [4]: [COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112 AS COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#101113 AS COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#101115 AS COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, str_remove_space(str_if_with_rule(((COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112 <=> B) OR (COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112 <=> C)), str_extract_middle(COL_B706A975_F287_4DC9_B631_A35735FE936F#101109, 78, 5), null), ONLY_ONE) AS COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239]
Input [4]: [COL_B706A975_F287_4DC9_B631_A35735FE936F#101109, COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#101113, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#101115]

(4) Exchange
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239]
Arguments: hashpartitioning(COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, 10), ENSURE_REQUIREMENTS, [plan_id=27388]

(5) ShuffleQueryStage
Output [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239]
Arguments: 0

(6) Sort [codegen id : 3]
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239]
Arguments: [COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(7) Window
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239]
Arguments: [collect_set(COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239, 0, 0) windowspecdefinition(COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272], [COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217], [1 DESC NULLS LAST]

(8) Filter [codegen id : 4]
Input [5]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272]
Condition : (COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216 <=> A)

(9) Project [codegen id : 4]
Output [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272]
Input [5]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272]

(10) Exchange
Input [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272]
Arguments: hashpartitioning(COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, 10), ENSURE_REQUIREMENTS, [plan_id=27952]

(11) ShuffleQueryStage
Output [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272]
Arguments: 2

(12) Sort [codegen id : 5]
Input [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272]
Arguments: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219 ASC NULLS FIRST], false, 0

(13) Scan csv 
Output [2]: [Numéro Séjour#100932, UF#100933]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/02_PASSAGE_PATI_344985/passage_pationt_09122025.csv]
PushedFilters: [IsNotNull(Numéro Séjour)]
ReadSchema: struct<Numéro Séjour:string,UF:string>

(14) Filter [codegen id : 2]
Input [2]: [Numéro Séjour#100932, UF#100933]
Condition : (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#100932, #)) THEN false ELSE StartsWith(Numéro Séjour#100932, #) END AND isnotnull(Numéro Séjour#100932))

(15) Project [codegen id : 2]
Output [2]: [Numéro Séjour#100932 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, UF#100933 AS COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054]
Input [2]: [Numéro Séjour#100932, UF#100933]

(16) Exchange
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054]
Arguments: hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, 10), ENSURE_REQUIREMENTS, [plan_id=27407]

(17) ShuffleQueryStage
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054]
Arguments: 1

(18) Sort [codegen id : 6]
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054]
Arguments: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(19) Window
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054]
Arguments: [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#101069], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053], [1 DESC NULLS LAST]

(20) Filter [codegen id : 7]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#101069]
Condition : (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#101069 <=> 1)

(21) Project [codegen id : 7]
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053 AS 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101428, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054 AS 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#101069]

(22) SortMergeJoin [codegen id : 8]
Left keys [1]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219]
Right keys [1]: [00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101428]
Join type: LeftOuter
Join condition: None

(23) Project [codegen id : 8]
Output [3]: [str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272, [SAS]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429, ) AS COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429 AS COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272, [SUN,SUF]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429, ) AS COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735]
Input [4]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272, 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101428, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429]

(24) Exchange
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735]
Arguments: hashpartitioning(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, 10), ENSURE_REQUIREMENTS, [plan_id=28100]

(25) ShuffleQueryStage
Output [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735]
Arguments: 3

(26) AQEShuffleRead
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735]
Arguments: coalesced

(27) Sort [codegen id : 9]
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735]
Arguments: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(28) Window
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735]
Arguments: [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, 0, 0) windowspecdefinition(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_87E64838_3BAB_4526_BF3E_008427D11600#101784], [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733], [1 DESC NULLS LAST]

(29) Project [codegen id : 10]
Output [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784]
Input [4]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784]

(30) Exchange
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784]
Arguments: hashpartitioning(COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, 10), ENSURE_REQUIREMENTS, [plan_id=28202]

(31) ShuffleQueryStage
Output [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784]
Arguments: 4

(32) AQEShuffleRead
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784]
Arguments: coalesced

(33) Sort [codegen id : 11]
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784]
Arguments: [COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(34) Window
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784]
Arguments: [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, 0, 0) windowspecdefinition(COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_2094C447_FD18_4EDD_AB41_506CB04536E3#101859], [COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735], [1 DESC NULLS LAST]

(35) Filter [codegen id : 12]
Input [4]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784, COL_2094C447_FD18_4EDD_AB41_506CB04536E3#101859]
Condition : (isnotnull(str_list_as_str(COL_87E64838_3BAB_4526_BF3E_008427D11600#101784)) OR isnotnull(str_list_as_str(COL_2094C447_FD18_4EDD_AB41_506CB04536E3#101859)))

(36) Project [codegen id : 12]
Output: []
Input [4]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784, COL_2094C447_FD18_4EDD_AB41_506CB04536E3#101859]

(37) HashAggregate [codegen id : 12]
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#102139L]
Results [1]: [count#102140L]

(38) Exchange
Input [1]: [count#102140L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=28273]

(39) ShuffleQueryStage
Output [1]: [count#102140L]
Arguments: 5

(40) HashAggregate [codegen id : 13]
Input [1]: [count#102140L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#102136L]
Results [1]: [count(1)#102136L AS count#102137L]

(41) Project
Output [4]: [COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112 AS COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#101113 AS COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#101115 AS COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, str_remove_space(str_if_with_rule(((COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112 <=> B) OR (COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112 <=> C)), str_extract_middle(COL_B706A975_F287_4DC9_B631_A35735FE936F#101109, 78, 5), null), ONLY_ONE) AS COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239]
Input [4]: [COL_B706A975_F287_4DC9_B631_A35735FE936F#101109, COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#101112, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#101113, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#101115]

(42) Exchange
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239]
Arguments: hashpartitioning(COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, 10), ENSURE_REQUIREMENTS, [plan_id=27294]

(43) Sort
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239]
Arguments: [COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(44) Window
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239]
Arguments: [collect_set(COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239, 0, 0) windowspecdefinition(COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272], [COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217], [1 DESC NULLS LAST]

(45) Filter
Input [5]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272]
Condition : (COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216 <=> A)

(46) Project
Output [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272]
Input [5]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#101216, COL_86264515_64DE_4F5A_B65C_1F224369C11E#101217, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#101239, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272]

(47) Exchange
Input [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272]
Arguments: hashpartitioning(COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, 10), ENSURE_REQUIREMENTS, [plan_id=27306]

(48) Sort
Input [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272]
Arguments: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219 ASC NULLS FIRST], false, 0

(49) Filter
Input [2]: [Numéro Séjour#100932, UF#100933]
Condition : (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#100932, #)) THEN false ELSE StartsWith(Numéro Séjour#100932, #) END AND isnotnull(Numéro Séjour#100932))

(50) Project
Output [2]: [Numéro Séjour#100932 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, UF#100933 AS COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054]
Input [2]: [Numéro Séjour#100932, UF#100933]

(51) Exchange
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054]
Arguments: hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, 10), ENSURE_REQUIREMENTS, [plan_id=27299]

(52) Sort
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054]
Arguments: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(53) Window
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054]
Arguments: [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#101069], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053], [1 DESC NULLS LAST]

(54) Filter
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#101069]
Condition : (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#101069 <=> 1)

(55) Project
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053 AS 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101428, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054 AS 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101053, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101054, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#101069]

(56) SortMergeJoin
Left keys [1]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219]
Right keys [1]: [00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101428]
Join type: LeftOuter
Join condition: None

(57) Project
Output [3]: [str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272, [SAS]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429, ) AS COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429 AS COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272, [SUN,SUF]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429, ) AS COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735]
Input [4]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#101219, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#101272, 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#101428, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#101429]

(58) Exchange
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735]
Arguments: hashpartitioning(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, 10), ENSURE_REQUIREMENTS, [plan_id=27311]

(59) Sort
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735]
Arguments: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(60) Window
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735]
Arguments: [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, 0, 0) windowspecdefinition(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_87E64838_3BAB_4526_BF3E_008427D11600#101784], [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733], [1 DESC NULLS LAST]

(61) Project
Output [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784]
Input [4]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#101733, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784]

(62) Exchange
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784]
Arguments: hashpartitioning(COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, 10), ENSURE_REQUIREMENTS, [plan_id=27316]

(63) Sort
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784]
Arguments: [COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(64) Window
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784]
Arguments: [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, 0, 0) windowspecdefinition(COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_2094C447_FD18_4EDD_AB41_506CB04536E3#101859], [COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735], [1 DESC NULLS LAST]

(65) Filter
Input [4]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784, COL_2094C447_FD18_4EDD_AB41_506CB04536E3#101859]
Condition : (isnotnull(str_list_as_str(COL_87E64838_3BAB_4526_BF3E_008427D11600#101784)) OR isnotnull(str_list_as_str(COL_2094C447_FD18_4EDD_AB41_506CB04536E3#101859)))

(66) Project
Output: []
Input [4]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#101734, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#101735, COL_87E64838_3BAB_4526_BF3E_008427D11600#101784, COL_2094C447_FD18_4EDD_AB41_506CB04536E3#101859]

(67) HashAggregate
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#102139L]
Results [1]: [count#102140L]

(68) Exchange
Input [1]: [count#102140L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=27323]

(69) HashAggregate
Input [1]: [count#102140L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#102136L]
Results [1]: [count(1)#102136L AS count#102137L]

(70) AdaptiveSparkPlan
Output [1]: [count#102137L]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet