SP1 - Details for Query 597

Submitted Time: 2026/08/28 12:17:53
Duration: 36 s
Succeeded Jobs: 705 706 707 708 709 710 711

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; 1 [labelType="html" label="ObjectHashAggregate number of output rows: 1 time in aggregation build: 11 ms spill size: 0.0 B number of sort fallback tasks: 0"]; 2 [labelType="html" label="Exchange shuffle records written: 1 local merged chunks fetched: 0 shuffle write time: 0 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 1 local bytes read: 452.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 1240.0 B local merged bytes read: 0.0 B number of partitions: 1 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 452.0 B"]; 3 [labelType="html" label="ObjectHashAggregate number of output rows: 1 time in aggregation build: 27.9 s spill size: 0.0 B number of sort fallback tasks: 0"]; subgraph cluster4 { isCluster="true"; label="WholeStageCodegen (12)\n \nduration: 27.9 s"; 5 [labelType="html" label=" Project "]; } 6 [labelType="html" label="Window spill size: 0.0 B"]; subgraph cluster7 { isCluster="true"; label="WholeStageCodegen (11)\n \nduration: 28.6 s"; 8 [labelType="html" label="Sort sort time: 91 ms peak memory: 304.0 MiB spill size: 0.0 B"]; } 9 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 5.5 MiB number of coalesced partitions: 1"]; 10 [labelType="html" label="Exchange shuffle records written: 602,754 local merged chunks fetched: 0 shuffle write time: 15 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 602,754 local bytes read: 5.4 MiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 285.1 MiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 5.4 MiB"]; subgraph cluster11 { isCluster="true"; label="WholeStageCodegen (10)\n \nduration: 880 ms"; 12 [labelType="html" label=" Project "]; } 13 [labelType="html" label="Window spill size: 0.0 B"]; subgraph cluster14 { isCluster="true"; label="WholeStageCodegen (9)\n \nduration: 1.1 s"; 15 [labelType="html" label="Sort sort time: 44 ms peak memory: 48.0 MiB spill size: 0.0 B"]; } 16 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 939.2 KiB number of coalesced partitions: 1"]; 17 [labelType="html" label="Exchange shuffle records written: 602,754 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 14 ms (1 ms, 1 ms, 1 ms (stage 1151.0: task 1536)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 602,754 local bytes read: 911.1 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 10 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 21.5 MiB (2.1 MiB, 2.2 MiB, 2.2 MiB (stage 1151.0: task 1536)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 911.1 KiB (89.7 KiB, 91.3 KiB, 92.2 KiB (stage 1151.0: task 1536))"]; subgraph cluster18 { isCluster="true"; label="WholeStageCodegen (8)\n \nduration: total (min, med, max (stageId: taskId))\n5.5 s (537 ms, 557 ms, 571 ms (stage 1151.0: task 1539))"; 19 [labelType="html" label=" Project "]; 20 [labelType="html" label="SortMergeJoin number of output rows: 602,754 spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1151.0: task 1530))"]; } subgraph cluster21 { isCluster="true"; label="WholeStageCodegen (5)\n \nduration: total (min, med, max (stageId: taskId))\n5.6 s (545 ms, 564 ms, 578 ms (stage 1151.0: task 1539))"; 22 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 118 ms (11 ms, 12 ms, 15 ms (stage 1151.0: task 1538)) peak memory total (min, med, max (stageId: taskId)) 180.0 MiB (18.0 MiB, 18.0 MiB, 18.0 MiB (stage 1151.0: task 1530)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1151.0: task 1530))"]; } 23 [labelType="html" label="Exchange shuffle records written: 602,754 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 60 ms (5 ms, 5 ms, 8 ms (stage 1147.0: task 1528)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 602,754 local bytes read total (min, med, max (stageId: taskId)) 15.3 MiB (1557.8 KiB, 1571.2 KiB, 1579.4 KiB (stage 1151.0: task 1536)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1151.0: task 1530)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 100 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 51.3 MiB (5.1 MiB, 5.1 MiB, 5.2 MiB (stage 1147.0: task 1529)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 15.3 MiB (1557.0 KiB, 1571.4 KiB, 1578.9 KiB (stage 1147.0: task 1521))"]; subgraph cluster24 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: total (min, med, max (stageId: taskId))\n3.7 s (350 ms, 376 ms, 397 ms (stage 1147.0: task 1525))"; 25 [labelType="html" label=" Project "]; 26 [labelType="html" label="Filter number of output rows: 602,754"]; } 27 [labelType="html" label="Window spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1147.0: task 1526))"]; subgraph cluster28 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: total (min, med, max (stageId: taskId))\n5.3 s (498 ms, 530 ms, 576 ms (stage 1147.0: task 1522))"; 29 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 192 ms (17 ms, 17 ms, 32 ms (stage 1147.0: task 1522)) peak memory total (min, med, max (stageId: taskId)) 400.0 MiB (40.0 MiB, 40.0 MiB, 40.0 MiB (stage 1147.0: task 1520)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1147.0: task 1520))"]; } 30 [labelType="html" label="Exchange shuffle records written: 2,996,009 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 94 ms (14 ms, 79 ms, 79 ms (stage 1144.0: task 1512)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 2,996,009 local bytes read total (min, med, max (stageId: taskId)) 30.6 MiB (3.0 MiB, 3.1 MiB, 3.1 MiB (stage 1147.0: task 1529)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1147.0: task 1520)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 20 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 262.3 MiB (39.0 MiB, 223.2 MiB, 223.2 MiB (stage 1144.0: task 1512)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 30.6 MiB (4.6 MiB, 26.0 MiB, 26.0 MiB (stage 1144.0: task 1512))"]; subgraph cluster31 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: total (min, med, max (stageId: taskId))\n5.4 s (3 ms, 4 ms, 4.5 s (stage 1144.0: task 1512))"; 32 [labelType="html" label=" Project "]; 33 [labelType="html" label="ColumnarToRow number of output rows: 2,996,009 number of input batches: 732"]; } 34 [labelType="html" label="Scan parquet number of files read: 1 scan time total (min, med, max (stageId: taskId)) 1.2 s (2 ms, 3 ms, 1.0 s (stage 1144.0: task 1512)) metadata time: 0 ms size of files read: 150.9 MiB number of output rows: 2,996,009"]; subgraph cluster35 { isCluster="true"; label="WholeStageCodegen (7)\n \nduration: 0 ms"; 36 [labelType="html" label=" Project "]; 37 [labelType="html" label="Filter number of output rows: 88,203"]; } 38 [labelType="html" label="Window spill size: 0.0 B"]; subgraph cluster39 { isCluster="true"; label="WholeStageCodegen (6)\n \nduration: 0 ms"; 40 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1151.0: task 1530)) peak memory total (min, med, max (stageId: taskId)) 162.5 MiB (16.3 MiB, 16.3 MiB, 16.3 MiB (stage 1151.0: task 1530)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 1151.0: task 1530))"]; } 41 [labelType="html" label="Exchange shuffle records written: 93,005 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 6 ms (2 ms, 3 ms, 3 ms (stage 1145.0: task 1518)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 93,005 local bytes read total (min, med, max (stageId: taskId)) 1057.6 KiB (103.1 KiB, 106.2 KiB, 107.8 KiB (stage 1151.0: task 1536)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1151.0: task 1530)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 20 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 6.3 MiB (2.6 MiB, 3.7 MiB, 3.7 MiB (stage 1145.0: task 1518)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 1057.6 KiB (437.9 KiB, 619.8 KiB, 619.8 KiB (stage 1145.0: task 1518))"]; subgraph cluster42 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: total (min, med, max (stageId: taskId))\n452 ms (199 ms, 253 ms, 253 ms (stage 1145.0: task 1518))"; 43 [labelType="html" label=" Project "]; 44 [labelType="html" label="Filter number of output rows: 93,005"]; } 45 [labelType="html" label="Scan csv number of output rows: 93,005 number of files read: 1 metadata time: 0 ms size of files read: 6.4 MiB"]; 1->0; 2->1; 3->2; 5->3; 6->5; 8->6; 9->8; 10->9; 12->10; 13->12; 15->13; 16->15; 17->16; 19->17; 20->19; 22->20; 23->22; 25->23; 26->25; 27->26; 29->27; 30->29; 32->30; 33->32; 34->33; 36->20; 37->36; 38->37; 40->38; 41->40; 43->41; 44->43; 45->44; }

AdaptiveSparkPlan isFinalPlan=true

ObjectHashAggregate(keys=[], functions=[collect_set(COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, 0, 0), collect_set(COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782, 0, 0)])

Exchange SinglePartition, ENSURE_REQUIREMENTS, [plan_id=29420]

ObjectHashAggregate(keys=[], functions=[partial_collect_set(COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, 0, 0), partial_collect_set(COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782, 0, 0)])

Project [str_list_as_str(COL_87E64838_3BAB_4526_BF3E_008427D11600#105535) AS COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, str_list_as_str(COL_2094C447_FD18_4EDD_AB41_506CB04536E3#105610) AS COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782]

WholeStageCodegen (12)

Window [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, 0, 0) windowspecdefinition(COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_2094C447_FD18_4EDD_AB41_506CB04536E3#105610], [COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486], [1 DESC NULLS LAST]

Sort [COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

WholeStageCodegen (11)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, 10), ENSURE_REQUIREMENTS, [plan_id=29357]

Project [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535]

WholeStageCodegen (10)

Window [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, 0, 0) windowspecdefinition(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_87E64838_3BAB_4526_BF3E_008427D11600#105535], [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484], [1 DESC NULLS LAST]

Sort [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

WholeStageCodegen (9)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, 10), ENSURE_REQUIREMENTS, [plan_id=29261]

Project [str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023, [SAS]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180, ) AS COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180 AS COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023, [SUN,SUF]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180, ) AS COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486]

SortMergeJoin [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970], [00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#105179], LeftOuter

WholeStageCodegen (8)

Sort [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970 ASC NULLS FIRST], false, 0

WholeStageCodegen (5)

Exchange hashpartitioning(COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, 10), ENSURE_REQUIREMENTS, [plan_id=29132]

Project [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023]

Filter (COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967 <=> A)

WholeStageCodegen (4)

Window [collect_set(COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990, 0, 0) windowspecdefinition(COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023], [COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968], [1 DESC NULLS LAST]

Sort [COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

WholeStageCodegen (3)

Exchange hashpartitioning(COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, 10), ENSURE_REQUIREMENTS, [plan_id=28891]

Project [COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863 AS COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#104864 AS COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#104866 AS COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, str_remove_space(str_if_with_rule(((COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863 <=> B) OR (COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863 <=> C)), str_extract_middle(COL_B706A975_F287_4DC9_B631_A35735FE936F#104860, 78, 5), null), ONLY_ONE) AS COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990]

ColumnarToRow

WholeStageCodegen (1)

FileScan parquet [COL_B706A975_F287_4DC9_B631_A35735FE936F#104860,COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863,COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#104864,COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#104866] Batched: true, DataFilters: [], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/output/cache/parquet/datablock/00_A_LIGNES_RSF_345253], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<COL_B706A975_F287_4DC9_B631_A35735FE936F:string,COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38:s...

Project [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804 AS 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#105179, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805 AS 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180]

Filter (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#104820 <=> 1)

WholeStageCodegen (7)

Window [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#104820], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804], [1 DESC NULLS LAST]

Sort [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

WholeStageCodegen (6)

Exchange hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, 10), ENSURE_REQUIREMENTS, [plan_id=28910]

Project [Numéro Séjour#104683 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, UF#104684 AS COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805]

Filter (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#104683, #)) THEN false ELSE StartsWith(Numéro Séjour#104683, #) END AND isnotnull(Numéro Séjour#104683))

WholeStageCodegen (2)

FileScan csv [Numéro Séjour#104683,UF#104684] Batched: false, DataFilters: [NOT CASE WHEN isnull(StartsWith(Numéro Séjour#104683, #)) THEN false ELSE StartsWith(Numéro Séjo..., Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/02_PASSAGE_PATI_344985/passage_pationt_..., PartitionFilters: [], PushedFilters: [IsNotNull(Numéro Séjour)], ReadSchema: struct<Numéro Séjour:string,UF:string>

Details

== Physical Plan ==
AdaptiveSparkPlan (68)
+- == Final Plan ==
   ObjectHashAggregate (39)
   +- ShuffleQueryStage (38), Statistics(sizeInBytes=1240.0 B, rowCount=1)
      +- Exchange (37)
         +- ObjectHashAggregate (36)
            +- * Project (35)
               +- Window (34)
                  +- * Sort (33)
                     +- AQEShuffleRead (32)
                        +- ShuffleQueryStage (31), Statistics(sizeInBytes=285.1 MiB, rowCount=6.03E+5)
                           +- Exchange (30)
                              +- * Project (29)
                                 +- Window (28)
                                    +- * Sort (27)
                                       +- AQEShuffleRead (26)
                                          +- ShuffleQueryStage (25), Statistics(sizeInBytes=21.5 MiB, rowCount=6.03E+5)
                                             +- Exchange (24)
                                                +- * Project (23)
                                                   +- * SortMergeJoin LeftOuter (22)
                                                      :- * Sort (12)
                                                      :  +- ShuffleQueryStage (11), Statistics(sizeInBytes=51.3 MiB, rowCount=6.03E+5)
                                                      :     +- Exchange (10)
                                                      :        +- * Project (9)
                                                      :           +- * Filter (8)
                                                      :              +- Window (7)
                                                      :                 +- * Sort (6)
                                                      :                    +- ShuffleQueryStage (5), Statistics(sizeInBytes=262.3 MiB, rowCount=3.00E+6)
                                                      :                       +- Exchange (4)
                                                      :                          +- * Project (3)
                                                      :                             +- * ColumnarToRow (2)
                                                      :                                +- Scan parquet  (1)
                                                      +- * Project (21)
                                                         +- * Filter (20)
                                                            +- Window (19)
                                                               +- * Sort (18)
                                                                  +- ShuffleQueryStage (17), Statistics(sizeInBytes=6.3 MiB, rowCount=9.30E+4)
                                                                     +- Exchange (16)
                                                                        +- * Project (15)
                                                                           +- * Filter (14)
                                                                              +- Scan csv  (13)
+- == Initial Plan ==
   ObjectHashAggregate (67)
   +- Exchange (66)
      +- ObjectHashAggregate (65)
         +- Project (64)
            +- Window (63)
               +- Sort (62)
                  +- Exchange (61)
                     +- Project (60)
                        +- Window (59)
                           +- Sort (58)
                              +- Exchange (57)
                                 +- Project (56)
                                    +- SortMergeJoin LeftOuter (55)
                                       :- Sort (47)
                                       :  +- Exchange (46)
                                       :     +- Project (45)
                                       :        +- Filter (44)
                                       :           +- Window (43)
                                       :              +- Sort (42)
                                       :                 +- Exchange (41)
                                       :                    +- Project (40)
                                       :                       +- Scan parquet  (1)
                                       +- Project (54)
                                          +- Filter (53)
                                             +- Window (52)
                                                +- Sort (51)
                                                   +- Exchange (50)
                                                      +- Project (49)
                                                         +- Filter (48)
                                                            +- Scan csv  (13)


(1) Scan parquet 
Output [4]: [COL_B706A975_F287_4DC9_B631_A35735FE936F#104860, COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#104864, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#104866]
Batched: true
Location: InMemoryFileIndex [file:/data/output/cache/parquet/datablock/00_A_LIGNES_RSF_345253]
ReadSchema: struct<COL_B706A975_F287_4DC9_B631_A35735FE936F:string,COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38:string,COL_0767075F_6D90_4406_A1C5_BC087A39F7CE:string,COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D:string>

(2) ColumnarToRow [codegen id : 1]
Input [4]: [COL_B706A975_F287_4DC9_B631_A35735FE936F#104860, COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#104864, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#104866]

(3) Project [codegen id : 1]
Output [4]: [COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863 AS COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#104864 AS COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#104866 AS COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, str_remove_space(str_if_with_rule(((COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863 <=> B) OR (COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863 <=> C)), str_extract_middle(COL_B706A975_F287_4DC9_B631_A35735FE936F#104860, 78, 5), null), ONLY_ONE) AS COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990]
Input [4]: [COL_B706A975_F287_4DC9_B631_A35735FE936F#104860, COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#104864, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#104866]

(4) Exchange
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990]
Arguments: hashpartitioning(COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, 10), ENSURE_REQUIREMENTS, [plan_id=28891]

(5) ShuffleQueryStage
Output [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990]
Arguments: 0

(6) Sort [codegen id : 3]
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990]
Arguments: [COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(7) Window
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990]
Arguments: [collect_set(COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990, 0, 0) windowspecdefinition(COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023], [COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968], [1 DESC NULLS LAST]

(8) Filter [codegen id : 4]
Input [5]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023]
Condition : (COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967 <=> A)

(9) Project [codegen id : 4]
Output [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023]
Input [5]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023]

(10) Exchange
Input [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023]
Arguments: hashpartitioning(COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, 10), ENSURE_REQUIREMENTS, [plan_id=29132]

(11) ShuffleQueryStage
Output [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023]
Arguments: 2

(12) Sort [codegen id : 5]
Input [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023]
Arguments: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970 ASC NULLS FIRST], false, 0

(13) Scan csv 
Output [2]: [Numéro Séjour#104683, UF#104684]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/02_PASSAGE_PATI_344985/passage_pationt_09122025.csv]
PushedFilters: [IsNotNull(Numéro Séjour)]
ReadSchema: struct<Numéro Séjour:string,UF:string>

(14) Filter [codegen id : 2]
Input [2]: [Numéro Séjour#104683, UF#104684]
Condition : (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#104683, #)) THEN false ELSE StartsWith(Numéro Séjour#104683, #) END AND isnotnull(Numéro Séjour#104683))

(15) Project [codegen id : 2]
Output [2]: [Numéro Séjour#104683 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, UF#104684 AS COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805]
Input [2]: [Numéro Séjour#104683, UF#104684]

(16) Exchange
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805]
Arguments: hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, 10), ENSURE_REQUIREMENTS, [plan_id=28910]

(17) ShuffleQueryStage
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805]
Arguments: 1

(18) Sort [codegen id : 6]
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805]
Arguments: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(19) Window
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805]
Arguments: [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#104820], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804], [1 DESC NULLS LAST]

(20) Filter [codegen id : 7]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#104820]
Condition : (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#104820 <=> 1)

(21) Project [codegen id : 7]
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804 AS 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#105179, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805 AS 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#104820]

(22) SortMergeJoin [codegen id : 8]
Left keys [1]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970]
Right keys [1]: [00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#105179]
Join type: LeftOuter
Join condition: None

(23) Project [codegen id : 8]
Output [3]: [str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023, [SAS]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180, ) AS COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180 AS COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023, [SUN,SUF]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180, ) AS COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486]
Input [4]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023, 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#105179, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180]

(24) Exchange
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486]
Arguments: hashpartitioning(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, 10), ENSURE_REQUIREMENTS, [plan_id=29261]

(25) ShuffleQueryStage
Output [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486]
Arguments: 3

(26) AQEShuffleRead
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486]
Arguments: coalesced

(27) Sort [codegen id : 9]
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486]
Arguments: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(28) Window
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486]
Arguments: [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, 0, 0) windowspecdefinition(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_87E64838_3BAB_4526_BF3E_008427D11600#105535], [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484], [1 DESC NULLS LAST]

(29) Project [codegen id : 10]
Output [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535]
Input [4]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535]

(30) Exchange
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535]
Arguments: hashpartitioning(COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, 10), ENSURE_REQUIREMENTS, [plan_id=29357]

(31) ShuffleQueryStage
Output [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535]
Arguments: 4

(32) AQEShuffleRead
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535]
Arguments: coalesced

(33) Sort [codegen id : 11]
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535]
Arguments: [COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(34) Window
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535]
Arguments: [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, 0, 0) windowspecdefinition(COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_2094C447_FD18_4EDD_AB41_506CB04536E3#105610], [COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486], [1 DESC NULLS LAST]

(35) Project [codegen id : 12]
Output [2]: [str_list_as_str(COL_87E64838_3BAB_4526_BF3E_008427D11600#105535) AS COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, str_list_as_str(COL_2094C447_FD18_4EDD_AB41_506CB04536E3#105610) AS COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782]
Input [4]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535, COL_2094C447_FD18_4EDD_AB41_506CB04536E3#105610]

(36) ObjectHashAggregate
Input [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782]
Keys: []
Functions [2]: [partial_collect_set(COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, 0, 0), partial_collect_set(COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782, 0, 0)]
Aggregate Attributes [2]: [buf#105849, buf#105850]
Results [2]: [buf#105851, buf#105852]

(37) Exchange
Input [2]: [buf#105851, buf#105852]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=29420]

(38) ShuffleQueryStage
Output [2]: [buf#105851, buf#105852]
Arguments: 5

(39) ObjectHashAggregate
Input [2]: [buf#105851, buf#105852]
Keys: []
Functions [2]: [collect_set(COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, 0, 0), collect_set(COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782, 0, 0)]
Aggregate Attributes [2]: [collect_set(COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, 0, 0)#105835, collect_set(COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782, 0, 0)#105837]
Results [2]: [collect_set(COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, 0, 0)#105835 AS COL_E62322DC_5484_43E2_B84A_CB48C76BB235#105845, collect_set(COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782, 0, 0)#105837 AS COL_2018A643_F4A6_47BE_B780_14EA53E475E6#105846]

(40) Project
Output [4]: [COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863 AS COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#104864 AS COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#104866 AS COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, str_remove_space(str_if_with_rule(((COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863 <=> B) OR (COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863 <=> C)), str_extract_middle(COL_B706A975_F287_4DC9_B631_A35735FE936F#104860, 78, 5), null), ONLY_ONE) AS COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990]
Input [4]: [COL_B706A975_F287_4DC9_B631_A35735FE936F#104860, COL_1ADA21FB_DB08_4A1F_986E_E8E363B14F38#104863, COL_0767075F_6D90_4406_A1C5_BC087A39F7CE#104864, COL_1CCAED33_3E69_435E_B522_DAE3B9E63F9D#104866]

(41) Exchange
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990]
Arguments: hashpartitioning(COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, 10), ENSURE_REQUIREMENTS, [plan_id=28799]

(42) Sort
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990]
Arguments: [COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(43) Window
Input [4]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990]
Arguments: [collect_set(COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990, 0, 0) windowspecdefinition(COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023], [COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968], [1 DESC NULLS LAST]

(44) Filter
Input [5]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023]
Condition : (COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967 <=> A)

(45) Project
Output [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023]
Input [5]: [COL_D50B88DC_7339_47AA_AF53_7DF1382234F8#104967, COL_86264515_64DE_4F5A_B65C_1F224369C11E#104968, COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_FF2201D9_E9A4_4F4A_9614_694F74FD5D0F#104990, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023]

(46) Exchange
Input [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023]
Arguments: hashpartitioning(COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, 10), ENSURE_REQUIREMENTS, [plan_id=28811]

(47) Sort
Input [2]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023]
Arguments: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970 ASC NULLS FIRST], false, 0

(48) Filter
Input [2]: [Numéro Séjour#104683, UF#104684]
Condition : (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#104683, #)) THEN false ELSE StartsWith(Numéro Séjour#104683, #) END AND isnotnull(Numéro Séjour#104683))

(49) Project
Output [2]: [Numéro Séjour#104683 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, UF#104684 AS COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805]
Input [2]: [Numéro Séjour#104683, UF#104684]

(50) Exchange
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805]
Arguments: hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, 10), ENSURE_REQUIREMENTS, [plan_id=28804]

(51) Sort
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805]
Arguments: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(52) Window
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805]
Arguments: [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#104820], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804], [1 DESC NULLS LAST]

(53) Filter
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#104820]
Condition : (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#104820 <=> 1)

(54) Project
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804 AS 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#105179, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805 AS 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#104804, COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#104805, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#104820]

(55) SortMergeJoin
Left keys [1]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970]
Right keys [1]: [00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#105179]
Join type: LeftOuter
Join condition: None

(56) Project
Output [3]: [str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023, [SAS]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180, ) AS COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180 AS COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, str_if_with_rule((size(str_list_intersect_fixed(COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023, [SUN,SUF]), true) <=> 1), 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180, ) AS COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486]
Input [4]: [COL_136DCAA3_2545_47C9_A61E_86ED7914066D#104970, COL_7F6BA768_8054_4161_B9FA_C8767D1D66AD#105023, 00_C_PASSAGE_PA_345648_COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#105179, 00_C_PASSAGE_PA_345648_COL_E82CFB57_01EB_4E90_836D_4D6F4CA131FE#105180]

(57) Exchange
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486]
Arguments: hashpartitioning(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, 10), ENSURE_REQUIREMENTS, [plan_id=28816]

(58) Sort
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486]
Arguments: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(59) Window
Input [3]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486]
Arguments: [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, 0, 0) windowspecdefinition(COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_87E64838_3BAB_4526_BF3E_008427D11600#105535], [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484], [1 DESC NULLS LAST]

(60) Project
Output [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535]
Input [4]: [COL_A7B79A69_6514_4DE6_BB59_8CD22992A386#105484, COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535]

(61) Exchange
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535]
Arguments: hashpartitioning(COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, 10), ENSURE_REQUIREMENTS, [plan_id=28821]

(62) Sort
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535]
Arguments: [COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(63) Window
Input [3]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535]
Arguments: [collect_set(COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, 0, 0) windowspecdefinition(COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, 1 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_2094C447_FD18_4EDD_AB41_506CB04536E3#105610], [COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486], [1 DESC NULLS LAST]

(64) Project
Output [2]: [str_list_as_str(COL_87E64838_3BAB_4526_BF3E_008427D11600#105535) AS COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, str_list_as_str(COL_2094C447_FD18_4EDD_AB41_506CB04536E3#105610) AS COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782]
Input [4]: [COL_AF978AAB_D361_4C61_94AF_432EBFAA8810#105485, COL_8D906CB5_E958_4E21_BA53_1C757CF7C488#105486, COL_87E64838_3BAB_4526_BF3E_008427D11600#105535, COL_2094C447_FD18_4EDD_AB41_506CB04536E3#105610]

(65) ObjectHashAggregate
Input [2]: [COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782]
Keys: []
Functions [2]: [partial_collect_set(COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, 0, 0), partial_collect_set(COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782, 0, 0)]
Aggregate Attributes [2]: [buf#105849, buf#105850]
Results [2]: [buf#105851, buf#105852]

(66) Exchange
Input [2]: [buf#105851, buf#105852]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=28827]

(67) ObjectHashAggregate
Input [2]: [buf#105851, buf#105852]
Keys: []
Functions [2]: [collect_set(COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, 0, 0), collect_set(COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782, 0, 0)]
Aggregate Attributes [2]: [collect_set(COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, 0, 0)#105835, collect_set(COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782, 0, 0)#105837]
Results [2]: [collect_set(COL_5A5CA1D7_78FD_44C9_B61E_BE7E8296E46C#105756, 0, 0)#105835 AS COL_E62322DC_5484_43E2_B84A_CB48C76BB235#105845, collect_set(COL_A3A00539_B329_4DF2_A762_2F27B0C604BE#105782, 0, 0)#105837 AS COL_2018A643_F4A6_47BE_B780_14EA53E475E6#105846]

(68) AdaptiveSparkPlan
Output [2]: [COL_E62322DC_5484_43E2_B84A_CB48C76BB235#105845, COL_2018A643_F4A6_47BE_B780_14EA53E475E6#105846]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet