hdh-spark-job - Details for Query 1339

Submitted Time: 2026/08/31 13:59:47
Duration: 23 s
Succeeded Jobs: 1740 1741 1743 1745 1747 1749

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (13)\n \nduration: 0 ms"; 2 [labelType="html" label="HashAggregate time in aggregation build: 0 ms number of output rows: 1"]; } 3 [labelType="html" label="Exchange shuffle records written: 2 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 2627.0: task 10387)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 2 local bytes read: 118.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 2 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 32.0 B (16.0 B, 16.0 B, 16.0 B (stage 2627.0: task 10388)) local merged bytes read: 0.0 B number of partitions: 1 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 118.0 B (59.0 B, 59.0 B, 59.0 B (stage 2627.0: task 10388))"]; subgraph cluster4 { isCluster="true"; label="WholeStageCodegen (12)\n \nduration: total (min, med, max (stageId: taskId))\n2.0 s (987 ms, 1.0 s, 1.0 s (stage 2627.0: task 10387))"; 5 [labelType="html" label="HashAggregate spill size: 0.0 B time in aggregation build total (min, med, max (stageId: taskId)) 2.0 s (987 ms, 1.0 s, 1.0 s (stage 2627.0: task 10387)) peak memory: 0.0 B number of output rows: 2 number of sort fallback tasks: 0 avg hash probes per key: 0"]; 6 [labelType="html" label=" Project "]; 7 [labelType="html" label="SortMergeJoin number of output rows: 502,502 spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 2627.0: task 10388))"]; } subgraph cluster8 { isCluster="true"; label="WholeStageCodegen (10)\n \nduration: total (min, med, max (stageId: taskId))\n2.0 s (1.0 s, 1.0 s, 1.0 s (stage 2627.0: task 10387))"; 9 [labelType="html" label=" Project "]; 10 [labelType="html" label="SortMergeJoin number of output rows: 502,502 spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 2627.0: task 10388))"]; } subgraph cluster11 { isCluster="true"; label="WholeStageCodegen (8)\n \nduration: total (min, med, max (stageId: taskId))\n2.0 s (1.0 s, 1.0 s, 1.0 s (stage 2627.0: task 10387))"; 12 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 328 ms (162 ms, 166 ms, 166 ms (stage 2627.0: task 10388)) peak memory total (min, med, max (stageId: taskId)) 144.0 MiB (72.0 MiB, 72.0 MiB, 72.0 MiB (stage 2627.0: task 10388)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 2627.0: task 10388))"]; } 13 [labelType="html" label="AQEShuffleRead number of partitions: 2 partition data size total (min, med, max (stageId: taskId)) 965.0 KiB (479.0 KiB, 486.1 KiB, 486.1 KiB (driver)) number of coalesced partitions: 2"]; 14 [labelType="html" label="Exchange shuffle records written: 502,502 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 10 ms (1 ms, 1 ms, 3 ms (stage 2614.0: task 10366)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 502,502 local bytes read total (min, med, max (stageId: taskId)) 929.0 KiB (461.6 KiB, 467.3 KiB, 467.3 KiB (stage 2627.0: task 10387)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 2627.0: task 10388)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 10 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 24.7 MiB (819.0 KiB, 4.1 MiB, 13.1 MiB (stage 2614.0: task 10366)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 929.0 KiB (22.2 KiB, 115.1 KiB, 603.8 KiB (stage 2614.0: task 10366))"]; 15 [labelType="html" label=" Union "]; subgraph cluster16 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: total (min, med, max (stageId: taskId))\n3.5 s (284 ms, 343 ms, 494 ms (stage 2614.0: task 10363))"; 17 [labelType="html" label=" Project "]; 18 [labelType="html" label="Filter number of output rows: 216,339"]; } 19 [labelType="html" label="Scan csv number of output rows: 601,244 number of files read: 1 metadata time: 0 ms size of files read: 104.1 MiB"]; subgraph cluster20 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: 1.5 s"; 21 [labelType="html" label=" Project "]; 22 [labelType="html" label="Filter number of output rows: 286,163"]; 23 [labelType="html" label="Scan JDBCRelation((SELECT \"IPP\", \"Code \u00E9tablissement\", \"Lib \u00E9tablissement\", \"Date pr\u00E9l\u00E9vement\", \"Code examen Biologie\", \"Libell\u00E9 examen Biologie\", \"R\u00E9sultat (num\u00E9rique)\", \"Unite\", \"Code m\u00E9decin\", \"Nom m\u00E9decin\", \"Pr\u00E9nom m\u00E9decin\", \"Nom document biologie\", \"Nom complet document biologie\", \"Venue\", \"Borne basse\", \"Borne haute\" FROM \"public\".\"biologie_etb_lin\") as x) [numPartitions=1] number of output rows: 471,858"]; } subgraph cluster24 { isCluster="true"; label="WholeStageCodegen (9)\n \nduration: 0 ms"; 25 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 67 ms (33 ms, 34 ms, 34 ms (stage 2627.0: task 10387)) peak memory total (min, med, max (stageId: taskId)) 132.0 MiB (66.0 MiB, 66.0 MiB, 66.0 MiB (stage 2627.0: task 10388)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 2627.0: task 10388))"]; } 26 [labelType="html" label="AQEShuffleRead number of partitions: 2 partition data size total (min, med, max (stageId: taskId)) 655.0 KiB (324.3 KiB, 330.7 KiB, 330.7 KiB (driver)) number of coalesced partitions: 2"]; 27 [labelType="html" label="Exchange shuffle records written: 95,007 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 5 ms (1 ms, 2 ms, 2 ms (stage 2620.0: task 10381)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 95,007 local bytes read total (min, med, max (stageId: taskId)) 638.0 KiB (317.6 KiB, 320.5 KiB, 320.5 KiB (stage 2627.0: task 10387)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 2627.0: task 10388)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 6 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 4.6 MiB (469.6 KiB, 1881.4 KiB, 2.3 MiB (stage 2620.0: task 10381)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 638.0 KiB (65.8 KiB, 257.3 KiB, 314.9 KiB (stage 2620.0: task 10381))"]; subgraph cluster28 { isCluster="true"; label="WholeStageCodegen (7)\n \nduration: total (min, med, max (stageId: taskId))\n449 ms (36 ms, 182 ms, 231 ms (stage 2620.0: task 10381))"; 29 [labelType="html" label="HashAggregate spill size: 0.0 B time in aggregation build total (min, med, max (stageId: taskId)) 357 ms (25 ms, 144 ms, 188 ms (stage 2620.0: task 10381)) peak memory total (min, med, max (stageId: taskId)) 196.5 MiB (64.5 MiB, 66.0 MiB, 66.0 MiB (stage 2620.0: task 10382)) number of output rows: 95,007 number of sort fallback tasks: 0 avg hash probes per key (min, med, max (stageId: taskId)): (1.4, 1.5, 1.6 (stage 2620.0: task 10382))"]; } 30 [labelType="html" label="AQEShuffleRead number of partitions: 3 partition data size total (min, med, max (stageId: taskId)) 15.0 MiB (1560.8 KiB, 6.0 MiB, 7.5 MiB (driver)) number of coalesced partitions: 2"]; 31 [labelType="html" label="Exchange shuffle records written: 95,008 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 45 ms (6 ms, 14 ms, 16 ms (stage 2615.0: task 10367)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 95,008 local bytes read total (min, med, max (stageId: taskId)) 14.4 MiB (1477.7 KiB, 5.8 MiB, 7.2 MiB (stage 2620.0: task 10381)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 2620.0: task 10382)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 12 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 66.9 MiB (8.5 MiB, 21.3 MiB, 26.7 MiB (stage 2615.0: task 10367)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 14.4 MiB (1866.2 KiB, 4.6 MiB, 5.8 MiB (stage 2615.0: task 10367))"]; subgraph cluster32 { isCluster="true"; label="WholeStageCodegen (5)\n \nduration: total (min, med, max (stageId: taskId))\n3.8 s (475 ms, 939 ms, 1.9 s (stage 2615.0: task 10367))"; 33 [labelType="html" label="HashAggregate spill size: 0.0 B time in aggregation build total (min, med, max (stageId: taskId)) 3.4 s (430 ms, 846 ms, 1.7 s (stage 2615.0: task 10367)) peak memory total (min, med, max (stageId: taskId)) 260.0 MiB (64.5 MiB, 65.0 MiB, 66.0 MiB (stage 2615.0: task 10367)) number of output rows: 95,008 number of sort fallback tasks: 0 avg hash probes per key (min, med, max (stageId: taskId)): (1.4, 1.5, 1.6 (stage 2615.0: task 10367))"]; } 34 [labelType="html" label=" Union "]; subgraph cluster35 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: total (min, med, max (stageId: taskId))\n2.2 s (470 ms, 1.8 s, 1.8 s (stage 2615.0: task 10367))"; 36 [labelType="html" label=" Project "]; 37 [labelType="html" label="Filter number of output rows: 50,002"]; 38 [labelType="html" label=" Project "]; } 39 [labelType="html" label="Scan csv number of output rows: 50,002 number of files read: 1 metadata time: 0 ms size of files read: 5.3 MiB"]; subgraph cluster40 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: total (min, med, max (stageId: taskId))\n1.3 s (435 ms, 851 ms, 851 ms (stage 2615.0: task 10369))"; 41 [labelType="html" label=" Project "]; 42 [labelType="html" label="Filter number of output rows: 45,006"]; 43 [labelType="html" label=" Project "]; } 44 [labelType="html" label="Scan csv number of output rows: 45,006 number of files read: 2 metadata time: 0 ms size of files read: 4.7 MiB"]; subgraph cluster45 { isCluster="true"; label="WholeStageCodegen (11)\n \nduration: total (min, med, max (stageId: taskId))\n2.0 s (996 ms, 1.0 s, 1.0 s (stage 2627.0: task 10387))"; 46 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 22 ms (11 ms, 11 ms, 11 ms (stage 2627.0: task 10388)) peak memory total (min, med, max (stageId: taskId)) 132.0 MiB (66.0 MiB, 66.0 MiB, 66.0 MiB (stage 2627.0: task 10388)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 2627.0: task 10388))"]; } 47 [labelType="html" label="AQEShuffleRead number of partitions: 2 partition data size total (min, med, max (stageId: taskId)) 711.0 KiB (352.3 KiB, 358.7 KiB, 358.7 KiB (driver)) number of coalesced partitions: 2"]; 48 [labelType="html" label="Exchange shuffle records written: 95,000 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 6 ms (1 ms, 2 ms, 2 ms (stage 2617.0: task 10376)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 95,000 local bytes read total (min, med, max (stageId: taskId)) 692.3 KiB (344.6 KiB, 347.7 KiB, 347.7 KiB (stage 2627.0: task 10387)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 2627.0: task 10388)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 6 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 4.6 MiB (232.0 KiB, 2.2 MiB, 2.2 MiB (stage 2617.0: task 10376)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 692.3 KiB (36.4 KiB, 317.2 KiB, 338.7 KiB (stage 2617.0: task 10376))"]; subgraph cluster49 { isCluster="true"; label="WholeStageCodegen (6)\n \nduration: total (min, med, max (stageId: taskId))\n370 ms (52 ms, 100 ms, 218 ms (stage 2617.0: task 10377))"; 50 [labelType="html" label=" Project "]; 51 [labelType="html" label="Filter number of output rows: 95,000"]; 52 [labelType="html" label="ColumnarToRow number of output rows: 95,000 number of input batches: 26"]; } 53 [labelType="html" label="Scan parquet number of files read: 3 scan time total (min, med, max (stageId: taskId)) 294 ms (15 ms, 65 ms, 214 ms (stage 2617.0: task 10377)) metadata time: 0 ms size of files read: 3.4 MiB number of output rows: 95,000"]; 2->0; 3->2; 5->3; 6->5; 7->6; 9->7; 10->9; 12->10; 13->12; 14->13; 15->14; 17->15; 18->17; 19->18; 21->15; 22->21; 23->22; 25->10; 26->25; 27->26; 29->27; 30->29; 31->30; 33->31; 34->33; 36->34; 37->36; 38->37; 39->38; 41->34; 42->41; 43->42; 44->43; 46->7; 47->46; 48->47; 50->48; 51->50; 52->51; 53->52; }

AdaptiveSparkPlan isFinalPlan=true

HashAggregate(keys=[], functions=[count(1)])

WholeStageCodegen (13)

Exchange SinglePartition, ENSURE_REQUIREMENTS, [plan_id=97560]

HashAggregate(keys=[], functions=[partial_count(1)])

Project

SortMergeJoin [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563], [PATIENT_ADRESSE_19963_IPP_19964#284163, PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160], LeftOuter

WholeStageCodegen (12)

Project [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]

SortMergeJoin [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563], [PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887, PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884], LeftOuter

WholeStageCodegen (10)

Sort [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562 ASC NULLS FIRST, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563 ASC NULLS FIRST], false, 0

WholeStageCodegen (8)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563, 10), ENSURE_REQUIREMENTS, [plan_id=96951]

Union

Project [IPP#281900 AS COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, Code établissement#281901 AS COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]

Filter (str_remove_accent(upper(Libellé examen Biologie#281905)) <=> GLYCEMIE)

WholeStageCodegen (1)

FileScan csv [IPP#281900,Code établissement#281901,Libellé examen Biologie#281905] Batched: false, DataFilters: [(str_remove_accent(upper(Libellé examen Biologie#281905)) <=> GLYCEMIE)], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/BIOLOGIE_SAINT__19889/BIOLOGIE_Etab_STA..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<IPP:string,Code établissement:string,Libellé examen Biologie:string>

Project [IPP#282048 AS COL_04AF725C_66A0_4299_A535_7D820A79F925#290261, Code établissement#282049 AS COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#290262]

Filter (str_remove_accent(upper(Libellé examen Biologie#282053)) <=> GLYCEMIE)

Scan JDBCRelation((SELECT "IPP", "Code établissement", "Lib établissement", "Date prélévement", "Code examen Biologie", "Libellé examen Biologie", "Résultat (numérique)", "Unite", "Code médecin", "Nom médecin", "Prénom médecin", "Nom document biologie", "Nom complet document biologie", "Venue", "Borne basse", "Borne haute" FROM "public"."biologie_etb_lin") as x) [numPartitions=1] [IPP#282048,Code établissement#282049,Libellé examen Biologie#282053] PushedFilters: [], ReadSchema: struct<IPP:string,Code établissement:string,Libellé examen Biologie:string>

WholeStageCodegen (2)

Sort [PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887 ASC NULLS FIRST, PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884 ASC NULLS FIRST], false, 0

WholeStageCodegen (9)

AQEShuffleRead coalesced

Exchange hashpartitioning(PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887, PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884, 10), ENSURE_REQUIREMENTS, [plan_id=97235]

HashAggregate(keys=[CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990], functions=[])

WholeStageCodegen (7)

AQEShuffleRead coalesced

Exchange hashpartitioning(CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990, 10), ENSURE_REQUIREMENTS, [plan_id=96978]

WholeStageCodegen (5)

Union

Project [COLL10#282655 AS CODE_ETABLISSEM_19957#282683, str_to_date(str_if_with_rule(CASE WHEN isnull(Contains(COLL10#282655, LIN)) THEN false ELSE Contains(COLL10#282655, LIN) END, str_concat(array(str_extract(COLL7#282652, RIGHT, 4), -, str_extract_middle(COLL7#282652, 4, 2), -, str_extract(COLL7#282652, LEFT, 2))), COLL7#282652), yyyy-MM-dd) AS DATE_DE_NAISSAN_19954#282696, cast(COLL9#282654 as string) AS INSC_PATIENT_19956#282685, COLL0#282645 AS IPP_IDENTIFIANT_19947#282686, COLL11#282656 AS LIBELLE_ETABLIS_19958#282687, COLL4#282649 AS NATIONALITE_PAT_19951#282688, COLL1#282646 AS NOM_DE_FAMILLE__19948#282689, COLL3#282648 AS NOM_DE_NAISSANC_19950#282690, COLL8#282653 AS NUMERO_DE_FINES_19955#282691, COLL2#282647 AS PRENOM_PATIENT_19949#282692, COLL5#282650 AS SEXE_PATIENT_19952#282693, COLL6#282651 AS TITRE_PATIENT_19953#282694, COLL12#282669 AS TRACE_ORIGINE_19959#282695, str_remove_extend(str_extract_by_str(str_transform_case(COLL12#282669, UPPER), PATIENT_ETAB_, RIGHT), [.CSV"}]) AS ORIGINE_19960#282984, str_extract(COLL1#282646, LEFT, 3) AS TEST_300328#282985, str_extract(COLL1#282646, LEFT, 2) AS TEST_315786#282986, str_extract(COLL2#282647, LEFT, 4) AS EXTRAC_CAR_329947#282987, str_encrypt(COLL0#282645) AS IPP_HAC_399222#282988, str_extract(COLL1#282646, LEFT, 2) AS TET_406009#282989, str_extract(COLL0#282645, LEFT, 3) AS TEST_424515#282990]

Filter (isnotnull(COLL0#282645) AND isnotnull(COLL10#282655))

Project [IPP - Identifiant Patient#282596 AS COLL0#282645, Nom de famille patient#282597 AS COLL1#282646, Prénom patient#282598 AS COLL2#282647, Nom de naissance patient#282599 AS COLL3#282648, Nationalité patient#282600 AS COLL4#282649, Sexe Patient#282601 AS COLL5#282650, Titre patient#282602 AS COLL6#282651, Date de naissance patient#282603 AS COLL7#282652, Numéro de FINESS#282604 AS COLL8#282653, INSC Patient#282605 AS COLL9#282654, Code établissement#282606 AS COLL10#282655, Libellé établissement#282607 AS COLL11#282656, CREATE_DEPOT_METADATA({"reader_type":"CSV","current_version_mask":"*.*","sep":",","quote":"","header":true,"charset":"DEFAULT"}, {"type":"connector.mapping.sftp","user_configured_path":"","local":false,"host":"test.adobiscloud.ovh","port":22,"username":"stj","type":"connector.mapping.sftp"}, input_file_name()) AS COLL12#282669]

WholeStageCodegen (3)

FileScan csv [IPP - Identifiant Patient#282596,Nom de famille patient#282597,Prénom patient#282598,Nom de naissance patient#282599,Nationalité patient#282600,Sexe Patient#282601,Titre patient#282602,Date de naissance patient#282603,Numéro de FINESS#282604,INSC Patient#282605,Code établissement#282606,Libellé établissement#282607] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/PATIENT_TOUT_ET_19945/PATIENT_Etab_LIN...., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<IPP - Identifiant Patient:string,Nom de famille patient:string,Prénom patient:string,Nom d...

Project [COLL10#282917 AS CODE_ETABLISSEM_19957#282945, str_to_datez(COLL7#282914, yyyy-MM-dd, null, null) AS DATE_DE_NAISSAN_19954#282946, COLL9#282916 AS INSC_PATIENT_19956#282947, COLL0#282907 AS IPP_IDENTIFIANT_19947#282948, COLL11#282918 AS LIBELLE_ETABLIS_19958#282949, COLL4#282911 AS NATIONALITE_PAT_19951#282950, COLL1#282908 AS NOM_DE_FAMILLE__19948#282951, COLL3#282910 AS NOM_DE_NAISSANC_19950#282952, COLL8#282915 AS NUMERO_DE_FINES_19955#282953, COLL2#282909 AS PRENOM_PATIENT_19949#282954, cast(COLL5#282912 as int) AS SEXE_PATIENT_19952#282955, COLL6#282913 AS TITRE_PATIENT_19953#282956, COLL12#282931 AS TRACE_ORIGINE_19959#282957, str_remove_extend(str_extract_by_str(str_transform_case(COLL12#282931, UPPER), PATIENT_ETAB_, RIGHT), [.CSV"}]) AS ORIGINE_19960#290205, str_extract(COLL1#282908, LEFT, 3) AS TEST_300328#290206, str_extract(COLL1#282908, LEFT, 2) AS TEST_315786#290207, str_extract(COLL2#282909, LEFT, 4) AS EXTRAC_CAR_329947#290208, str_encrypt(COLL0#282907) AS IPP_HAC_399222#290209, str_extract(COLL1#282908, LEFT, 2) AS TET_406009#290210, str_extract(COLL0#282907, LEFT, 3) AS TEST_424515#290211]

Filter (isnotnull(COLL0#282907) AND isnotnull(COLL10#282917))

Project [N° patient#282858 AS COLL0#282907, Nom de Famille#282859 AS COLL1#282908, PRENOM#282860 AS COLL2#282909, Nom de naissance#282861 AS COLL3#282910, Natio#282862 AS COLL4#282911, Sexe#282863 AS COLL5#282912, Civilité#282864 AS COLL6#282913, Né(e)#282865 AS COLL7#282914, Finess#282866 AS COLL8#282915, INSC#282867 AS COLL9#282916, Code Etablissement#282868 AS COLL10#282917, Nom Etablissement#282869 AS COLL11#282918, CREATE_DEPOT_METADATA({"reader_type":"CSV","current_version_mask":"*.*","sep":";","quote":"","header":true,"charset":"DEFAULT"}, {"type":"connector.mapping.sftp","user_configured_path":"","local":false,"host":"test.adobiscloud.ovh","port":22,"username":"stj","type":"connector.mapping.sftp"}, input_file_name()) AS COLL12#282931]

WholeStageCodegen (4)

FileScan csv [N° patient#282858,Nom de Famille#282859,PRENOM#282860,Nom de naissance#282861,Natio#282862,Sexe#282863,Civilité#282864,Né(e)#282865,Finess#282866,INSC#282867,Code Etablissement#282868,Nom Etablissement#282869] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(2 paths)[file:/data/input/depot/csv/tmp/PATIENT_STI_19961/PATIENT_ETAB_STI.csv,..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<N° patient:string,Nom de Famille:string,PRENOM:string,Nom de naissance:string,Natio:string...

Sort [PATIENT_ADRESSE_19963_IPP_19964#284163 ASC NULLS FIRST, PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160 ASC NULLS FIRST], false, 0

WholeStageCodegen (11)

AQEShuffleRead coalesced

Exchange hashpartitioning(PATIENT_ADRESSE_19963_IPP_19964#284163, PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, 10), ENSURE_REQUIREMENTS, [plan_id=97017]

Project [CODE_ETABLISSEM_19965#283324 AS PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, IPP_19964#283327 AS PATIENT_ADRESSE_19963_IPP_19964#284163]

Filter (isnotnull(CODE_ETABLISSEM_19965#283324) AND isnotnull(IPP_19964#283327))

ColumnarToRow

WholeStageCodegen (6)

FileScan parquet [CODE_ETABLISSEM_19965#283324,IPP_19964#283327] Batched: true, DataFilters: [isnotnull(CODE_ETABLISSEM_19965#283324), isnotnull(IPP_19964#283327)], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/output/cache/parquet/uet/PATIENT_ADRESSE_19963], PartitionFilters: [], PushedFilters: [IsNotNull(CODE_ETABLISSEM_19965), IsNotNull(IPP_19964)], ReadSchema: struct<CODE_ETABLISSEM_19965:string,IPP_19964:string>

Details

== Physical Plan ==
AdaptiveSparkPlan (74)
+- == Final Plan ==
   * HashAggregate (45)
   +- ShuffleQueryStage (44), Statistics(sizeInBytes=32.0 B, rowCount=2)
      +- Exchange (43)
         +- * HashAggregate (42)
            +- * Project (41)
               +- * SortMergeJoin LeftOuter (40)
                  :- * Project (31)
                  :  +- * SortMergeJoin LeftOuter (30)
                  :     :- * Sort (11)
                  :     :  +- AQEShuffleRead (10)
                  :     :     +- ShuffleQueryStage (9), Statistics(sizeInBytes=24.7 MiB, rowCount=5.03E+5)
                  :     :        +- Exchange (8)
                  :     :           +- Union (7)
                  :     :              :- * Project (3)
                  :     :              :  +- * Filter (2)
                  :     :              :     +- Scan csv  (1)
                  :     :              +- * Project (6)
                  :     :                 +- * Filter (5)
                  :     :                    +- * Scan JDBCRelation((SELECT "IPP", "Code établissement", "Lib établissement", "Date prélévement", "Code examen Biologie", "Libellé  examen Biologie", "Résultat (numérique)", "Unite", "Code médecin", "Nom médecin", "Prénom médecin", "Nom document biologie", "Nom complet document biologie", "Venue", "Borne basse", "Borne haute" FROM "public"."biologie_etb_lin") as x) [numPartitions=1]  (4)
                  :     +- * Sort (29)
                  :        +- AQEShuffleRead (28)
                  :           +- ShuffleQueryStage (27), Statistics(sizeInBytes=4.6 MiB, rowCount=9.50E+4)
                  :              +- Exchange (26)
                  :                 +- * HashAggregate (25)
                  :                    +- AQEShuffleRead (24)
                  :                       +- ShuffleQueryStage (23), Statistics(sizeInBytes=66.9 MiB, rowCount=9.50E+4)
                  :                          +- Exchange (22)
                  :                             +- * HashAggregate (21)
                  :                                +- Union (20)
                  :                                   :- * Project (15)
                  :                                   :  +- * Filter (14)
                  :                                   :     +- * Project (13)
                  :                                   :        +- Scan csv  (12)
                  :                                   +- * Project (19)
                  :                                      +- * Filter (18)
                  :                                         +- * Project (17)
                  :                                            +- Scan csv  (16)
                  +- * Sort (39)
                     +- AQEShuffleRead (38)
                        +- ShuffleQueryStage (37), Statistics(sizeInBytes=4.6 MiB, rowCount=9.50E+4)
                           +- Exchange (36)
                              +- * Project (35)
                                 +- * Filter (34)
                                    +- * ColumnarToRow (33)
                                       +- Scan parquet  (32)
+- == Initial Plan ==
   HashAggregate (73)
   +- Exchange (72)
      +- HashAggregate (71)
         +- Project (70)
            +- SortMergeJoin LeftOuter (69)
               :- Project (64)
               :  +- SortMergeJoin LeftOuter (63)
               :     :- Sort (50)
               :     :  +- Exchange (49)
               :     :     +- Union (48)
               :     :        :- Project (47)
               :     :        :  +- Filter (46)
               :     :        :     +- Scan csv  (1)
               :     :        +- Project (6)
               :     :           +- Filter (5)
               :     :              +- Scan JDBCRelation((SELECT "IPP", "Code établissement", "Lib établissement", "Date prélévement", "Code examen Biologie", "Libellé  examen Biologie", "Résultat (numérique)", "Unite", "Code médecin", "Nom médecin", "Prénom médecin", "Nom document biologie", "Nom complet document biologie", "Venue", "Borne basse", "Borne haute" FROM "public"."biologie_etb_lin") as x) [numPartitions=1]  (4)
               :     +- Sort (62)
               :        +- Exchange (61)
               :           +- HashAggregate (60)
               :              +- Exchange (59)
               :                 +- HashAggregate (58)
               :                    +- Union (57)
               :                       :- Project (53)
               :                       :  +- Filter (52)
               :                       :     +- Project (51)
               :                       :        +- Scan csv  (12)
               :                       +- Project (56)
               :                          +- Filter (55)
               :                             +- Project (54)
               :                                +- Scan csv  (16)
               +- Sort (68)
                  +- Exchange (67)
                     +- Project (66)
                        +- Filter (65)
                           +- Scan parquet  (32)


(1) Scan csv 
Output [3]: [IPP#281900, Code établissement#281901, Libellé  examen Biologie#281905]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/BIOLOGIE_SAINT__19889/BIOLOGIE_Etab_STA.csv]
ReadSchema: struct<IPP:string,Code établissement:string,Libellé  examen Biologie:string>

(2) Filter [codegen id : 1]
Input [3]: [IPP#281900, Code établissement#281901, Libellé  examen Biologie#281905]
Condition : (str_remove_accent(upper(Libellé  examen Biologie#281905)) <=> GLYCEMIE)

(3) Project [codegen id : 1]
Output [2]: [IPP#281900 AS COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, Code établissement#281901 AS COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Input [3]: [IPP#281900, Code établissement#281901, Libellé  examen Biologie#281905]

(4) Scan JDBCRelation((SELECT "IPP", "Code établissement", "Lib établissement", "Date prélévement", "Code examen Biologie", "Libellé  examen Biologie", "Résultat (numérique)", "Unite", "Code médecin", "Nom médecin", "Prénom médecin", "Nom document biologie", "Nom complet document biologie", "Venue", "Borne basse", "Borne haute" FROM "public"."biologie_etb_lin") as x) [numPartitions=1]  [codegen id : 2]
Output [3]: [IPP#282048, Code établissement#282049, Libellé  examen Biologie#282053]
ReadSchema: struct<IPP:string,Code établissement:string,Libellé  examen Biologie:string>

(5) Filter [codegen id : 2]
Input [3]: [IPP#282048, Code établissement#282049, Libellé  examen Biologie#282053]
Condition : (str_remove_accent(upper(Libellé  examen Biologie#282053)) <=> GLYCEMIE)

(6) Project [codegen id : 2]
Output [2]: [IPP#282048 AS COL_04AF725C_66A0_4299_A535_7D820A79F925#290261, Code établissement#282049 AS COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#290262]
Input [3]: [IPP#282048, Code établissement#282049, Libellé  examen Biologie#282053]

(7) Union

(8) Exchange
Input [2]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Arguments: hashpartitioning(COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563, 10), ENSURE_REQUIREMENTS, [plan_id=96951]

(9) ShuffleQueryStage
Output [2]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Arguments: 0

(10) AQEShuffleRead
Input [2]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Arguments: coalesced

(11) Sort [codegen id : 8]
Input [2]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Arguments: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562 ASC NULLS FIRST, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563 ASC NULLS FIRST], false, 0

(12) Scan csv 
Output [12]: [IPP - Identifiant Patient#282596, Nom de famille patient#282597, Prénom patient#282598, Nom de naissance patient#282599, Nationalité patient#282600, Sexe Patient#282601, Titre patient#282602, Date de naissance patient#282603, Numéro de FINESS#282604, INSC Patient#282605, Code établissement#282606, Libellé établissement#282607]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/PATIENT_TOUT_ET_19945/PATIENT_Etab_LIN.csv]
ReadSchema: struct<IPP - Identifiant Patient:string,Nom de famille patient:string,Prénom patient:string,Nom de naissance patient:string,Nationalité patient:string,Sexe Patient:int,Titre patient:string,Date de naissance patient:string,Numéro de FINESS:string,INSC Patient:decimal(22,0),Code établissement:string,Libellé établissement:string>

(13) Project [codegen id : 3]
Output [13]: [IPP - Identifiant Patient#282596 AS COLL0#282645, Nom de famille patient#282597 AS COLL1#282646, Prénom patient#282598 AS COLL2#282647, Nom de naissance patient#282599 AS COLL3#282648, Nationalité patient#282600 AS COLL4#282649, Sexe Patient#282601 AS COLL5#282650, Titre patient#282602 AS COLL6#282651, Date de naissance patient#282603 AS COLL7#282652, Numéro de FINESS#282604 AS COLL8#282653, INSC Patient#282605 AS COLL9#282654, Code établissement#282606 AS COLL10#282655, Libellé établissement#282607 AS COLL11#282656, CREATE_DEPOT_METADATA({"reader_type":"CSV","current_version_mask":"*.*","sep":",","quote":"","header":true,"charset":"DEFAULT"}, {"type":"connector.mapping.sftp","user_configured_path":"","local":false,"host":"test.adobiscloud.ovh","port":22,"username":"stj","type":"connector.mapping.sftp"}, input_file_name()) AS COLL12#282669]
Input [12]: [IPP - Identifiant Patient#282596, Nom de famille patient#282597, Prénom patient#282598, Nom de naissance patient#282599, Nationalité patient#282600, Sexe Patient#282601, Titre patient#282602, Date de naissance patient#282603, Numéro de FINESS#282604, INSC Patient#282605, Code établissement#282606, Libellé établissement#282607]

(14) Filter [codegen id : 3]
Input [13]: [COLL0#282645, COLL1#282646, COLL2#282647, COLL3#282648, COLL4#282649, COLL5#282650, COLL6#282651, COLL7#282652, COLL8#282653, COLL9#282654, COLL10#282655, COLL11#282656, COLL12#282669]
Condition : (isnotnull(COLL0#282645) AND isnotnull(COLL10#282655))

(15) Project [codegen id : 3]
Output [20]: [COLL10#282655 AS CODE_ETABLISSEM_19957#282683, str_to_date(str_if_with_rule(CASE WHEN isnull(Contains(COLL10#282655, LIN)) THEN false ELSE Contains(COLL10#282655, LIN) END, str_concat(array(str_extract(COLL7#282652, RIGHT, 4), -, str_extract_middle(COLL7#282652, 4, 2), -, str_extract(COLL7#282652, LEFT, 2))), COLL7#282652), yyyy-MM-dd) AS DATE_DE_NAISSAN_19954#282696, cast(COLL9#282654 as string) AS INSC_PATIENT_19956#282685, COLL0#282645 AS IPP_IDENTIFIANT_19947#282686, COLL11#282656 AS LIBELLE_ETABLIS_19958#282687, COLL4#282649 AS NATIONALITE_PAT_19951#282688, COLL1#282646 AS NOM_DE_FAMILLE__19948#282689, COLL3#282648 AS NOM_DE_NAISSANC_19950#282690, COLL8#282653 AS NUMERO_DE_FINES_19955#282691, COLL2#282647 AS PRENOM_PATIENT_19949#282692, COLL5#282650 AS SEXE_PATIENT_19952#282693, COLL6#282651 AS TITRE_PATIENT_19953#282694, COLL12#282669 AS TRACE_ORIGINE_19959#282695, str_remove_extend(str_extract_by_str(str_transform_case(COLL12#282669, UPPER), PATIENT_ETAB_, RIGHT), [.CSV"}]) AS ORIGINE_19960#282984, str_extract(COLL1#282646, LEFT, 3) AS TEST_300328#282985, str_extract(COLL1#282646, LEFT, 2) AS TEST_315786#282986, str_extract(COLL2#282647, LEFT, 4) AS EXTRAC_CAR_329947#282987, str_encrypt(COLL0#282645) AS IPP_HAC_399222#282988, str_extract(COLL1#282646, LEFT, 2) AS TET_406009#282989, str_extract(COLL0#282645, LEFT, 3) AS TEST_424515#282990]
Input [13]: [COLL0#282645, COLL1#282646, COLL2#282647, COLL3#282648, COLL4#282649, COLL5#282650, COLL6#282651, COLL7#282652, COLL8#282653, COLL9#282654, COLL10#282655, COLL11#282656, COLL12#282669]

(16) Scan csv 
Output [12]: [N° patient#282858, Nom de Famille#282859, PRENOM#282860, Nom de naissance#282861, Natio#282862, Sexe#282863, Civilité#282864, Né(e)#282865, Finess#282866, INSC#282867, Code Etablissement#282868, Nom Etablissement#282869]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/PATIENT_STI_19961/PATIENT_ETAB_STI.csv, ... 1 entries]
ReadSchema: struct<N° patient:string,Nom de Famille:string,PRENOM:string,Nom de naissance:string,Natio:string,Sexe:string,Civilité:string,Né(e):string,Finess:string,INSC:string,Code Etablissement:string,Nom Etablissement:string>

(17) Project [codegen id : 4]
Output [13]: [N° patient#282858 AS COLL0#282907, Nom de Famille#282859 AS COLL1#282908, PRENOM#282860 AS COLL2#282909, Nom de naissance#282861 AS COLL3#282910, Natio#282862 AS COLL4#282911, Sexe#282863 AS COLL5#282912, Civilité#282864 AS COLL6#282913, Né(e)#282865 AS COLL7#282914, Finess#282866 AS COLL8#282915, INSC#282867 AS COLL9#282916, Code Etablissement#282868 AS COLL10#282917, Nom Etablissement#282869 AS COLL11#282918, CREATE_DEPOT_METADATA({"reader_type":"CSV","current_version_mask":"*.*","sep":";","quote":"","header":true,"charset":"DEFAULT"}, {"type":"connector.mapping.sftp","user_configured_path":"","local":false,"host":"test.adobiscloud.ovh","port":22,"username":"stj","type":"connector.mapping.sftp"}, input_file_name()) AS COLL12#282931]
Input [12]: [N° patient#282858, Nom de Famille#282859, PRENOM#282860, Nom de naissance#282861, Natio#282862, Sexe#282863, Civilité#282864, Né(e)#282865, Finess#282866, INSC#282867, Code Etablissement#282868, Nom Etablissement#282869]

(18) Filter [codegen id : 4]
Input [13]: [COLL0#282907, COLL1#282908, COLL2#282909, COLL3#282910, COLL4#282911, COLL5#282912, COLL6#282913, COLL7#282914, COLL8#282915, COLL9#282916, COLL10#282917, COLL11#282918, COLL12#282931]
Condition : (isnotnull(COLL0#282907) AND isnotnull(COLL10#282917))

(19) Project [codegen id : 4]
Output [20]: [COLL10#282917 AS CODE_ETABLISSEM_19957#282945, str_to_datez(COLL7#282914, yyyy-MM-dd, null, null) AS DATE_DE_NAISSAN_19954#282946, COLL9#282916 AS INSC_PATIENT_19956#282947, COLL0#282907 AS IPP_IDENTIFIANT_19947#282948, COLL11#282918 AS LIBELLE_ETABLIS_19958#282949, COLL4#282911 AS NATIONALITE_PAT_19951#282950, COLL1#282908 AS NOM_DE_FAMILLE__19948#282951, COLL3#282910 AS NOM_DE_NAISSANC_19950#282952, COLL8#282915 AS NUMERO_DE_FINES_19955#282953, COLL2#282909 AS PRENOM_PATIENT_19949#282954, cast(COLL5#282912 as int) AS SEXE_PATIENT_19952#282955, COLL6#282913 AS TITRE_PATIENT_19953#282956, COLL12#282931 AS TRACE_ORIGINE_19959#282957, str_remove_extend(str_extract_by_str(str_transform_case(COLL12#282931, UPPER), PATIENT_ETAB_, RIGHT), [.CSV"}]) AS ORIGINE_19960#290205, str_extract(COLL1#282908, LEFT, 3) AS TEST_300328#290206, str_extract(COLL1#282908, LEFT, 2) AS TEST_315786#290207, str_extract(COLL2#282909, LEFT, 4) AS EXTRAC_CAR_329947#290208, str_encrypt(COLL0#282907) AS IPP_HAC_399222#290209, str_extract(COLL1#282908, LEFT, 2) AS TET_406009#290210, str_extract(COLL0#282907, LEFT, 3) AS TEST_424515#290211]
Input [13]: [COLL0#282907, COLL1#282908, COLL2#282909, COLL3#282910, COLL4#282911, COLL5#282912, COLL6#282913, COLL7#282914, COLL8#282915, COLL9#282916, COLL10#282917, COLL11#282918, COLL12#282931]

(20) Union

(21) HashAggregate [codegen id : 5]
Input [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]
Keys [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]
Functions: []
Aggregate Attributes: []
Results [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]

(22) Exchange
Input [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]
Arguments: hashpartitioning(CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990, 10), ENSURE_REQUIREMENTS, [plan_id=96978]

(23) ShuffleQueryStage
Output [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]
Arguments: 1

(24) AQEShuffleRead
Input [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]
Arguments: coalesced

(25) HashAggregate [codegen id : 7]
Input [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]
Keys [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]
Functions: []
Aggregate Attributes: []
Results [2]: [CODE_ETABLISSEM_19957#282683 AS PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884, IPP_IDENTIFIANT_19947#282686 AS PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887]

(26) Exchange
Input [2]: [PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884, PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887]
Arguments: hashpartitioning(PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887, PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884, 10), ENSURE_REQUIREMENTS, [plan_id=97235]

(27) ShuffleQueryStage
Output [2]: [PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884, PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887]
Arguments: 3

(28) AQEShuffleRead
Input [2]: [PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884, PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887]
Arguments: coalesced

(29) Sort [codegen id : 9]
Input [2]: [PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884, PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887]
Arguments: [PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887 ASC NULLS FIRST, PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884 ASC NULLS FIRST], false, 0

(30) SortMergeJoin [codegen id : 10]
Left keys [2]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Right keys [2]: [PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887, PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884]
Join type: LeftOuter
Join condition: None

(31) Project [codegen id : 10]
Output [2]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Input [4]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563, PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884, PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887]

(32) Scan parquet 
Output [2]: [CODE_ETABLISSEM_19965#283324, IPP_19964#283327]
Batched: true
Location: InMemoryFileIndex [file:/data/output/cache/parquet/uet/PATIENT_ADRESSE_19963]
PushedFilters: [IsNotNull(CODE_ETABLISSEM_19965), IsNotNull(IPP_19964)]
ReadSchema: struct<CODE_ETABLISSEM_19965:string,IPP_19964:string>

(33) ColumnarToRow [codegen id : 6]
Input [2]: [CODE_ETABLISSEM_19965#283324, IPP_19964#283327]

(34) Filter [codegen id : 6]
Input [2]: [CODE_ETABLISSEM_19965#283324, IPP_19964#283327]
Condition : (isnotnull(CODE_ETABLISSEM_19965#283324) AND isnotnull(IPP_19964#283327))

(35) Project [codegen id : 6]
Output [2]: [CODE_ETABLISSEM_19965#283324 AS PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, IPP_19964#283327 AS PATIENT_ADRESSE_19963_IPP_19964#284163]
Input [2]: [CODE_ETABLISSEM_19965#283324, IPP_19964#283327]

(36) Exchange
Input [2]: [PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, PATIENT_ADRESSE_19963_IPP_19964#284163]
Arguments: hashpartitioning(PATIENT_ADRESSE_19963_IPP_19964#284163, PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, 10), ENSURE_REQUIREMENTS, [plan_id=97017]

(37) ShuffleQueryStage
Output [2]: [PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, PATIENT_ADRESSE_19963_IPP_19964#284163]
Arguments: 2

(38) AQEShuffleRead
Input [2]: [PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, PATIENT_ADRESSE_19963_IPP_19964#284163]
Arguments: coalesced

(39) Sort [codegen id : 11]
Input [2]: [PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, PATIENT_ADRESSE_19963_IPP_19964#284163]
Arguments: [PATIENT_ADRESSE_19963_IPP_19964#284163 ASC NULLS FIRST, PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160 ASC NULLS FIRST], false, 0

(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Right keys [2]: [PATIENT_ADRESSE_19963_IPP_19964#284163, PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160]
Join type: LeftOuter
Join condition: None

(41) Project [codegen id : 12]
Output: []
Input [4]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563, PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, PATIENT_ADRESSE_19963_IPP_19964#284163]

(42) HashAggregate [codegen id : 12]
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#290280L]
Results [1]: [count#290281L]

(43) Exchange
Input [1]: [count#290281L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=97560]

(44) ShuffleQueryStage
Output [1]: [count#290281L]
Arguments: 4

(45) HashAggregate [codegen id : 13]
Input [1]: [count#290281L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#290199L]
Results [1]: [count(1)#290199L AS count#290200L]

(46) Filter
Input [3]: [IPP#281900, Code établissement#281901, Libellé  examen Biologie#281905]
Condition : (str_remove_accent(upper(Libellé  examen Biologie#281905)) <=> GLYCEMIE)

(47) Project
Output [2]: [IPP#281900 AS COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, Code établissement#281901 AS COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Input [3]: [IPP#281900, Code établissement#281901, Libellé  examen Biologie#281905]

(48) Union

(49) Exchange
Input [2]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Arguments: hashpartitioning(COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563, 10), ENSURE_REQUIREMENTS, [plan_id=96870]

(50) Sort
Input [2]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Arguments: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562 ASC NULLS FIRST, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563 ASC NULLS FIRST], false, 0

(51) Project
Output [13]: [IPP - Identifiant Patient#282596 AS COLL0#282645, Nom de famille patient#282597 AS COLL1#282646, Prénom patient#282598 AS COLL2#282647, Nom de naissance patient#282599 AS COLL3#282648, Nationalité patient#282600 AS COLL4#282649, Sexe Patient#282601 AS COLL5#282650, Titre patient#282602 AS COLL6#282651, Date de naissance patient#282603 AS COLL7#282652, Numéro de FINESS#282604 AS COLL8#282653, INSC Patient#282605 AS COLL9#282654, Code établissement#282606 AS COLL10#282655, Libellé établissement#282607 AS COLL11#282656, CREATE_DEPOT_METADATA({"reader_type":"CSV","current_version_mask":"*.*","sep":",","quote":"","header":true,"charset":"DEFAULT"}, {"type":"connector.mapping.sftp","user_configured_path":"","local":false,"host":"test.adobiscloud.ovh","port":22,"username":"stj","type":"connector.mapping.sftp"}, input_file_name()) AS COLL12#282669]
Input [12]: [IPP - Identifiant Patient#282596, Nom de famille patient#282597, Prénom patient#282598, Nom de naissance patient#282599, Nationalité patient#282600, Sexe Patient#282601, Titre patient#282602, Date de naissance patient#282603, Numéro de FINESS#282604, INSC Patient#282605, Code établissement#282606, Libellé établissement#282607]

(52) Filter
Input [13]: [COLL0#282645, COLL1#282646, COLL2#282647, COLL3#282648, COLL4#282649, COLL5#282650, COLL6#282651, COLL7#282652, COLL8#282653, COLL9#282654, COLL10#282655, COLL11#282656, COLL12#282669]
Condition : (isnotnull(COLL0#282645) AND isnotnull(COLL10#282655))

(53) Project
Output [20]: [COLL10#282655 AS CODE_ETABLISSEM_19957#282683, str_to_date(str_if_with_rule(CASE WHEN isnull(Contains(COLL10#282655, LIN)) THEN false ELSE Contains(COLL10#282655, LIN) END, str_concat(array(str_extract(COLL7#282652, RIGHT, 4), -, str_extract_middle(COLL7#282652, 4, 2), -, str_extract(COLL7#282652, LEFT, 2))), COLL7#282652), yyyy-MM-dd) AS DATE_DE_NAISSAN_19954#282696, cast(COLL9#282654 as string) AS INSC_PATIENT_19956#282685, COLL0#282645 AS IPP_IDENTIFIANT_19947#282686, COLL11#282656 AS LIBELLE_ETABLIS_19958#282687, COLL4#282649 AS NATIONALITE_PAT_19951#282688, COLL1#282646 AS NOM_DE_FAMILLE__19948#282689, COLL3#282648 AS NOM_DE_NAISSANC_19950#282690, COLL8#282653 AS NUMERO_DE_FINES_19955#282691, COLL2#282647 AS PRENOM_PATIENT_19949#282692, COLL5#282650 AS SEXE_PATIENT_19952#282693, COLL6#282651 AS TITRE_PATIENT_19953#282694, COLL12#282669 AS TRACE_ORIGINE_19959#282695, str_remove_extend(str_extract_by_str(str_transform_case(COLL12#282669, UPPER), PATIENT_ETAB_, RIGHT), [.CSV"}]) AS ORIGINE_19960#282984, str_extract(COLL1#282646, LEFT, 3) AS TEST_300328#282985, str_extract(COLL1#282646, LEFT, 2) AS TEST_315786#282986, str_extract(COLL2#282647, LEFT, 4) AS EXTRAC_CAR_329947#282987, str_encrypt(COLL0#282645) AS IPP_HAC_399222#282988, str_extract(COLL1#282646, LEFT, 2) AS TET_406009#282989, str_extract(COLL0#282645, LEFT, 3) AS TEST_424515#282990]
Input [13]: [COLL0#282645, COLL1#282646, COLL2#282647, COLL3#282648, COLL4#282649, COLL5#282650, COLL6#282651, COLL7#282652, COLL8#282653, COLL9#282654, COLL10#282655, COLL11#282656, COLL12#282669]

(54) Project
Output [13]: [N° patient#282858 AS COLL0#282907, Nom de Famille#282859 AS COLL1#282908, PRENOM#282860 AS COLL2#282909, Nom de naissance#282861 AS COLL3#282910, Natio#282862 AS COLL4#282911, Sexe#282863 AS COLL5#282912, Civilité#282864 AS COLL6#282913, Né(e)#282865 AS COLL7#282914, Finess#282866 AS COLL8#282915, INSC#282867 AS COLL9#282916, Code Etablissement#282868 AS COLL10#282917, Nom Etablissement#282869 AS COLL11#282918, CREATE_DEPOT_METADATA({"reader_type":"CSV","current_version_mask":"*.*","sep":";","quote":"","header":true,"charset":"DEFAULT"}, {"type":"connector.mapping.sftp","user_configured_path":"","local":false,"host":"test.adobiscloud.ovh","port":22,"username":"stj","type":"connector.mapping.sftp"}, input_file_name()) AS COLL12#282931]
Input [12]: [N° patient#282858, Nom de Famille#282859, PRENOM#282860, Nom de naissance#282861, Natio#282862, Sexe#282863, Civilité#282864, Né(e)#282865, Finess#282866, INSC#282867, Code Etablissement#282868, Nom Etablissement#282869]

(55) Filter
Input [13]: [COLL0#282907, COLL1#282908, COLL2#282909, COLL3#282910, COLL4#282911, COLL5#282912, COLL6#282913, COLL7#282914, COLL8#282915, COLL9#282916, COLL10#282917, COLL11#282918, COLL12#282931]
Condition : (isnotnull(COLL0#282907) AND isnotnull(COLL10#282917))

(56) Project
Output [20]: [COLL10#282917 AS CODE_ETABLISSEM_19957#282945, str_to_datez(COLL7#282914, yyyy-MM-dd, null, null) AS DATE_DE_NAISSAN_19954#282946, COLL9#282916 AS INSC_PATIENT_19956#282947, COLL0#282907 AS IPP_IDENTIFIANT_19947#282948, COLL11#282918 AS LIBELLE_ETABLIS_19958#282949, COLL4#282911 AS NATIONALITE_PAT_19951#282950, COLL1#282908 AS NOM_DE_FAMILLE__19948#282951, COLL3#282910 AS NOM_DE_NAISSANC_19950#282952, COLL8#282915 AS NUMERO_DE_FINES_19955#282953, COLL2#282909 AS PRENOM_PATIENT_19949#282954, cast(COLL5#282912 as int) AS SEXE_PATIENT_19952#282955, COLL6#282913 AS TITRE_PATIENT_19953#282956, COLL12#282931 AS TRACE_ORIGINE_19959#282957, str_remove_extend(str_extract_by_str(str_transform_case(COLL12#282931, UPPER), PATIENT_ETAB_, RIGHT), [.CSV"}]) AS ORIGINE_19960#290205, str_extract(COLL1#282908, LEFT, 3) AS TEST_300328#290206, str_extract(COLL1#282908, LEFT, 2) AS TEST_315786#290207, str_extract(COLL2#282909, LEFT, 4) AS EXTRAC_CAR_329947#290208, str_encrypt(COLL0#282907) AS IPP_HAC_399222#290209, str_extract(COLL1#282908, LEFT, 2) AS TET_406009#290210, str_extract(COLL0#282907, LEFT, 3) AS TEST_424515#290211]
Input [13]: [COLL0#282907, COLL1#282908, COLL2#282909, COLL3#282910, COLL4#282911, COLL5#282912, COLL6#282913, COLL7#282914, COLL8#282915, COLL9#282916, COLL10#282917, COLL11#282918, COLL12#282931]

(57) Union

(58) HashAggregate
Input [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]
Keys [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]
Functions: []
Aggregate Attributes: []
Results [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]

(59) Exchange
Input [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]
Arguments: hashpartitioning(CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990, 10), ENSURE_REQUIREMENTS, [plan_id=96864]

(60) HashAggregate
Input [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]
Keys [20]: [CODE_ETABLISSEM_19957#282683, DATE_DE_NAISSAN_19954#282696, INSC_PATIENT_19956#282685, IPP_IDENTIFIANT_19947#282686, LIBELLE_ETABLIS_19958#282687, NATIONALITE_PAT_19951#282688, NOM_DE_FAMILLE__19948#282689, NOM_DE_NAISSANC_19950#282690, NUMERO_DE_FINES_19955#282691, PRENOM_PATIENT_19949#282692, SEXE_PATIENT_19952#282693, TITRE_PATIENT_19953#282694, TRACE_ORIGINE_19959#282695, ORIGINE_19960#282984, TEST_300328#282985, TEST_315786#282986, EXTRAC_CAR_329947#282987, IPP_HAC_399222#282988, TET_406009#282989, TEST_424515#282990]
Functions: []
Aggregate Attributes: []
Results [2]: [CODE_ETABLISSEM_19957#282683 AS PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884, IPP_IDENTIFIANT_19947#282686 AS PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887]

(61) Exchange
Input [2]: [PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884, PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887]
Arguments: hashpartitioning(PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887, PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884, 10), ENSURE_REQUIREMENTS, [plan_id=96871]

(62) Sort
Input [2]: [PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884, PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887]
Arguments: [PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887 ASC NULLS FIRST, PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884 ASC NULLS FIRST], false, 0

(63) SortMergeJoin
Left keys [2]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Right keys [2]: [PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887, PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884]
Join type: LeftOuter
Join condition: None

(64) Project
Output [2]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Input [4]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563, PATIENT_TOUT_ET_19946_CODE_ETABLISSEM_19957#283884, PATIENT_TOUT_ET_19946_IPP_IDENTIFIANT_19947#283887]

(65) Filter
Input [2]: [CODE_ETABLISSEM_19965#283324, IPP_19964#283327]
Condition : (isnotnull(CODE_ETABLISSEM_19965#283324) AND isnotnull(IPP_19964#283327))

(66) Project
Output [2]: [CODE_ETABLISSEM_19965#283324 AS PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, IPP_19964#283327 AS PATIENT_ADRESSE_19963_IPP_19964#284163]
Input [2]: [CODE_ETABLISSEM_19965#283324, IPP_19964#283327]

(67) Exchange
Input [2]: [PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, PATIENT_ADRESSE_19963_IPP_19964#284163]
Arguments: hashpartitioning(PATIENT_ADRESSE_19963_IPP_19964#284163, PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, 10), ENSURE_REQUIREMENTS, [plan_id=96878]

(68) Sort
Input [2]: [PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, PATIENT_ADRESSE_19963_IPP_19964#284163]
Arguments: [PATIENT_ADRESSE_19963_IPP_19964#284163 ASC NULLS FIRST, PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160 ASC NULLS FIRST], false, 0

(69) SortMergeJoin
Left keys [2]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563]
Right keys [2]: [PATIENT_ADRESSE_19963_IPP_19964#284163, PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160]
Join type: LeftOuter
Join condition: None

(70) Project
Output: []
Input [4]: [COL_04AF725C_66A0_4299_A535_7D820A79F925#283562, COL_81492BFD_C38C_4C09_8A5D_1EE53F619CB4#283563, PATIENT_ADRESSE_19963_CODE_ETABLISSEM_19965#284160, PATIENT_ADRESSE_19963_IPP_19964#284163]

(71) HashAggregate
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#290280L]
Results [1]: [count#290281L]

(72) Exchange
Input [1]: [count#290281L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=96884]

(73) HashAggregate
Input [1]: [count#290281L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#290199L]
Results [1]: [count(1)#290199L AS count#290200L]

(74) AdaptiveSparkPlan
Output [1]: [count#290200L]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet