hdh-spark-job - Details for Query 609

Submitted Time: 2026/10/21 21:32:14
Duration: 0.2 s
Succeeded Jobs: 545 546

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: 0 ms"; 2 [labelType="html" label="HashAggregate time in aggregation build: 0 ms number of output rows: 1"]; } 3 [labelType="html" label="Exchange shuffle records written: 1 local merged chunks fetched: 0 shuffle write time: 0 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 1 local bytes read: 59.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 16.0 B local merged bytes read: 0.0 B number of partitions: 1 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 59.0 B"]; subgraph cluster4 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 7 ms"; 5 [labelType="html" label="HashAggregate time in aggregation build: 7 ms number of output rows: 1"]; 6 [labelType="html" label=" Project "]; 7 [labelType="html" label="Filter number of output rows: 78"]; 8 [labelType="html" label="ColumnarToRow number of output rows: 80 number of input batches: 1"]; } 9 [labelType="html" label="Scan parquet number of files read: 1 scan time: 5 ms metadata time: 0 ms size of files read: 16.2 KiB number of output rows: 80"]; 2->0; 3->2; 5->3; 6->5; 7->6; 8->7; 9->8; }

AdaptiveSparkPlan isFinalPlan=true

HashAggregate(keys=[], functions=[count(1)])

WholeStageCodegen (2)

Exchange SinglePartition, ENSURE_REQUIREMENTS, [plan_id=12057]

HashAggregate(keys=[], functions=[partial_count(1)])

Project

Filter (((((((((((((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODSER_438335#126255)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODSER_438335#126255)), MARX) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_LIB30_438336#126270)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_LIB30_438336#126270)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_LIBCO_438337#126271)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_LIBCO_438337#126271)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_SERV_438338#126281)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_SERV_438338#126281)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NATURE_438339#126275)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NATURE_438339#126275)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_VALID_438340#126286)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_VALID_438340#126286)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_UF_DEM_438341#126283)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_UF_DEM_438341#126283)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_UF_EXE_438342#126284)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_UF_EXE_438342#126284)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_UF_LOC_438343#126285)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_UF_LOC_438343#126285)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_TELBUR_438344#126282)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_TELBUR_438344#126282)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_FAX_438345#126268)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_FAX_438345#126268)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_E_MAIL_438346#126267)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_E_MAIL_438346#126267)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_ENVADM_438347#126266)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_ENVADM_438347#126266)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_LIEU_S_438348#126272)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_LIEU_S_438348#126272)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODUTI_438349#126258)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODUTI_438349#126258)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_DATMAJ_438350#126264)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_DATMAJ_438350#126264)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODSIT_438351#126256)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODSIT_438351#126256)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_MODTRT_438352#126273)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_MODTRT_438352#126273)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_DISPRE_438353#126265)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_DISPRE_438353#126265)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODSOC_438354#126257)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODSOC_438354#126257)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NUMCPT_A_438355#126276)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NUMCPT_A_438355#126276)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NUMCPT_F_438356#126278)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NUMCPT_F_438356#126278)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NUMCPT_C_438357#126277)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NUMCPT_C_438357#126277)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CHEFSER_438358#126252)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CHEFSER_438358#126252)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_DATEDE_438359#126262)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_DATEDE_438359#126262)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_DATEFI_438360#126263)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_DATEFI_438360#126263)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_COMMENT_438361#126259)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_COMMENT_438361#126259)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_FLICPT_438362#126269)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_FLICPT_438362#126269)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_XML_P_CPTA_438363#126288)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_XML_P_CPTA_438363#126288)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NUMPRF_438364#126279)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NUMPRF_438364#126279)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CSCPT_438365#126261)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CSCPT_438365#126261)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CSANA_438366#126260)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CSANA_438366#126260)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODADM_438367#126253)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODADM_438367#126253)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_MOD_ENVOI_438368#126274)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_MOD_ENVOI_438368#126274)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_ADR_1_438369#126249)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_ADR_1_438369#126249)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_ADR_2_438370#126250)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_ADR_2_438370#126250)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_ADR_3_438371#126251)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_ADR_3_438371#126251)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODPOS_438372#126254)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODPOS_438372#126254)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_VILLE_438373#126287)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_VILLE_438373#126287)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_PAYS_438374#126280)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_PAYS_438374#126280)), MARX) END)

ColumnarToRow

WholeStageCodegen (1)

FileScan parquet [UN_ADR_1_438369#126249,UN_ADR_2_438370#126250,UN_ADR_3_438371#126251,UN_CHEFSER_438358#126252,UN_CODADM_438367#126253,UN_CODPOS_438372#126254,UN_CODSER_438335#126255,UN_CODSIT_438351#126256,UN_CODSOC_438354#126257,UN_CODUTI_438349#126258,UN_COMMENT_438361#126259,UN_CSANA_438366#126260,UN_CSCPT_438365#126261,UN_DATEDE_438359#126262,UN_DATEFI_438360#126263,UN_DATMAJ_438350#126264,UN_DISPRE_438353#126265,UN_ENVADM_438347#126266,UN_E_MAIL_438346#126267,UN_FAX_438345#126268,UN_FLICPT_438362#126269,UN_LIB30_438336#126270,UN_LIBCO_438337#126271,UN_LIEU_S_438348#126272,... 16 more fields] Batched: true, DataFilters: [(((((((((((((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODS..., Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/output/cache/parquet/uet/H_UNIT_438334], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<UN_ADR_1_438369:string,UN_ADR_2_438370:string,UN_ADR_3_438371:string,UN_CHEFSER_438358:str...

Details

== Physical Plan ==
AdaptiveSparkPlan (14)
+- == Final Plan ==
   * HashAggregate (8)
   +- ShuffleQueryStage (7), Statistics(sizeInBytes=16.0 B, rowCount=1)
      +- Exchange (6)
         +- * HashAggregate (5)
            +- * Project (4)
               +- * Filter (3)
                  +- * ColumnarToRow (2)
                     +- Scan parquet  (1)
+- == Initial Plan ==
   HashAggregate (13)
   +- Exchange (12)
      +- HashAggregate (11)
         +- Project (10)
            +- Filter (9)
               +- Scan parquet  (1)


(1) Scan parquet 
Output [40]: [UN_ADR_1_438369#126249, UN_ADR_2_438370#126250, UN_ADR_3_438371#126251, UN_CHEFSER_438358#126252, UN_CODADM_438367#126253, UN_CODPOS_438372#126254, UN_CODSER_438335#126255, UN_CODSIT_438351#126256, UN_CODSOC_438354#126257, UN_CODUTI_438349#126258, UN_COMMENT_438361#126259, UN_CSANA_438366#126260, UN_CSCPT_438365#126261, UN_DATEDE_438359#126262, UN_DATEFI_438360#126263, UN_DATMAJ_438350#126264, UN_DISPRE_438353#126265, UN_ENVADM_438347#126266, UN_E_MAIL_438346#126267, UN_FAX_438345#126268, UN_FLICPT_438362#126269, UN_LIB30_438336#126270, UN_LIBCO_438337#126271, UN_LIEU_S_438348#126272, UN_MODTRT_438352#126273, UN_MOD_ENVOI_438368#126274, UN_NATURE_438339#126275, UN_NUMCPT_A_438355#126276, UN_NUMCPT_C_438357#126277, UN_NUMCPT_F_438356#126278, UN_NUMPRF_438364#126279, UN_PAYS_438374#126280, UN_SERV_438338#126281, UN_TELBUR_438344#126282, UN_UF_DEM_438341#126283, UN_UF_EXE_438342#126284, UN_UF_LOC_438343#126285, UN_VALID_438340#126286, UN_VILLE_438373#126287, UN_XML_P_CPTA_438363#126288]
Batched: true
Location: InMemoryFileIndex [file:/data/output/cache/parquet/uet/H_UNIT_438334]
ReadSchema: struct<UN_ADR_1_438369:string,UN_ADR_2_438370:string,UN_ADR_3_438371:string,UN_CHEFSER_438358:string,UN_CODADM_438367:string,UN_CODPOS_438372:string,UN_CODSER_438335:string,UN_CODSIT_438351:string,UN_CODSOC_438354:string,UN_CODUTI_438349:string,UN_COMMENT_438361:string,UN_CSANA_438366:string,UN_CSCPT_438365:string,UN_DATEDE_438359:string,UN_DATEFI_438360:string,UN_DATMAJ_438350:string,UN_DISPRE_438353:string,UN_ENVADM_438347:string,UN_E_MAIL_438346:string,UN_FAX_438345:string,UN_FLICPT_438362:string,UN_LIB30_438336:string,UN_LIBCO_438337:string,UN_LIEU_S_438348:string,UN_MODTRT_438352:string,UN_MOD_ENVOI_438368:string,UN_NATURE_438339:string,UN_NUMCPT_A_438355:string,UN_NUMCPT_C_438357:string,UN_NUMCPT_F_438356:string,UN_NUMPRF_438364:string,UN_PAYS_438374:string,UN_SERV_438338:string,UN_TELBUR_438344:string,UN_UF_DEM_438341:string,UN_UF_EXE_438342:string,UN_UF_LOC_438343:string,UN_VALID_438340:string,UN_VILLE_438373:string,UN_XML_P_CPTA_438363:string>

(2) ColumnarToRow [codegen id : 1]
Input [40]: [UN_ADR_1_438369#126249, UN_ADR_2_438370#126250, UN_ADR_3_438371#126251, UN_CHEFSER_438358#126252, UN_CODADM_438367#126253, UN_CODPOS_438372#126254, UN_CODSER_438335#126255, UN_CODSIT_438351#126256, UN_CODSOC_438354#126257, UN_CODUTI_438349#126258, UN_COMMENT_438361#126259, UN_CSANA_438366#126260, UN_CSCPT_438365#126261, UN_DATEDE_438359#126262, UN_DATEFI_438360#126263, UN_DATMAJ_438350#126264, UN_DISPRE_438353#126265, UN_ENVADM_438347#126266, UN_E_MAIL_438346#126267, UN_FAX_438345#126268, UN_FLICPT_438362#126269, UN_LIB30_438336#126270, UN_LIBCO_438337#126271, UN_LIEU_S_438348#126272, UN_MODTRT_438352#126273, UN_MOD_ENVOI_438368#126274, UN_NATURE_438339#126275, UN_NUMCPT_A_438355#126276, UN_NUMCPT_C_438357#126277, UN_NUMCPT_F_438356#126278, UN_NUMPRF_438364#126279, UN_PAYS_438374#126280, UN_SERV_438338#126281, UN_TELBUR_438344#126282, UN_UF_DEM_438341#126283, UN_UF_EXE_438342#126284, UN_UF_LOC_438343#126285, UN_VALID_438340#126286, UN_VILLE_438373#126287, UN_XML_P_CPTA_438363#126288]

(3) Filter [codegen id : 1]
Input [40]: [UN_ADR_1_438369#126249, UN_ADR_2_438370#126250, UN_ADR_3_438371#126251, UN_CHEFSER_438358#126252, UN_CODADM_438367#126253, UN_CODPOS_438372#126254, UN_CODSER_438335#126255, UN_CODSIT_438351#126256, UN_CODSOC_438354#126257, UN_CODUTI_438349#126258, UN_COMMENT_438361#126259, UN_CSANA_438366#126260, UN_CSCPT_438365#126261, UN_DATEDE_438359#126262, UN_DATEFI_438360#126263, UN_DATMAJ_438350#126264, UN_DISPRE_438353#126265, UN_ENVADM_438347#126266, UN_E_MAIL_438346#126267, UN_FAX_438345#126268, UN_FLICPT_438362#126269, UN_LIB30_438336#126270, UN_LIBCO_438337#126271, UN_LIEU_S_438348#126272, UN_MODTRT_438352#126273, UN_MOD_ENVOI_438368#126274, UN_NATURE_438339#126275, UN_NUMCPT_A_438355#126276, UN_NUMCPT_C_438357#126277, UN_NUMCPT_F_438356#126278, UN_NUMPRF_438364#126279, UN_PAYS_438374#126280, UN_SERV_438338#126281, UN_TELBUR_438344#126282, UN_UF_DEM_438341#126283, UN_UF_EXE_438342#126284, UN_UF_LOC_438343#126285, UN_VALID_438340#126286, UN_VILLE_438373#126287, UN_XML_P_CPTA_438363#126288]
Condition : (((((((((((((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODSER_438335#126255)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODSER_438335#126255)), MARX) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_LIB30_438336#126270)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_LIB30_438336#126270)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_LIBCO_438337#126271)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_LIBCO_438337#126271)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_SERV_438338#126281)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_SERV_438338#126281)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NATURE_438339#126275)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NATURE_438339#126275)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_VALID_438340#126286)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_VALID_438340#126286)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_UF_DEM_438341#126283)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_UF_DEM_438341#126283)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_UF_EXE_438342#126284)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_UF_EXE_438342#126284)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_UF_LOC_438343#126285)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_UF_LOC_438343#126285)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_TELBUR_438344#126282)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_TELBUR_438344#126282)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_FAX_438345#126268)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_FAX_438345#126268)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_E_MAIL_438346#126267)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_E_MAIL_438346#126267)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_ENVADM_438347#126266)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_ENVADM_438347#126266)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_LIEU_S_438348#126272)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_LIEU_S_438348#126272)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODUTI_438349#126258)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODUTI_438349#126258)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_DATMAJ_438350#126264)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_DATMAJ_438350#126264)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODSIT_438351#126256)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODSIT_438351#126256)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_MODTRT_438352#126273)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_MODTRT_438352#126273)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_DISPRE_438353#126265)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_DISPRE_438353#126265)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODSOC_438354#126257)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODSOC_438354#126257)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NUMCPT_A_438355#126276)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NUMCPT_A_438355#126276)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NUMCPT_F_438356#126278)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NUMCPT_F_438356#126278)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NUMCPT_C_438357#126277)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NUMCPT_C_438357#126277)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CHEFSER_438358#126252)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CHEFSER_438358#126252)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_DATEDE_438359#126262)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_DATEDE_438359#126262)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_DATEFI_438360#126263)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_DATEFI_438360#126263)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_COMMENT_438361#126259)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_COMMENT_438361#126259)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_FLICPT_438362#126269)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_FLICPT_438362#126269)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_XML_P_CPTA_438363#126288)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_XML_P_CPTA_438363#126288)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NUMPRF_438364#126279)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NUMPRF_438364#126279)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CSCPT_438365#126261)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CSCPT_438365#126261)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CSANA_438366#126260)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CSANA_438366#126260)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODADM_438367#126253)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODADM_438367#126253)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_MOD_ENVOI_438368#126274)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_MOD_ENVOI_438368#126274)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_ADR_1_438369#126249)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_ADR_1_438369#126249)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_ADR_2_438370#126250)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_ADR_2_438370#126250)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_ADR_3_438371#126251)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_ADR_3_438371#126251)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODPOS_438372#126254)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODPOS_438372#126254)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_VILLE_438373#126287)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_VILLE_438373#126287)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_PAYS_438374#126280)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_PAYS_438374#126280)), MARX) END)

(4) Project [codegen id : 1]
Output: []
Input [40]: [UN_ADR_1_438369#126249, UN_ADR_2_438370#126250, UN_ADR_3_438371#126251, UN_CHEFSER_438358#126252, UN_CODADM_438367#126253, UN_CODPOS_438372#126254, UN_CODSER_438335#126255, UN_CODSIT_438351#126256, UN_CODSOC_438354#126257, UN_CODUTI_438349#126258, UN_COMMENT_438361#126259, UN_CSANA_438366#126260, UN_CSCPT_438365#126261, UN_DATEDE_438359#126262, UN_DATEFI_438360#126263, UN_DATMAJ_438350#126264, UN_DISPRE_438353#126265, UN_ENVADM_438347#126266, UN_E_MAIL_438346#126267, UN_FAX_438345#126268, UN_FLICPT_438362#126269, UN_LIB30_438336#126270, UN_LIBCO_438337#126271, UN_LIEU_S_438348#126272, UN_MODTRT_438352#126273, UN_MOD_ENVOI_438368#126274, UN_NATURE_438339#126275, UN_NUMCPT_A_438355#126276, UN_NUMCPT_C_438357#126277, UN_NUMCPT_F_438356#126278, UN_NUMPRF_438364#126279, UN_PAYS_438374#126280, UN_SERV_438338#126281, UN_TELBUR_438344#126282, UN_UF_DEM_438341#126283, UN_UF_EXE_438342#126284, UN_UF_LOC_438343#126285, UN_VALID_438340#126286, UN_VILLE_438373#126287, UN_XML_P_CPTA_438363#126288]

(5) HashAggregate [codegen id : 1]
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#126612L]
Results [1]: [count#126613L]

(6) Exchange
Input [1]: [count#126613L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=12057]

(7) ShuffleQueryStage
Output [1]: [count#126613L]
Arguments: 0

(8) HashAggregate [codegen id : 2]
Input [1]: [count#126613L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#126609L]
Results [1]: [count(1)#126609L AS count#126610L]

(9) Filter
Input [40]: [UN_ADR_1_438369#126249, UN_ADR_2_438370#126250, UN_ADR_3_438371#126251, UN_CHEFSER_438358#126252, UN_CODADM_438367#126253, UN_CODPOS_438372#126254, UN_CODSER_438335#126255, UN_CODSIT_438351#126256, UN_CODSOC_438354#126257, UN_CODUTI_438349#126258, UN_COMMENT_438361#126259, UN_CSANA_438366#126260, UN_CSCPT_438365#126261, UN_DATEDE_438359#126262, UN_DATEFI_438360#126263, UN_DATMAJ_438350#126264, UN_DISPRE_438353#126265, UN_ENVADM_438347#126266, UN_E_MAIL_438346#126267, UN_FAX_438345#126268, UN_FLICPT_438362#126269, UN_LIB30_438336#126270, UN_LIBCO_438337#126271, UN_LIEU_S_438348#126272, UN_MODTRT_438352#126273, UN_MOD_ENVOI_438368#126274, UN_NATURE_438339#126275, UN_NUMCPT_A_438355#126276, UN_NUMCPT_C_438357#126277, UN_NUMCPT_F_438356#126278, UN_NUMPRF_438364#126279, UN_PAYS_438374#126280, UN_SERV_438338#126281, UN_TELBUR_438344#126282, UN_UF_DEM_438341#126283, UN_UF_EXE_438342#126284, UN_UF_LOC_438343#126285, UN_VALID_438340#126286, UN_VILLE_438373#126287, UN_XML_P_CPTA_438363#126288]
Condition : (((((((((((((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODSER_438335#126255)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODSER_438335#126255)), MARX) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_LIB30_438336#126270)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_LIB30_438336#126270)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_LIBCO_438337#126271)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_LIBCO_438337#126271)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_SERV_438338#126281)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_SERV_438338#126281)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NATURE_438339#126275)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NATURE_438339#126275)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_VALID_438340#126286)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_VALID_438340#126286)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_UF_DEM_438341#126283)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_UF_DEM_438341#126283)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_UF_EXE_438342#126284)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_UF_EXE_438342#126284)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_UF_LOC_438343#126285)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_UF_LOC_438343#126285)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_TELBUR_438344#126282)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_TELBUR_438344#126282)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_FAX_438345#126268)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_FAX_438345#126268)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_E_MAIL_438346#126267)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_E_MAIL_438346#126267)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_ENVADM_438347#126266)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_ENVADM_438347#126266)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_LIEU_S_438348#126272)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_LIEU_S_438348#126272)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODUTI_438349#126258)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODUTI_438349#126258)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_DATMAJ_438350#126264)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_DATMAJ_438350#126264)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODSIT_438351#126256)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODSIT_438351#126256)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_MODTRT_438352#126273)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_MODTRT_438352#126273)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_DISPRE_438353#126265)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_DISPRE_438353#126265)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODSOC_438354#126257)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODSOC_438354#126257)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NUMCPT_A_438355#126276)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NUMCPT_A_438355#126276)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NUMCPT_F_438356#126278)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NUMCPT_F_438356#126278)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NUMCPT_C_438357#126277)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NUMCPT_C_438357#126277)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CHEFSER_438358#126252)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CHEFSER_438358#126252)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_DATEDE_438359#126262)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_DATEDE_438359#126262)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_DATEFI_438360#126263)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_DATEFI_438360#126263)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_COMMENT_438361#126259)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_COMMENT_438361#126259)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_FLICPT_438362#126269)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_FLICPT_438362#126269)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_XML_P_CPTA_438363#126288)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_XML_P_CPTA_438363#126288)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_NUMPRF_438364#126279)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_NUMPRF_438364#126279)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CSCPT_438365#126261)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CSCPT_438365#126261)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CSANA_438366#126260)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CSANA_438366#126260)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODADM_438367#126253)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODADM_438367#126253)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_MOD_ENVOI_438368#126274)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_MOD_ENVOI_438368#126274)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_ADR_1_438369#126249)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_ADR_1_438369#126249)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_ADR_2_438370#126250)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_ADR_2_438370#126250)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_ADR_3_438371#126251)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_ADR_3_438371#126251)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_CODPOS_438372#126254)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_CODPOS_438372#126254)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_VILLE_438373#126287)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_VILLE_438373#126287)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(UN_PAYS_438374#126280)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(UN_PAYS_438374#126280)), MARX) END)

(10) Project
Output: []
Input [40]: [UN_ADR_1_438369#126249, UN_ADR_2_438370#126250, UN_ADR_3_438371#126251, UN_CHEFSER_438358#126252, UN_CODADM_438367#126253, UN_CODPOS_438372#126254, UN_CODSER_438335#126255, UN_CODSIT_438351#126256, UN_CODSOC_438354#126257, UN_CODUTI_438349#126258, UN_COMMENT_438361#126259, UN_CSANA_438366#126260, UN_CSCPT_438365#126261, UN_DATEDE_438359#126262, UN_DATEFI_438360#126263, UN_DATMAJ_438350#126264, UN_DISPRE_438353#126265, UN_ENVADM_438347#126266, UN_E_MAIL_438346#126267, UN_FAX_438345#126268, UN_FLICPT_438362#126269, UN_LIB30_438336#126270, UN_LIBCO_438337#126271, UN_LIEU_S_438348#126272, UN_MODTRT_438352#126273, UN_MOD_ENVOI_438368#126274, UN_NATURE_438339#126275, UN_NUMCPT_A_438355#126276, UN_NUMCPT_C_438357#126277, UN_NUMCPT_F_438356#126278, UN_NUMPRF_438364#126279, UN_PAYS_438374#126280, UN_SERV_438338#126281, UN_TELBUR_438344#126282, UN_UF_DEM_438341#126283, UN_UF_EXE_438342#126284, UN_UF_LOC_438343#126285, UN_VALID_438340#126286, UN_VILLE_438373#126287, UN_XML_P_CPTA_438363#126288]

(11) HashAggregate
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#126612L]
Results [1]: [count#126613L]

(12) Exchange
Input [1]: [count#126613L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=12037]

(13) HashAggregate
Input [1]: [count#126613L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#126609L]
Results [1]: [count(1)#126609L AS count#126610L]

(14) AdaptiveSparkPlan
Output [1]: [count#126610L]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet