hdh-spark-job - Details for Query 1347

Submitted Time: 2026/10/23 13:28:01
Duration: 4 s
Succeeded Jobs: 1344 1349

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: 0 ms"; 2 [labelType="html" label="HashAggregate time in aggregation build: 0 ms number of output rows: 1"]; } 3 [labelType="html" label="Exchange shuffle records written: 2 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1938.0: task 1693)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 2 local bytes read: 112.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 2 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 32.0 B (16.0 B, 16.0 B, 16.0 B (stage 1938.0: task 1693)) local merged bytes read: 0.0 B number of partitions: 1 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 112.0 B (56.0 B, 56.0 B, 56.0 B (stage 1938.0: task 1693))"]; subgraph cluster4 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: total (min, med, max (stageId: taskId))\n3.0 s (1.5 s, 1.5 s, 1.5 s (stage 1938.0: task 1692))"; 5 [labelType="html" label="HashAggregate time in aggregation build total (min, med, max (stageId: taskId)) 3.0 s (1.5 s, 1.5 s, 1.5 s (stage 1938.0: task 1692)) number of output rows: 2"]; } 6 [labelType="html" label=" Union "]; subgraph cluster7 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 1.5 s"; 8 [labelType="html" label=" Project "]; 9 [labelType="html" label="Filter number of output rows: 0"]; 10 [labelType="html" label="Scan JDBCRelation((SELECT \"nj_numper\", \"nj_sigma\", \"nj_numdos\", \"nj_codser\", \"nj_codufl\", \"nj_datede\", \"nj_datefi\", \"nj_coduti\", \"nj_datmaj\", \"nj_datcre\", \"nj_nature\", \"nj_heudeb\", \"nj_heufin\", \"nj_numcha\", \"nj_codips\", \"nj_datmvt\", \"nj_heumvt\", \"nj_oldcodser\", \"nj_oldcodufl\", \"nj_numlit\", \"nj_classe\", \"nj_numper_ori\", \"nj_typorg\", \"nj_natass\", \"nj_codicd\", \"nj_motifhosp\", \"nj_type_icd\", \"nj_ver_icd\", \"nj_altvisitid\" FROM \"xplore\".\"h_numsej\") as x) [numPartitions=1] number of output rows: 70,896"]; } subgraph cluster11 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: 1.5 s"; 12 [labelType="html" label=" Project "]; 13 [labelType="html" label="Filter number of output rows: 0"]; 14 [labelType="html" label="Scan JDBCRelation((SELECT \"nj_numper\", \"nj_sigma\", \"nj_numdos\", \"nj_codser\", \"nj_codufl\", \"nj_datede\", \"nj_datefi\", \"nj_coduti\", \"nj_datmaj\", \"nj_datcre\", \"nj_nature\", \"nj_heudeb\", \"nj_heufin\", \"nj_numcha\", \"nj_codips\", \"nj_datmvt\", \"nj_heumvt\", \"nj_oldcodser\", \"nj_oldcodufl\", \"nj_numlit\", \"nj_classe\", \"nj_numper_ori\", \"nj_typorg\", \"nj_natass\", \"nj_codicd\", \"nj_motifhosp\", \"nj_type_icd\", \"nj_ver_icd\", \"nj_altvisitid\" FROM \"xplore2\".\"h_numsej\") as x) [numPartitions=1] number of output rows: 70,896"]; } 2->0; 3->2; 5->3; 6->5; 8->6; 9->8; 10->9; 12->6; 13->12; 14->13; }

AdaptiveSparkPlan isFinalPlan=true

HashAggregate(keys=[], functions=[count(1)])

WholeStageCodegen (4)

Exchange SinglePartition, ENSURE_REQUIREMENTS, [plan_id=36056]

HashAggregate(keys=[], functions=[partial_count(1)])

WholeStageCodegen (3)

Union

Project

Filter (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#666209)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#666209)), MAIN) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#666210)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#666210)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#666211)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#666211)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#666212)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#666212)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#666213)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#666213)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#666214)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#666214)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#666215)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#666215)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#666216)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#666216)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#666217)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#666217)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#666218)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#666218)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#666219)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#666219)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#666220)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#666220)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#666221)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#666221)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#666222)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#666222)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#666223)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#666223)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#666224)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#666224)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#666225)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#666225)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#666226)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#666226)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#666227)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#666227)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#666228)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#666228)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#666229)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#666229)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#666230)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#666230)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#666231)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#666231)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#666232)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#666232)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#666233)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#666233)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#666234)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#666234)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#666235)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#666235)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#666236)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#666236)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#666237)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#666237)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_A))), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_A))), MAIN) END)

Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1] [nj_numper#666209,nj_sigma#666210,nj_numdos#666211,nj_codser#666212,nj_codufl#666213,nj_datede#666214,nj_datefi#666215,nj_coduti#666216,nj_datmaj#666217,nj_datcre#666218,nj_nature#666219,nj_heudeb#666220,nj_heufin#666221,nj_numcha#666222,nj_codips#666223,nj_datmvt#666224,nj_heumvt#666225,nj_oldcodser#666226,nj_oldcodufl#666227,nj_numlit#666228,nj_classe#666229,nj_numper_ori#666230,nj_typorg#666231,nj_natass#666232,... 5 more fields] PushedFilters: [], ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_dat...

WholeStageCodegen (1)

Project

Filter (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#666757)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#666757)), MAIN) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#666758)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#666758)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#666759)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#666759)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#666760)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#666760)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#666761)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#666761)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#666762)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#666762)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#666763)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#666763)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#666764)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#666764)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#666765)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#666765)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#666766)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#666766)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#666767)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#666767)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#666768)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#666768)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#666769)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#666769)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#666770)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#666770)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#666771)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#666771)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#666772)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#666772)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#666773)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#666773)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#666774)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#666774)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#666775)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#666775)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#666776)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#666776)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#666777)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#666777)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#666778)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#666778)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#666779)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#666779)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#666780)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#666780)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#666781)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#666781)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#666782)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#666782)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#666783)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#666783)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#666784)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#666784)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#666785)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#666785)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_B))), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_B))), MAIN) END)

Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1] [nj_numper#666757,nj_sigma#666758,nj_numdos#666759,nj_codser#666760,nj_codufl#666761,nj_datede#666762,nj_datefi#666763,nj_coduti#666764,nj_datmaj#666765,nj_datcre#666766,nj_nature#666767,nj_heudeb#666768,nj_heufin#666769,nj_numcha#666770,nj_codips#666771,nj_datmvt#666772,nj_heumvt#666773,nj_oldcodser#666774,nj_oldcodufl#666775,nj_numlit#666776,nj_classe#666777,nj_numper_ori#666778,nj_typorg#666779,nj_natass#666780,... 5 more fields] PushedFilters: [], ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_dat...

WholeStageCodegen (2)

Details

== Physical Plan ==
AdaptiveSparkPlan (16)
+- == Final Plan ==
   * HashAggregate (11)
   +- ShuffleQueryStage (10), Statistics(sizeInBytes=32.0 B, rowCount=2)
      +- Exchange (9)
         +- * HashAggregate (8)
            +- Union (7)
               :- * Project (3)
               :  +- * Filter (2)
               :     +- * Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1]  (1)
               +- * Project (6)
                  +- * Filter (5)
                     +- * Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1]  (4)
+- == Initial Plan ==
   HashAggregate (15)
   +- Exchange (14)
      +- HashAggregate (13)
         +- Union (12)
            :- Project (3)
            :  +- Filter (2)
            :     +- Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1]  (1)
            +- Project (6)
               +- Filter (5)
                  +- Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1]  (4)


(1) Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1]  [codegen id : 1]
Output [29]: [nj_numper#666209, nj_sigma#666210, nj_numdos#666211, nj_codser#666212, nj_codufl#666213, nj_datede#666214, nj_datefi#666215, nj_coduti#666216, nj_datmaj#666217, nj_datcre#666218, nj_nature#666219, nj_heudeb#666220, nj_heufin#666221, nj_numcha#666222, nj_codips#666223, nj_datmvt#666224, nj_heumvt#666225, nj_oldcodser#666226, nj_oldcodufl#666227, nj_numlit#666228, nj_classe#666229, nj_numper_ori#666230, nj_typorg#666231, nj_natass#666232, nj_codicd#666233, nj_motifhosp#666234, nj_type_icd#666235, nj_ver_icd#666236, nj_altvisitid#666237]
ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_datede:string,nj_datefi:string,nj_coduti:string,nj_datmaj:string,nj_datcre:string,nj_nature:string,nj_heudeb:string,nj_heufin:string,nj_numcha:string,nj_codips:string,nj_datmvt:string,nj_heumvt:string,nj_oldcodser:string,nj_oldcodufl:string,nj_numlit:string,nj_classe:string,nj_numper_ori:string,nj_typorg:string,nj_natass:string,nj_codicd:string,nj_motifhosp:string,nj_type_icd:string,nj_ver_icd:string,nj_altvisitid:string>

(2) Filter [codegen id : 1]
Input [29]: [nj_numper#666209, nj_sigma#666210, nj_numdos#666211, nj_codser#666212, nj_codufl#666213, nj_datede#666214, nj_datefi#666215, nj_coduti#666216, nj_datmaj#666217, nj_datcre#666218, nj_nature#666219, nj_heudeb#666220, nj_heufin#666221, nj_numcha#666222, nj_codips#666223, nj_datmvt#666224, nj_heumvt#666225, nj_oldcodser#666226, nj_oldcodufl#666227, nj_numlit#666228, nj_classe#666229, nj_numper_ori#666230, nj_typorg#666231, nj_natass#666232, nj_codicd#666233, nj_motifhosp#666234, nj_type_icd#666235, nj_ver_icd#666236, nj_altvisitid#666237]
Condition : (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#666209)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#666209)), MAIN) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#666210)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#666210)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#666211)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#666211)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#666212)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#666212)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#666213)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#666213)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#666214)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#666214)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#666215)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#666215)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#666216)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#666216)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#666217)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#666217)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#666218)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#666218)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#666219)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#666219)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#666220)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#666220)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#666221)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#666221)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#666222)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#666222)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#666223)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#666223)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#666224)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#666224)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#666225)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#666225)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#666226)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#666226)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#666227)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#666227)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#666228)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#666228)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#666229)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#666229)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#666230)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#666230)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#666231)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#666231)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#666232)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#666232)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#666233)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#666233)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#666234)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#666234)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#666235)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#666235)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#666236)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#666236)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#666237)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#666237)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_A))), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_A))), MAIN) END)

(3) Project [codegen id : 1]
Output: []
Input [29]: [nj_numper#666209, nj_sigma#666210, nj_numdos#666211, nj_codser#666212, nj_codufl#666213, nj_datede#666214, nj_datefi#666215, nj_coduti#666216, nj_datmaj#666217, nj_datcre#666218, nj_nature#666219, nj_heudeb#666220, nj_heufin#666221, nj_numcha#666222, nj_codips#666223, nj_datmvt#666224, nj_heumvt#666225, nj_oldcodser#666226, nj_oldcodufl#666227, nj_numlit#666228, nj_classe#666229, nj_numper_ori#666230, nj_typorg#666231, nj_natass#666232, nj_codicd#666233, nj_motifhosp#666234, nj_type_icd#666235, nj_ver_icd#666236, nj_altvisitid#666237]

(4) Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1]  [codegen id : 2]
Output [29]: [nj_numper#666757, nj_sigma#666758, nj_numdos#666759, nj_codser#666760, nj_codufl#666761, nj_datede#666762, nj_datefi#666763, nj_coduti#666764, nj_datmaj#666765, nj_datcre#666766, nj_nature#666767, nj_heudeb#666768, nj_heufin#666769, nj_numcha#666770, nj_codips#666771, nj_datmvt#666772, nj_heumvt#666773, nj_oldcodser#666774, nj_oldcodufl#666775, nj_numlit#666776, nj_classe#666777, nj_numper_ori#666778, nj_typorg#666779, nj_natass#666780, nj_codicd#666781, nj_motifhosp#666782, nj_type_icd#666783, nj_ver_icd#666784, nj_altvisitid#666785]
ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_datede:string,nj_datefi:string,nj_coduti:string,nj_datmaj:string,nj_datcre:string,nj_nature:string,nj_heudeb:string,nj_heufin:string,nj_numcha:string,nj_codips:string,nj_datmvt:string,nj_heumvt:string,nj_oldcodser:string,nj_oldcodufl:string,nj_numlit:string,nj_classe:string,nj_numper_ori:string,nj_typorg:string,nj_natass:string,nj_codicd:string,nj_motifhosp:string,nj_type_icd:string,nj_ver_icd:string,nj_altvisitid:string>

(5) Filter [codegen id : 2]
Input [29]: [nj_numper#666757, nj_sigma#666758, nj_numdos#666759, nj_codser#666760, nj_codufl#666761, nj_datede#666762, nj_datefi#666763, nj_coduti#666764, nj_datmaj#666765, nj_datcre#666766, nj_nature#666767, nj_heudeb#666768, nj_heufin#666769, nj_numcha#666770, nj_codips#666771, nj_datmvt#666772, nj_heumvt#666773, nj_oldcodser#666774, nj_oldcodufl#666775, nj_numlit#666776, nj_classe#666777, nj_numper_ori#666778, nj_typorg#666779, nj_natass#666780, nj_codicd#666781, nj_motifhosp#666782, nj_type_icd#666783, nj_ver_icd#666784, nj_altvisitid#666785]
Condition : (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#666757)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#666757)), MAIN) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#666758)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#666758)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#666759)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#666759)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#666760)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#666760)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#666761)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#666761)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#666762)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#666762)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#666763)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#666763)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#666764)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#666764)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#666765)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#666765)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#666766)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#666766)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#666767)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#666767)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#666768)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#666768)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#666769)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#666769)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#666770)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#666770)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#666771)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#666771)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#666772)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#666772)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#666773)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#666773)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#666774)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#666774)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#666775)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#666775)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#666776)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#666776)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#666777)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#666777)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#666778)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#666778)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#666779)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#666779)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#666780)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#666780)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#666781)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#666781)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#666782)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#666782)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#666783)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#666783)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#666784)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#666784)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#666785)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#666785)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_B))), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_B))), MAIN) END)

(6) Project [codegen id : 2]
Output: []
Input [29]: [nj_numper#666757, nj_sigma#666758, nj_numdos#666759, nj_codser#666760, nj_codufl#666761, nj_datede#666762, nj_datefi#666763, nj_coduti#666764, nj_datmaj#666765, nj_datcre#666766, nj_nature#666767, nj_heudeb#666768, nj_heufin#666769, nj_numcha#666770, nj_codips#666771, nj_datmvt#666772, nj_heumvt#666773, nj_oldcodser#666774, nj_oldcodufl#666775, nj_numlit#666776, nj_classe#666777, nj_numper_ori#666778, nj_typorg#666779, nj_natass#666780, nj_codicd#666781, nj_motifhosp#666782, nj_type_icd#666783, nj_ver_icd#666784, nj_altvisitid#666785]

(7) Union

(8) HashAggregate [codegen id : 3]
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#667471L]
Results [1]: [count#667472L]

(9) Exchange
Input [1]: [count#667472L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=36056]

(10) ShuffleQueryStage
Output [1]: [count#667472L]
Arguments: 0

(11) HashAggregate [codegen id : 4]
Input [1]: [count#667472L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#667400L]
Results [1]: [count(1)#667400L AS COL_b828bb17-025d-41d0-a0a1-6d748d4a498c#667402L]

(12) Union

(13) HashAggregate
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#667471L]
Results [1]: [count#667472L]

(14) Exchange
Input [1]: [count#667472L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=36036]

(15) HashAggregate
Input [1]: [count#667472L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#667400L]
Results [1]: [count(1)#667400L AS COL_b828bb17-025d-41d0-a0a1-6d748d4a498c#667402L]

(16) AdaptiveSparkPlan
Output [1]: [COL_b828bb17-025d-41d0-a0a1-6d748d4a498c#667402L]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet