hdh-spark-job - Details for Query 1454

Submitted Time: 2026/10/23 13:29:37
Duration: 2 s
Succeeded Jobs: 1452 1457

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: 0 ms"; 2 [labelType="html" label="HashAggregate time in aggregation build: 0 ms number of output rows: 1"]; } 3 [labelType="html" label="Exchange shuffle records written: 2 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 2114.0: task 1846)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 2 local bytes read: 112.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 2 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 32.0 B (16.0 B, 16.0 B, 16.0 B (stage 2114.0: task 1846)) local merged bytes read: 0.0 B number of partitions: 1 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 112.0 B (56.0 B, 56.0 B, 56.0 B (stage 2114.0: task 1846))"]; subgraph cluster4 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: total (min, med, max (stageId: taskId))\n3.0 s (1.5 s, 1.5 s, 1.5 s (stage 2114.0: task 1845))"; 5 [labelType="html" label="HashAggregate time in aggregation build total (min, med, max (stageId: taskId)) 3.0 s (1.5 s, 1.5 s, 1.5 s (stage 2114.0: task 1845)) number of output rows: 2"]; } 6 [labelType="html" label=" Union "]; subgraph cluster7 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 1.5 s"; 8 [labelType="html" label=" Project "]; 9 [labelType="html" label="Filter number of output rows: 0"]; 10 [labelType="html" label="Scan JDBCRelation((SELECT \"nj_numper\", \"nj_sigma\", \"nj_numdos\", \"nj_codser\", \"nj_codufl\", \"nj_datede\", \"nj_datefi\", \"nj_coduti\", \"nj_datmaj\", \"nj_datcre\", \"nj_nature\", \"nj_heudeb\", \"nj_heufin\", \"nj_numcha\", \"nj_codips\", \"nj_datmvt\", \"nj_heumvt\", \"nj_oldcodser\", \"nj_oldcodufl\", \"nj_numlit\", \"nj_classe\", \"nj_numper_ori\", \"nj_typorg\", \"nj_natass\", \"nj_codicd\", \"nj_motifhosp\", \"nj_type_icd\", \"nj_ver_icd\", \"nj_altvisitid\" FROM \"xplore\".\"h_numsej\") as x) [numPartitions=1] number of output rows: 70,896"]; } subgraph cluster11 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: 1.5 s"; 12 [labelType="html" label=" Project "]; 13 [labelType="html" label="Filter number of output rows: 0"]; 14 [labelType="html" label="Scan JDBCRelation((SELECT \"nj_numper\", \"nj_sigma\", \"nj_numdos\", \"nj_codser\", \"nj_codufl\", \"nj_datede\", \"nj_datefi\", \"nj_coduti\", \"nj_datmaj\", \"nj_datcre\", \"nj_nature\", \"nj_heudeb\", \"nj_heufin\", \"nj_numcha\", \"nj_codips\", \"nj_datmvt\", \"nj_heumvt\", \"nj_oldcodser\", \"nj_oldcodufl\", \"nj_numlit\", \"nj_classe\", \"nj_numper_ori\", \"nj_typorg\", \"nj_natass\", \"nj_codicd\", \"nj_motifhosp\", \"nj_type_icd\", \"nj_ver_icd\", \"nj_altvisitid\" FROM \"xplore2\".\"h_numsej\") as x) [numPartitions=1] number of output rows: 70,896"]; } 2->0; 3->2; 5->3; 6->5; 8->6; 9->8; 10->9; 12->6; 13->12; 14->13; }

AdaptiveSparkPlan isFinalPlan=true

HashAggregate(keys=[], functions=[count(1)])

WholeStageCodegen (4)

Exchange SinglePartition, ENSURE_REQUIREMENTS, [plan_id=39658]

HashAggregate(keys=[], functions=[partial_count(1)])

WholeStageCodegen (3)

Union

Project

Filter (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#742329)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#742329)), MAIN) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#742330)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#742330)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#742331)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#742331)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#742332)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#742332)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#742333)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#742333)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#742334)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#742334)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#742335)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#742335)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#742336)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#742336)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#742337)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#742337)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#742338)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#742338)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#742339)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#742339)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#742340)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#742340)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#742341)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#742341)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#742342)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#742342)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#742343)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#742343)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#742344)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#742344)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#742345)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#742345)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#742346)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#742346)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#742347)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#742347)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#742348)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#742348)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#742349)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#742349)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#742350)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#742350)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#742351)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#742351)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#742352)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#742352)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#742353)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#742353)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#742354)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#742354)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#742355)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#742355)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#742356)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#742356)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#742357)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#742357)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_A))), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_A))), MAIN) END)

Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1] [nj_numper#742329,nj_sigma#742330,nj_numdos#742331,nj_codser#742332,nj_codufl#742333,nj_datede#742334,nj_datefi#742335,nj_coduti#742336,nj_datmaj#742337,nj_datcre#742338,nj_nature#742339,nj_heudeb#742340,nj_heufin#742341,nj_numcha#742342,nj_codips#742343,nj_datmvt#742344,nj_heumvt#742345,nj_oldcodser#742346,nj_oldcodufl#742347,nj_numlit#742348,nj_classe#742349,nj_numper_ori#742350,nj_typorg#742351,nj_natass#742352,... 5 more fields] PushedFilters: [], ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_dat...

WholeStageCodegen (1)

Project

Filter (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#743247)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#743247)), MAIN) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#743248)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#743248)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#743249)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#743249)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#743250)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#743250)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#743251)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#743251)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#743252)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#743252)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#743253)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#743253)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#743254)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#743254)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#743255)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#743255)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#743256)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#743256)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#743257)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#743257)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#743258)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#743258)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#743259)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#743259)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#743260)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#743260)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#743261)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#743261)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#743262)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#743262)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#743263)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#743263)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#743264)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#743264)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#743265)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#743265)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#743266)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#743266)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#743267)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#743267)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#743268)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#743268)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#743269)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#743269)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#743270)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#743270)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#743271)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#743271)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#743272)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#743272)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#743273)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#743273)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#743274)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#743274)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#743275)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#743275)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_B))), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_B))), MAIN) END)

Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1] [nj_numper#743247,nj_sigma#743248,nj_numdos#743249,nj_codser#743250,nj_codufl#743251,nj_datede#743252,nj_datefi#743253,nj_coduti#743254,nj_datmaj#743255,nj_datcre#743256,nj_nature#743257,nj_heudeb#743258,nj_heufin#743259,nj_numcha#743260,nj_codips#743261,nj_datmvt#743262,nj_heumvt#743263,nj_oldcodser#743264,nj_oldcodufl#743265,nj_numlit#743266,nj_classe#743267,nj_numper_ori#743268,nj_typorg#743269,nj_natass#743270,... 5 more fields] PushedFilters: [], ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_dat...

WholeStageCodegen (2)

Details

== Physical Plan ==
AdaptiveSparkPlan (16)
+- == Final Plan ==
   * HashAggregate (11)
   +- ShuffleQueryStage (10), Statistics(sizeInBytes=32.0 B, rowCount=2)
      +- Exchange (9)
         +- * HashAggregate (8)
            +- Union (7)
               :- * Project (3)
               :  +- * Filter (2)
               :     +- * Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1]  (1)
               +- * Project (6)
                  +- * Filter (5)
                     +- * Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1]  (4)
+- == Initial Plan ==
   HashAggregate (15)
   +- Exchange (14)
      +- HashAggregate (13)
         +- Union (12)
            :- Project (3)
            :  +- Filter (2)
            :     +- Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1]  (1)
            +- Project (6)
               +- Filter (5)
                  +- Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1]  (4)


(1) Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1]  [codegen id : 1]
Output [29]: [nj_numper#742329, nj_sigma#742330, nj_numdos#742331, nj_codser#742332, nj_codufl#742333, nj_datede#742334, nj_datefi#742335, nj_coduti#742336, nj_datmaj#742337, nj_datcre#742338, nj_nature#742339, nj_heudeb#742340, nj_heufin#742341, nj_numcha#742342, nj_codips#742343, nj_datmvt#742344, nj_heumvt#742345, nj_oldcodser#742346, nj_oldcodufl#742347, nj_numlit#742348, nj_classe#742349, nj_numper_ori#742350, nj_typorg#742351, nj_natass#742352, nj_codicd#742353, nj_motifhosp#742354, nj_type_icd#742355, nj_ver_icd#742356, nj_altvisitid#742357]
ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_datede:string,nj_datefi:string,nj_coduti:string,nj_datmaj:string,nj_datcre:string,nj_nature:string,nj_heudeb:string,nj_heufin:string,nj_numcha:string,nj_codips:string,nj_datmvt:string,nj_heumvt:string,nj_oldcodser:string,nj_oldcodufl:string,nj_numlit:string,nj_classe:string,nj_numper_ori:string,nj_typorg:string,nj_natass:string,nj_codicd:string,nj_motifhosp:string,nj_type_icd:string,nj_ver_icd:string,nj_altvisitid:string>

(2) Filter [codegen id : 1]
Input [29]: [nj_numper#742329, nj_sigma#742330, nj_numdos#742331, nj_codser#742332, nj_codufl#742333, nj_datede#742334, nj_datefi#742335, nj_coduti#742336, nj_datmaj#742337, nj_datcre#742338, nj_nature#742339, nj_heudeb#742340, nj_heufin#742341, nj_numcha#742342, nj_codips#742343, nj_datmvt#742344, nj_heumvt#742345, nj_oldcodser#742346, nj_oldcodufl#742347, nj_numlit#742348, nj_classe#742349, nj_numper_ori#742350, nj_typorg#742351, nj_natass#742352, nj_codicd#742353, nj_motifhosp#742354, nj_type_icd#742355, nj_ver_icd#742356, nj_altvisitid#742357]
Condition : (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#742329)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#742329)), MAIN) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#742330)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#742330)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#742331)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#742331)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#742332)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#742332)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#742333)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#742333)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#742334)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#742334)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#742335)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#742335)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#742336)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#742336)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#742337)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#742337)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#742338)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#742338)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#742339)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#742339)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#742340)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#742340)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#742341)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#742341)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#742342)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#742342)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#742343)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#742343)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#742344)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#742344)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#742345)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#742345)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#742346)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#742346)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#742347)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#742347)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#742348)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#742348)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#742349)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#742349)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#742350)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#742350)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#742351)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#742351)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#742352)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#742352)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#742353)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#742353)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#742354)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#742354)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#742355)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#742355)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#742356)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#742356)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#742357)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#742357)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_A))), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_A))), MAIN) END)

(3) Project [codegen id : 1]
Output: []
Input [29]: [nj_numper#742329, nj_sigma#742330, nj_numdos#742331, nj_codser#742332, nj_codufl#742333, nj_datede#742334, nj_datefi#742335, nj_coduti#742336, nj_datmaj#742337, nj_datcre#742338, nj_nature#742339, nj_heudeb#742340, nj_heufin#742341, nj_numcha#742342, nj_codips#742343, nj_datmvt#742344, nj_heumvt#742345, nj_oldcodser#742346, nj_oldcodufl#742347, nj_numlit#742348, nj_classe#742349, nj_numper_ori#742350, nj_typorg#742351, nj_natass#742352, nj_codicd#742353, nj_motifhosp#742354, nj_type_icd#742355, nj_ver_icd#742356, nj_altvisitid#742357]

(4) Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1]  [codegen id : 2]
Output [29]: [nj_numper#743247, nj_sigma#743248, nj_numdos#743249, nj_codser#743250, nj_codufl#743251, nj_datede#743252, nj_datefi#743253, nj_coduti#743254, nj_datmaj#743255, nj_datcre#743256, nj_nature#743257, nj_heudeb#743258, nj_heufin#743259, nj_numcha#743260, nj_codips#743261, nj_datmvt#743262, nj_heumvt#743263, nj_oldcodser#743264, nj_oldcodufl#743265, nj_numlit#743266, nj_classe#743267, nj_numper_ori#743268, nj_typorg#743269, nj_natass#743270, nj_codicd#743271, nj_motifhosp#743272, nj_type_icd#743273, nj_ver_icd#743274, nj_altvisitid#743275]
ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_datede:string,nj_datefi:string,nj_coduti:string,nj_datmaj:string,nj_datcre:string,nj_nature:string,nj_heudeb:string,nj_heufin:string,nj_numcha:string,nj_codips:string,nj_datmvt:string,nj_heumvt:string,nj_oldcodser:string,nj_oldcodufl:string,nj_numlit:string,nj_classe:string,nj_numper_ori:string,nj_typorg:string,nj_natass:string,nj_codicd:string,nj_motifhosp:string,nj_type_icd:string,nj_ver_icd:string,nj_altvisitid:string>

(5) Filter [codegen id : 2]
Input [29]: [nj_numper#743247, nj_sigma#743248, nj_numdos#743249, nj_codser#743250, nj_codufl#743251, nj_datede#743252, nj_datefi#743253, nj_coduti#743254, nj_datmaj#743255, nj_datcre#743256, nj_nature#743257, nj_heudeb#743258, nj_heufin#743259, nj_numcha#743260, nj_codips#743261, nj_datmvt#743262, nj_heumvt#743263, nj_oldcodser#743264, nj_oldcodufl#743265, nj_numlit#743266, nj_classe#743267, nj_numper_ori#743268, nj_typorg#743269, nj_natass#743270, nj_codicd#743271, nj_motifhosp#743272, nj_type_icd#743273, nj_ver_icd#743274, nj_altvisitid#743275]
Condition : (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#743247)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#743247)), MAIN) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#743248)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#743248)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#743249)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#743249)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#743250)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#743250)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#743251)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#743251)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#743252)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#743252)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#743253)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#743253)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#743254)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#743254)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#743255)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#743255)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#743256)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#743256)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#743257)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#743257)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#743258)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#743258)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#743259)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#743259)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#743260)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#743260)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#743261)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#743261)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#743262)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#743262)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#743263)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#743263)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#743264)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#743264)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#743265)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#743265)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#743266)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#743266)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#743267)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#743267)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#743268)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#743268)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#743269)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#743269)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#743270)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#743270)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#743271)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#743271)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#743272)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#743272)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#743273)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#743273)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#743274)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#743274)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#743275)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#743275)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_B))), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_B))), MAIN) END)

(6) Project [codegen id : 2]
Output: []
Input [29]: [nj_numper#743247, nj_sigma#743248, nj_numdos#743249, nj_codser#743250, nj_codufl#743251, nj_datede#743252, nj_datefi#743253, nj_coduti#743254, nj_datmaj#743255, nj_datcre#743256, nj_nature#743257, nj_heudeb#743258, nj_heufin#743259, nj_numcha#743260, nj_codips#743261, nj_datmvt#743262, nj_heumvt#743263, nj_oldcodser#743264, nj_oldcodufl#743265, nj_numlit#743266, nj_classe#743267, nj_numper_ori#743268, nj_typorg#743269, nj_natass#743270, nj_codicd#743271, nj_motifhosp#743272, nj_type_icd#743273, nj_ver_icd#743274, nj_altvisitid#743275]

(7) Union

(8) HashAggregate [codegen id : 3]
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#745346L]
Results [1]: [count#745347L]

(9) Exchange
Input [1]: [count#745347L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=39658]

(10) ShuffleQueryStage
Output [1]: [count#745347L]
Arguments: 0

(11) HashAggregate [codegen id : 4]
Input [1]: [count#745347L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#744877L]
Results [1]: [count(1)#744877L AS COL_f064a665-0cef-43be-9135-57ae0effcbb5#744879L]

(12) Union

(13) HashAggregate
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#745346L]
Results [1]: [count#745347L]

(14) Exchange
Input [1]: [count#745347L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=39631]

(15) HashAggregate
Input [1]: [count#745347L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#744877L]
Results [1]: [count(1)#744877L AS COL_f064a665-0cef-43be-9135-57ae0effcbb5#744879L]

(16) AdaptiveSparkPlan
Output [1]: [COL_f064a665-0cef-43be-9135-57ae0effcbb5#744879L]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet