hdh-spark-job - Details for Query 1404

Submitted Time: 2026/10/23 13:29:05
Duration: 3 s
Succeeded Jobs: 1400 1406

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: 0 ms"; 2 [labelType="html" label="HashAggregate time in aggregation build: 0 ms number of output rows: 1"]; } 3 [labelType="html" label="Exchange shuffle records written: 2 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 2027.0: task 1771)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 2 local bytes read: 112.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 2 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 32.0 B (16.0 B, 16.0 B, 16.0 B (stage 2027.0: task 1771)) local merged bytes read: 0.0 B number of partitions: 1 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 112.0 B (56.0 B, 56.0 B, 56.0 B (stage 2027.0: task 1771))"]; subgraph cluster4 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: total (min, med, max (stageId: taskId))\n3.1 s (1.5 s, 1.6 s, 1.6 s (stage 2027.0: task 1772))"; 5 [labelType="html" label="HashAggregate time in aggregation build total (min, med, max (stageId: taskId)) 3.1 s (1.5 s, 1.6 s, 1.6 s (stage 2027.0: task 1772)) number of output rows: 2"]; } 6 [labelType="html" label=" Union "]; subgraph cluster7 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 1.5 s"; 8 [labelType="html" label=" Project "]; 9 [labelType="html" label="Filter number of output rows: 0"]; 10 [labelType="html" label="Scan JDBCRelation((SELECT \"nj_numper\", \"nj_sigma\", \"nj_numdos\", \"nj_codser\", \"nj_codufl\", \"nj_datede\", \"nj_datefi\", \"nj_coduti\", \"nj_datmaj\", \"nj_datcre\", \"nj_nature\", \"nj_heudeb\", \"nj_heufin\", \"nj_numcha\", \"nj_codips\", \"nj_datmvt\", \"nj_heumvt\", \"nj_oldcodser\", \"nj_oldcodufl\", \"nj_numlit\", \"nj_classe\", \"nj_numper_ori\", \"nj_typorg\", \"nj_natass\", \"nj_codicd\", \"nj_motifhosp\", \"nj_type_icd\", \"nj_ver_icd\", \"nj_altvisitid\" FROM \"xplore\".\"h_numsej\") as x) [numPartitions=1] number of output rows: 70,896"]; } subgraph cluster11 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: 1.6 s"; 12 [labelType="html" label=" Project "]; 13 [labelType="html" label="Filter number of output rows: 0"]; 14 [labelType="html" label="Scan JDBCRelation((SELECT \"nj_numper\", \"nj_sigma\", \"nj_numdos\", \"nj_codser\", \"nj_codufl\", \"nj_datede\", \"nj_datefi\", \"nj_coduti\", \"nj_datmaj\", \"nj_datcre\", \"nj_nature\", \"nj_heudeb\", \"nj_heufin\", \"nj_numcha\", \"nj_codips\", \"nj_datmvt\", \"nj_heumvt\", \"nj_oldcodser\", \"nj_oldcodufl\", \"nj_numlit\", \"nj_classe\", \"nj_numper_ori\", \"nj_typorg\", \"nj_natass\", \"nj_codicd\", \"nj_motifhosp\", \"nj_type_icd\", \"nj_ver_icd\", \"nj_altvisitid\" FROM \"xplore2\".\"h_numsej\") as x) [numPartitions=1] number of output rows: 70,896"]; } 2->0; 3->2; 5->3; 6->5; 8->6; 9->8; 10->9; 12->6; 13->12; 14->13; }

AdaptiveSparkPlan isFinalPlan=true

HashAggregate(keys=[], functions=[count(1)])

WholeStageCodegen (4)

Exchange SinglePartition, ENSURE_REQUIREMENTS, [plan_id=37982]

HashAggregate(keys=[], functions=[partial_count(1)])

WholeStageCodegen (3)

Union

Project

Filter (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#706296)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#706296)), MAIN) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#706297)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#706297)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#706298)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#706298)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#706299)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#706299)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#706300)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#706300)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#706301)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#706301)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#706302)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#706302)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#706303)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#706303)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#706304)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#706304)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#706305)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#706305)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#706306)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#706306)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#706307)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#706307)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#706308)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#706308)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#706309)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#706309)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#706310)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#706310)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#706311)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#706311)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#706312)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#706312)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#706313)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#706313)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#706314)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#706314)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#706315)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#706315)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#706316)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#706316)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#706317)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#706317)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#706318)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#706318)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#706319)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#706319)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#706320)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#706320)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#706321)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#706321)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#706322)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#706322)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#706323)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#706323)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#706324)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#706324)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_A))), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_A))), MAIN) END)

Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1] [nj_numper#706296,nj_sigma#706297,nj_numdos#706298,nj_codser#706299,nj_codufl#706300,nj_datede#706301,nj_datefi#706302,nj_coduti#706303,nj_datmaj#706304,nj_datcre#706305,nj_nature#706306,nj_heudeb#706307,nj_heufin#706308,nj_numcha#706309,nj_codips#706310,nj_datmvt#706311,nj_heumvt#706312,nj_oldcodser#706313,nj_oldcodufl#706314,nj_numlit#706315,nj_classe#706316,nj_numper_ori#706317,nj_typorg#706318,nj_natass#706319,... 5 more fields] PushedFilters: [], ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_dat...

WholeStageCodegen (1)

Project

Filter (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#706562)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#706562)), MAIN) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#706563)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#706563)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#706564)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#706564)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#706565)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#706565)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#706566)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#706566)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#706567)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#706567)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#706568)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#706568)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#706569)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#706569)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#706570)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#706570)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#706571)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#706571)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#706572)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#706572)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#706573)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#706573)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#706574)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#706574)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#706575)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#706575)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#706576)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#706576)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#706577)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#706577)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#706578)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#706578)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#706579)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#706579)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#706580)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#706580)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#706581)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#706581)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#706582)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#706582)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#706583)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#706583)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#706584)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#706584)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#706585)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#706585)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#706586)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#706586)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#706587)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#706587)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#706588)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#706588)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#706589)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#706589)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#706590)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#706590)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_B))), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_B))), MAIN) END)

Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1] [nj_numper#706562,nj_sigma#706563,nj_numdos#706564,nj_codser#706565,nj_codufl#706566,nj_datede#706567,nj_datefi#706568,nj_coduti#706569,nj_datmaj#706570,nj_datcre#706571,nj_nature#706572,nj_heudeb#706573,nj_heufin#706574,nj_numcha#706575,nj_codips#706576,nj_datmvt#706577,nj_heumvt#706578,nj_oldcodser#706579,nj_oldcodufl#706580,nj_numlit#706581,nj_classe#706582,nj_numper_ori#706583,nj_typorg#706584,nj_natass#706585,... 5 more fields] PushedFilters: [], ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_dat...

WholeStageCodegen (2)

Details

== Physical Plan ==
AdaptiveSparkPlan (16)
+- == Final Plan ==
   * HashAggregate (11)
   +- ShuffleQueryStage (10), Statistics(sizeInBytes=32.0 B, rowCount=2)
      +- Exchange (9)
         +- * HashAggregate (8)
            +- Union (7)
               :- * Project (3)
               :  +- * Filter (2)
               :     +- * Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1]  (1)
               +- * Project (6)
                  +- * Filter (5)
                     +- * Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1]  (4)
+- == Initial Plan ==
   HashAggregate (15)
   +- Exchange (14)
      +- HashAggregate (13)
         +- Union (12)
            :- Project (3)
            :  +- Filter (2)
            :     +- Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1]  (1)
            +- Project (6)
               +- Filter (5)
                  +- Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1]  (4)


(1) Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1]  [codegen id : 1]
Output [29]: [nj_numper#706296, nj_sigma#706297, nj_numdos#706298, nj_codser#706299, nj_codufl#706300, nj_datede#706301, nj_datefi#706302, nj_coduti#706303, nj_datmaj#706304, nj_datcre#706305, nj_nature#706306, nj_heudeb#706307, nj_heufin#706308, nj_numcha#706309, nj_codips#706310, nj_datmvt#706311, nj_heumvt#706312, nj_oldcodser#706313, nj_oldcodufl#706314, nj_numlit#706315, nj_classe#706316, nj_numper_ori#706317, nj_typorg#706318, nj_natass#706319, nj_codicd#706320, nj_motifhosp#706321, nj_type_icd#706322, nj_ver_icd#706323, nj_altvisitid#706324]
ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_datede:string,nj_datefi:string,nj_coduti:string,nj_datmaj:string,nj_datcre:string,nj_nature:string,nj_heudeb:string,nj_heufin:string,nj_numcha:string,nj_codips:string,nj_datmvt:string,nj_heumvt:string,nj_oldcodser:string,nj_oldcodufl:string,nj_numlit:string,nj_classe:string,nj_numper_ori:string,nj_typorg:string,nj_natass:string,nj_codicd:string,nj_motifhosp:string,nj_type_icd:string,nj_ver_icd:string,nj_altvisitid:string>

(2) Filter [codegen id : 1]
Input [29]: [nj_numper#706296, nj_sigma#706297, nj_numdos#706298, nj_codser#706299, nj_codufl#706300, nj_datede#706301, nj_datefi#706302, nj_coduti#706303, nj_datmaj#706304, nj_datcre#706305, nj_nature#706306, nj_heudeb#706307, nj_heufin#706308, nj_numcha#706309, nj_codips#706310, nj_datmvt#706311, nj_heumvt#706312, nj_oldcodser#706313, nj_oldcodufl#706314, nj_numlit#706315, nj_classe#706316, nj_numper_ori#706317, nj_typorg#706318, nj_natass#706319, nj_codicd#706320, nj_motifhosp#706321, nj_type_icd#706322, nj_ver_icd#706323, nj_altvisitid#706324]
Condition : (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#706296)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#706296)), MAIN) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#706297)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#706297)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#706298)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#706298)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#706299)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#706299)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#706300)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#706300)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#706301)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#706301)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#706302)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#706302)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#706303)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#706303)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#706304)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#706304)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#706305)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#706305)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#706306)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#706306)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#706307)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#706307)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#706308)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#706308)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#706309)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#706309)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#706310)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#706310)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#706311)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#706311)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#706312)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#706312)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#706313)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#706313)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#706314)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#706314)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#706315)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#706315)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#706316)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#706316)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#706317)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#706317)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#706318)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#706318)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#706319)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#706319)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#706320)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#706320)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#706321)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#706321)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#706322)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#706322)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#706323)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#706323)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#706324)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#706324)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_A))), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_A))), MAIN) END)

(3) Project [codegen id : 1]
Output: []
Input [29]: [nj_numper#706296, nj_sigma#706297, nj_numdos#706298, nj_codser#706299, nj_codufl#706300, nj_datede#706301, nj_datefi#706302, nj_coduti#706303, nj_datmaj#706304, nj_datcre#706305, nj_nature#706306, nj_heudeb#706307, nj_heufin#706308, nj_numcha#706309, nj_codips#706310, nj_datmvt#706311, nj_heumvt#706312, nj_oldcodser#706313, nj_oldcodufl#706314, nj_numlit#706315, nj_classe#706316, nj_numper_ori#706317, nj_typorg#706318, nj_natass#706319, nj_codicd#706320, nj_motifhosp#706321, nj_type_icd#706322, nj_ver_icd#706323, nj_altvisitid#706324]

(4) Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1]  [codegen id : 2]
Output [29]: [nj_numper#706562, nj_sigma#706563, nj_numdos#706564, nj_codser#706565, nj_codufl#706566, nj_datede#706567, nj_datefi#706568, nj_coduti#706569, nj_datmaj#706570, nj_datcre#706571, nj_nature#706572, nj_heudeb#706573, nj_heufin#706574, nj_numcha#706575, nj_codips#706576, nj_datmvt#706577, nj_heumvt#706578, nj_oldcodser#706579, nj_oldcodufl#706580, nj_numlit#706581, nj_classe#706582, nj_numper_ori#706583, nj_typorg#706584, nj_natass#706585, nj_codicd#706586, nj_motifhosp#706587, nj_type_icd#706588, nj_ver_icd#706589, nj_altvisitid#706590]
ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_datede:string,nj_datefi:string,nj_coduti:string,nj_datmaj:string,nj_datcre:string,nj_nature:string,nj_heudeb:string,nj_heufin:string,nj_numcha:string,nj_codips:string,nj_datmvt:string,nj_heumvt:string,nj_oldcodser:string,nj_oldcodufl:string,nj_numlit:string,nj_classe:string,nj_numper_ori:string,nj_typorg:string,nj_natass:string,nj_codicd:string,nj_motifhosp:string,nj_type_icd:string,nj_ver_icd:string,nj_altvisitid:string>

(5) Filter [codegen id : 2]
Input [29]: [nj_numper#706562, nj_sigma#706563, nj_numdos#706564, nj_codser#706565, nj_codufl#706566, nj_datede#706567, nj_datefi#706568, nj_coduti#706569, nj_datmaj#706570, nj_datcre#706571, nj_nature#706572, nj_heudeb#706573, nj_heufin#706574, nj_numcha#706575, nj_codips#706576, nj_datmvt#706577, nj_heumvt#706578, nj_oldcodser#706579, nj_oldcodufl#706580, nj_numlit#706581, nj_classe#706582, nj_numper_ori#706583, nj_typorg#706584, nj_natass#706585, nj_codicd#706586, nj_motifhosp#706587, nj_type_icd#706588, nj_ver_icd#706589, nj_altvisitid#706590]
Condition : (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#706562)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#706562)), MAIN) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#706563)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#706563)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#706564)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#706564)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#706565)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#706565)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#706566)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#706566)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#706567)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#706567)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#706568)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#706568)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#706569)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#706569)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#706570)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#706570)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#706571)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#706571)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#706572)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#706572)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#706573)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#706573)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#706574)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#706574)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#706575)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#706575)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#706576)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#706576)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#706577)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#706577)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#706578)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#706578)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#706579)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#706579)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#706580)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#706580)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#706581)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#706581)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#706582)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#706582)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#706583)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#706583)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#706584)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#706584)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#706585)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#706585)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#706586)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#706586)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#706587)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#706587)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#706588)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#706588)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#706589)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#706589)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#706590)), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#706590)), MAIN) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_B))), MAIN)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_B))), MAIN) END)

(6) Project [codegen id : 2]
Output: []
Input [29]: [nj_numper#706562, nj_sigma#706563, nj_numdos#706564, nj_codser#706565, nj_codufl#706566, nj_datede#706567, nj_datefi#706568, nj_coduti#706569, nj_datmaj#706570, nj_datcre#706571, nj_nature#706572, nj_heudeb#706573, nj_heufin#706574, nj_numcha#706575, nj_codips#706576, nj_datmvt#706577, nj_heumvt#706578, nj_oldcodser#706579, nj_oldcodufl#706580, nj_numlit#706581, nj_classe#706582, nj_numper_ori#706583, nj_typorg#706584, nj_natass#706585, nj_codicd#706586, nj_motifhosp#706587, nj_type_icd#706588, nj_ver_icd#706589, nj_altvisitid#706590]

(7) Union

(8) HashAggregate [codegen id : 3]
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#707133L]
Results [1]: [count#707134L]

(9) Exchange
Input [1]: [count#707134L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=37982]

(10) ShuffleQueryStage
Output [1]: [count#707134L]
Arguments: 0

(11) HashAggregate [codegen id : 4]
Input [1]: [count#707134L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#707066L]
Results [1]: [count(1)#707066L AS COL_0d43aec4-9a8c-4a4d-b6e9-bf8987ff1c47#707068L]

(12) Union

(13) HashAggregate
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#707133L]
Results [1]: [count#707134L]

(14) Exchange
Input [1]: [count#707134L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=37962]

(15) HashAggregate
Input [1]: [count#707134L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#707066L]
Results [1]: [count(1)#707066L AS COL_0d43aec4-9a8c-4a4d-b6e9-bf8987ff1c47#707068L]

(16) AdaptiveSparkPlan
Output [1]: [COL_0d43aec4-9a8c-4a4d-b6e9-bf8987ff1c47#707068L]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet