hdh-spark-job - Details for Query 1293

Submitted Time: 2026/10/23 13:26:26
Duration: 4 s
Succeeded Jobs: 1294 1300

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: 0 ms"; 2 [labelType="html" label="HashAggregate time in aggregation build: 0 ms number of output rows: 1"]; } 3 [labelType="html" label="Exchange shuffle records written: 2 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1862.0: task 1620)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 2 local bytes read: 112.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 2 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 32.0 B (16.0 B, 16.0 B, 16.0 B (stage 1862.0: task 1619)) local merged bytes read: 0.0 B number of partitions: 1 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 112.0 B (56.0 B, 56.0 B, 56.0 B (stage 1862.0: task 1619))"]; subgraph cluster4 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: total (min, med, max (stageId: taskId))\n3.3 s (1.6 s, 1.7 s, 1.7 s (stage 1862.0: task 1620))"; 5 [labelType="html" label="HashAggregate time in aggregation build total (min, med, max (stageId: taskId)) 3.3 s (1.6 s, 1.7 s, 1.7 s (stage 1862.0: task 1620)) number of output rows: 2"]; } 6 [labelType="html" label=" Union "]; subgraph cluster7 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 1.6 s"; 8 [labelType="html" label=" Project "]; 9 [labelType="html" label="Filter number of output rows: 0"]; 10 [labelType="html" label="Scan JDBCRelation((SELECT \"nj_numper\", \"nj_sigma\", \"nj_numdos\", \"nj_codser\", \"nj_codufl\", \"nj_datede\", \"nj_datefi\", \"nj_coduti\", \"nj_datmaj\", \"nj_datcre\", \"nj_nature\", \"nj_heudeb\", \"nj_heufin\", \"nj_numcha\", \"nj_codips\", \"nj_datmvt\", \"nj_heumvt\", \"nj_oldcodser\", \"nj_oldcodufl\", \"nj_numlit\", \"nj_classe\", \"nj_numper_ori\", \"nj_typorg\", \"nj_natass\", \"nj_codicd\", \"nj_motifhosp\", \"nj_type_icd\", \"nj_ver_icd\", \"nj_altvisitid\" FROM \"xplore\".\"h_numsej\") as x) [numPartitions=1] number of output rows: 70,896"]; } subgraph cluster11 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: 1.7 s"; 12 [labelType="html" label=" Project "]; 13 [labelType="html" label="Filter number of output rows: 0"]; 14 [labelType="html" label="Scan JDBCRelation((SELECT \"nj_numper\", \"nj_sigma\", \"nj_numdos\", \"nj_codser\", \"nj_codufl\", \"nj_datede\", \"nj_datefi\", \"nj_coduti\", \"nj_datmaj\", \"nj_datcre\", \"nj_nature\", \"nj_heudeb\", \"nj_heufin\", \"nj_numcha\", \"nj_codips\", \"nj_datmvt\", \"nj_heumvt\", \"nj_oldcodser\", \"nj_oldcodufl\", \"nj_numlit\", \"nj_classe\", \"nj_numper_ori\", \"nj_typorg\", \"nj_natass\", \"nj_codicd\", \"nj_motifhosp\", \"nj_type_icd\", \"nj_ver_icd\", \"nj_altvisitid\" FROM \"xplore2\".\"h_numsej\") as x) [numPartitions=1] number of output rows: 70,896"]; } 2->0; 3->2; 5->3; 6->5; 8->6; 9->8; 10->9; 12->6; 13->12; 14->13; }

AdaptiveSparkPlan isFinalPlan=true

HashAggregate(keys=[], functions=[count(1)])

WholeStageCodegen (4)

Exchange SinglePartition, ENSURE_REQUIREMENTS, [plan_id=34248]

HashAggregate(keys=[], functions=[partial_count(1)])

WholeStageCodegen (3)

Union

Project

Filter (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#629077)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#629077)), MARX) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#629078)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#629078)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#629079)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#629079)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#629080)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#629080)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#629081)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#629081)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#629082)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#629082)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#629083)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#629083)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#629084)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#629084)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#629085)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#629085)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#629086)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#629086)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#629087)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#629087)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#629088)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#629088)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#629089)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#629089)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#629090)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#629090)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#629091)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#629091)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#629092)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#629092)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#629093)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#629093)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#629094)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#629094)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#629095)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#629095)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#629096)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#629096)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#629097)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#629097)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#629098)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#629098)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#629099)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#629099)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#629100)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#629100)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#629101)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#629101)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#629102)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#629102)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#629103)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#629103)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#629104)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#629104)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#629105)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#629105)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_A))), MARX)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_A))), MARX) END)

Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1] [nj_numper#629077,nj_sigma#629078,nj_numdos#629079,nj_codser#629080,nj_codufl#629081,nj_datede#629082,nj_datefi#629083,nj_coduti#629084,nj_datmaj#629085,nj_datcre#629086,nj_nature#629087,nj_heudeb#629088,nj_heufin#629089,nj_numcha#629090,nj_codips#629091,nj_datmvt#629092,nj_heumvt#629093,nj_oldcodser#629094,nj_oldcodufl#629095,nj_numlit#629096,nj_classe#629097,nj_numper_ori#629098,nj_typorg#629099,nj_natass#629100,... 5 more fields] PushedFilters: [], ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_dat...

WholeStageCodegen (1)

Project

Filter (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#629533)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#629533)), MARX) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#629534)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#629534)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#629535)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#629535)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#629536)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#629536)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#629537)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#629537)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#629538)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#629538)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#629539)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#629539)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#629540)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#629540)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#629541)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#629541)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#629542)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#629542)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#629543)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#629543)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#629544)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#629544)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#629545)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#629545)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#629546)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#629546)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#629547)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#629547)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#629548)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#629548)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#629549)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#629549)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#629550)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#629550)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#629551)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#629551)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#629552)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#629552)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#629553)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#629553)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#629554)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#629554)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#629555)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#629555)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#629556)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#629556)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#629557)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#629557)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#629558)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#629558)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#629559)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#629559)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#629560)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#629560)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#629561)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#629561)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_B))), MARX)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_B))), MARX) END)

Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1] [nj_numper#629533,nj_sigma#629534,nj_numdos#629535,nj_codser#629536,nj_codufl#629537,nj_datede#629538,nj_datefi#629539,nj_coduti#629540,nj_datmaj#629541,nj_datcre#629542,nj_nature#629543,nj_heudeb#629544,nj_heufin#629545,nj_numcha#629546,nj_codips#629547,nj_datmvt#629548,nj_heumvt#629549,nj_oldcodser#629550,nj_oldcodufl#629551,nj_numlit#629552,nj_classe#629553,nj_numper_ori#629554,nj_typorg#629555,nj_natass#629556,... 5 more fields] PushedFilters: [], ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_dat...

WholeStageCodegen (2)

Details

== Physical Plan ==
AdaptiveSparkPlan (16)
+- == Final Plan ==
   * HashAggregate (11)
   +- ShuffleQueryStage (10), Statistics(sizeInBytes=32.0 B, rowCount=2)
      +- Exchange (9)
         +- * HashAggregate (8)
            +- Union (7)
               :- * Project (3)
               :  +- * Filter (2)
               :     +- * Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1]  (1)
               +- * Project (6)
                  +- * Filter (5)
                     +- * Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1]  (4)
+- == Initial Plan ==
   HashAggregate (15)
   +- Exchange (14)
      +- HashAggregate (13)
         +- Union (12)
            :- Project (3)
            :  +- Filter (2)
            :     +- Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1]  (1)
            +- Project (6)
               +- Filter (5)
                  +- Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1]  (4)


(1) Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore"."h_numsej") as x) [numPartitions=1]  [codegen id : 1]
Output [29]: [nj_numper#629077, nj_sigma#629078, nj_numdos#629079, nj_codser#629080, nj_codufl#629081, nj_datede#629082, nj_datefi#629083, nj_coduti#629084, nj_datmaj#629085, nj_datcre#629086, nj_nature#629087, nj_heudeb#629088, nj_heufin#629089, nj_numcha#629090, nj_codips#629091, nj_datmvt#629092, nj_heumvt#629093, nj_oldcodser#629094, nj_oldcodufl#629095, nj_numlit#629096, nj_classe#629097, nj_numper_ori#629098, nj_typorg#629099, nj_natass#629100, nj_codicd#629101, nj_motifhosp#629102, nj_type_icd#629103, nj_ver_icd#629104, nj_altvisitid#629105]
ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_datede:string,nj_datefi:string,nj_coduti:string,nj_datmaj:string,nj_datcre:string,nj_nature:string,nj_heudeb:string,nj_heufin:string,nj_numcha:string,nj_codips:string,nj_datmvt:string,nj_heumvt:string,nj_oldcodser:string,nj_oldcodufl:string,nj_numlit:string,nj_classe:string,nj_numper_ori:string,nj_typorg:string,nj_natass:string,nj_codicd:string,nj_motifhosp:string,nj_type_icd:string,nj_ver_icd:string,nj_altvisitid:string>

(2) Filter [codegen id : 1]
Input [29]: [nj_numper#629077, nj_sigma#629078, nj_numdos#629079, nj_codser#629080, nj_codufl#629081, nj_datede#629082, nj_datefi#629083, nj_coduti#629084, nj_datmaj#629085, nj_datcre#629086, nj_nature#629087, nj_heudeb#629088, nj_heufin#629089, nj_numcha#629090, nj_codips#629091, nj_datmvt#629092, nj_heumvt#629093, nj_oldcodser#629094, nj_oldcodufl#629095, nj_numlit#629096, nj_classe#629097, nj_numper_ori#629098, nj_typorg#629099, nj_natass#629100, nj_codicd#629101, nj_motifhosp#629102, nj_type_icd#629103, nj_ver_icd#629104, nj_altvisitid#629105]
Condition : (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#629077)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#629077)), MARX) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#629078)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#629078)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#629079)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#629079)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#629080)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#629080)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#629081)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#629081)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#629082)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#629082)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#629083)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#629083)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#629084)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#629084)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#629085)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#629085)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#629086)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#629086)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#629087)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#629087)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#629088)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#629088)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#629089)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#629089)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#629090)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#629090)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#629091)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#629091)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#629092)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#629092)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#629093)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#629093)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#629094)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#629094)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#629095)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#629095)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#629096)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#629096)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#629097)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#629097)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#629098)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#629098)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#629099)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#629099)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#629100)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#629100)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#629101)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#629101)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#629102)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#629102)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#629103)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#629103)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#629104)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#629104)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#629105)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#629105)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_A))), MARX)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_A))), MARX) END)

(3) Project [codegen id : 1]
Output: []
Input [29]: [nj_numper#629077, nj_sigma#629078, nj_numdos#629079, nj_codser#629080, nj_codufl#629081, nj_datede#629082, nj_datefi#629083, nj_coduti#629084, nj_datmaj#629085, nj_datcre#629086, nj_nature#629087, nj_heudeb#629088, nj_heufin#629089, nj_numcha#629090, nj_codips#629091, nj_datmvt#629092, nj_heumvt#629093, nj_oldcodser#629094, nj_oldcodufl#629095, nj_numlit#629096, nj_classe#629097, nj_numper_ori#629098, nj_typorg#629099, nj_natass#629100, nj_codicd#629101, nj_motifhosp#629102, nj_type_icd#629103, nj_ver_icd#629104, nj_altvisitid#629105]

(4) Scan JDBCRelation((SELECT "nj_numper", "nj_sigma", "nj_numdos", "nj_codser", "nj_codufl", "nj_datede", "nj_datefi", "nj_coduti", "nj_datmaj", "nj_datcre", "nj_nature", "nj_heudeb", "nj_heufin", "nj_numcha", "nj_codips", "nj_datmvt", "nj_heumvt", "nj_oldcodser", "nj_oldcodufl", "nj_numlit", "nj_classe", "nj_numper_ori", "nj_typorg", "nj_natass", "nj_codicd", "nj_motifhosp", "nj_type_icd", "nj_ver_icd", "nj_altvisitid" FROM "xplore2"."h_numsej") as x) [numPartitions=1]  [codegen id : 2]
Output [29]: [nj_numper#629533, nj_sigma#629534, nj_numdos#629535, nj_codser#629536, nj_codufl#629537, nj_datede#629538, nj_datefi#629539, nj_coduti#629540, nj_datmaj#629541, nj_datcre#629542, nj_nature#629543, nj_heudeb#629544, nj_heufin#629545, nj_numcha#629546, nj_codips#629547, nj_datmvt#629548, nj_heumvt#629549, nj_oldcodser#629550, nj_oldcodufl#629551, nj_numlit#629552, nj_classe#629553, nj_numper_ori#629554, nj_typorg#629555, nj_natass#629556, nj_codicd#629557, nj_motifhosp#629558, nj_type_icd#629559, nj_ver_icd#629560, nj_altvisitid#629561]
ReadSchema: struct<nj_numper:string,nj_sigma:string,nj_numdos:string,nj_codser:string,nj_codufl:string,nj_datede:string,nj_datefi:string,nj_coduti:string,nj_datmaj:string,nj_datcre:string,nj_nature:string,nj_heudeb:string,nj_heufin:string,nj_numcha:string,nj_codips:string,nj_datmvt:string,nj_heumvt:string,nj_oldcodser:string,nj_oldcodufl:string,nj_numlit:string,nj_classe:string,nj_numper_ori:string,nj_typorg:string,nj_natass:string,nj_codicd:string,nj_motifhosp:string,nj_type_icd:string,nj_ver_icd:string,nj_altvisitid:string>

(5) Filter [codegen id : 2]
Input [29]: [nj_numper#629533, nj_sigma#629534, nj_numdos#629535, nj_codser#629536, nj_codufl#629537, nj_datede#629538, nj_datefi#629539, nj_coduti#629540, nj_datmaj#629541, nj_datcre#629542, nj_nature#629543, nj_heudeb#629544, nj_heufin#629545, nj_numcha#629546, nj_codips#629547, nj_datmvt#629548, nj_heumvt#629549, nj_oldcodser#629550, nj_oldcodufl#629551, nj_numlit#629552, nj_classe#629553, nj_numper_ori#629554, nj_typorg#629555, nj_natass#629556, nj_codicd#629557, nj_motifhosp#629558, nj_type_icd#629559, nj_ver_icd#629560, nj_altvisitid#629561]
Condition : (((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper#629533)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper#629533)), MARX) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_sigma#629534)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_sigma#629534)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numdos#629535)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numdos#629535)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codser#629536)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codser#629536)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codufl#629537)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codufl#629537)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datede#629538)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datede#629538)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datefi#629539)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datefi#629539)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_coduti#629540)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_coduti#629540)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmaj#629541)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmaj#629541)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datcre#629542)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datcre#629542)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_nature#629543)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_nature#629543)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heudeb#629544)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_heudeb#629544)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heufin#629545)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_heufin#629545)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numcha#629546)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numcha#629546)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codips#629547)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codips#629547)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_datmvt#629548)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_datmvt#629548)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_heumvt#629549)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_heumvt#629549)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodser#629550)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodser#629550)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_oldcodufl#629551)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_oldcodufl#629551)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numlit#629552)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numlit#629552)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_classe#629553)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_classe#629553)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_numper_ori#629554)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_numper_ori#629554)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_typorg#629555)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_typorg#629555)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_natass#629556)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_natass#629556)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_codicd#629557)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_codicd#629557)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_motifhosp#629558)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_motifhosp#629558)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_type_icd#629559)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_type_icd#629559)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_ver_icd#629560)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_ver_icd#629560)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(nj_altvisitid#629561)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(nj_altvisitid#629561)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_B))), MARX)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_B))), MARX) END)

(6) Project [codegen id : 2]
Output: []
Input [29]: [nj_numper#629533, nj_sigma#629534, nj_numdos#629535, nj_codser#629536, nj_codufl#629537, nj_datede#629538, nj_datefi#629539, nj_coduti#629540, nj_datmaj#629541, nj_datcre#629542, nj_nature#629543, nj_heudeb#629544, nj_heufin#629545, nj_numcha#629546, nj_codips#629547, nj_datmvt#629548, nj_heumvt#629549, nj_oldcodser#629550, nj_oldcodufl#629551, nj_numlit#629552, nj_classe#629553, nj_numper_ori#629554, nj_typorg#629555, nj_natass#629556, nj_codicd#629557, nj_motifhosp#629558, nj_type_icd#629559, nj_ver_icd#629560, nj_altvisitid#629561]

(7) Union

(8) HashAggregate [codegen id : 3]
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#630501L]
Results [1]: [count#630502L]

(9) Exchange
Input [1]: [count#630502L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=34248]

(10) ShuffleQueryStage
Output [1]: [count#630502L]
Arguments: 0

(11) HashAggregate [codegen id : 4]
Input [1]: [count#630502L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#630273L]
Results [1]: [count(1)#630273L AS COL_a0f59625-63a9-4b30-94af-cc90a776d03f#630275L]

(12) Union

(13) HashAggregate
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#630501L]
Results [1]: [count#630502L]

(14) Exchange
Input [1]: [count#630502L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=34228]

(15) HashAggregate
Input [1]: [count#630502L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#630273L]
Results [1]: [count(1)#630273L AS COL_a0f59625-63a9-4b30-94af-cc90a776d03f#630275L]

(16) AdaptiveSparkPlan
Output [1]: [COL_a0f59625-63a9-4b30-94af-cc90a776d03f#630275L]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet