hdh-spark-job - Details for Query 1296

Submitted Time: 2026/10/23 13:26:27
Duration: 4 s
Succeeded Jobs: 1296 1301

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: 0 ms"; 2 [labelType="html" label="HashAggregate time in aggregation build: 0 ms number of output rows: 1"]; } 3 [labelType="html" label="Exchange shuffle records written: 2 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 1864.0: task 1624)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 2 local bytes read: 118.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 2 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 32.0 B (16.0 B, 16.0 B, 16.0 B (stage 1864.0: task 1624)) local merged bytes read: 0.0 B number of partitions: 1 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 118.0 B (59.0 B, 59.0 B, 59.0 B (stage 1864.0: task 1624))"]; subgraph cluster4 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: total (min, med, max (stageId: taskId))\n763 ms (374 ms, 389 ms, 389 ms (stage 1864.0: task 1623))"; 5 [labelType="html" label="HashAggregate time in aggregation build total (min, med, max (stageId: taskId)) 762 ms (374 ms, 388 ms, 388 ms (stage 1864.0: task 1623)) number of output rows: 2"]; } 6 [labelType="html" label=" Union "]; subgraph cluster7 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 389 ms"; 8 [labelType="html" label=" Project "]; 9 [labelType="html" label="Filter number of output rows: 180"]; 10 [labelType="html" label="Scan JDBCRelation((SELECT \"jn_numjou\", \"jn_action\", \"jn_typjou\", \"jn_table\", \"jn_datjou\", \"jn_heujou\", \"jn_codper\", \"jn_numdos\", \"jn_numdem\", \"jn_numexa\", \"jn_numdrv\", \"jn_numcr\", \"jn_numfus\", \"jn_comment\", \"jn_codsit\", \"jn_xmldata\", \"jn_prg_code\", \"jn_terminal\", \"jn_osuser\", \"jn_ip_address\", \"jn_flenv\", \"jn_datenv\", \"jn_nument\", \"jn_numstu\", \"jn_numser\", \"jn_numima\", \"jn_numrb\", \"jn_dursec\" FROM \"xplore\".\"h_journal\") as x) [numPartitions=1] number of output rows: 8,765"]; } subgraph cluster11 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: 374 ms"; 12 [labelType="html" label=" Project "]; 13 [labelType="html" label="Filter number of output rows: 180"]; 14 [labelType="html" label="Scan JDBCRelation((SELECT \"jn_numjou\", \"jn_action\", \"jn_typjou\", \"jn_table\", \"jn_datjou\", \"jn_heujou\", \"jn_codper\", \"jn_numdos\", \"jn_numdem\", \"jn_numexa\", \"jn_numdrv\", \"jn_numcr\", \"jn_numfus\", \"jn_comment\", \"jn_codsit\", \"jn_xmldata\", \"jn_prg_code\", \"jn_terminal\", \"jn_osuser\", \"jn_ip_address\", \"jn_flenv\", \"jn_datenv\", \"jn_nument\", \"jn_numstu\", \"jn_numser\", \"jn_numima\", \"jn_numrb\", \"jn_dursec\" FROM \"xplore2\".\"h_journal\") as x) [numPartitions=1] number of output rows: 8,765"]; } 2->0; 3->2; 5->3; 6->5; 8->6; 9->8; 10->9; 12->6; 13->12; 14->13; }

AdaptiveSparkPlan isFinalPlan=true

HashAggregate(keys=[], functions=[count(1)])

WholeStageCodegen (4)

Exchange SinglePartition, ENSURE_REQUIREMENTS, [plan_id=34414]

HashAggregate(keys=[], functions=[partial_count(1)])

WholeStageCodegen (3)

Union

Project

Filter ((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numjou#630531)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numjou#630531)), MARX) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_action#630532)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_action#630532)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_typjou#630533)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_typjou#630533)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_table#630534)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_table#630534)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_datjou#630535)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_datjou#630535)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_heujou#630536)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_heujou#630536)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_codper#630537)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_codper#630537)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numdos#630538)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numdos#630538)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numdem#630539)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numdem#630539)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numexa#630540)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numexa#630540)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numdrv#630541)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numdrv#630541)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numcr#630542)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numcr#630542)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numfus#630543)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numfus#630543)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_comment#630544)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_comment#630544)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_codsit#630545)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_codsit#630545)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_xmldata#630546)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_xmldata#630546)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_prg_code#630547)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_prg_code#630547)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_terminal#630548)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_terminal#630548)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_osuser#630549)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_osuser#630549)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_ip_address#630550)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_ip_address#630550)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_flenv#630551)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_flenv#630551)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_datenv#630552)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_datenv#630552)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_nument#630553)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_nument#630553)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numstu#630554)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numstu#630554)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numser#630555)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numser#630555)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numima#630556)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numima#630556)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numrb#630557)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numrb#630557)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_dursec#630558)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_dursec#630558)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_A))), MARX)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_A))), MARX) END)

Scan JDBCRelation((SELECT "jn_numjou", "jn_action", "jn_typjou", "jn_table", "jn_datjou", "jn_heujou", "jn_codper", "jn_numdos", "jn_numdem", "jn_numexa", "jn_numdrv", "jn_numcr", "jn_numfus", "jn_comment", "jn_codsit", "jn_xmldata", "jn_prg_code", "jn_terminal", "jn_osuser", "jn_ip_address", "jn_flenv", "jn_datenv", "jn_nument", "jn_numstu", "jn_numser", "jn_numima", "jn_numrb", "jn_dursec" FROM "xplore"."h_journal") as x) [numPartitions=1] [jn_numjou#630531,jn_action#630532,jn_typjou#630533,jn_table#630534,jn_datjou#630535,jn_heujou#630536,jn_codper#630537,jn_numdos#630538,jn_numdem#630539,jn_numexa#630540,jn_numdrv#630541,jn_numcr#630542,jn_numfus#630543,jn_comment#630544,jn_codsit#630545,jn_xmldata#630546,jn_prg_code#630547,jn_terminal#630548,jn_osuser#630549,jn_ip_address#630550,jn_flenv#630551,jn_datenv#630552,jn_nument#630553,jn_numstu#630554,... 4 more fields] PushedFilters: [], ReadSchema: struct<jn_numjou:string,jn_action:string,jn_typjou:string,jn_table:string,jn_datjou:string,jn_heu...

WholeStageCodegen (1)

Project

Filter ((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numjou#630786)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numjou#630786)), MARX) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_action#630787)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_action#630787)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_typjou#630788)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_typjou#630788)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_table#630789)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_table#630789)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_datjou#630790)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_datjou#630790)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_heujou#630791)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_heujou#630791)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_codper#630792)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_codper#630792)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numdos#630793)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numdos#630793)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numdem#630794)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numdem#630794)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numexa#630795)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numexa#630795)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numdrv#630796)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numdrv#630796)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numcr#630797)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numcr#630797)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numfus#630798)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numfus#630798)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_comment#630799)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_comment#630799)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_codsit#630800)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_codsit#630800)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_xmldata#630801)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_xmldata#630801)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_prg_code#630802)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_prg_code#630802)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_terminal#630803)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_terminal#630803)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_osuser#630804)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_osuser#630804)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_ip_address#630805)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_ip_address#630805)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_flenv#630806)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_flenv#630806)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_datenv#630807)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_datenv#630807)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_nument#630808)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_nument#630808)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numstu#630809)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numstu#630809)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numser#630810)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numser#630810)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numima#630811)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numima#630811)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numrb#630812)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numrb#630812)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_dursec#630813)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_dursec#630813)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_B))), MARX)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_B))), MARX) END)

Scan JDBCRelation((SELECT "jn_numjou", "jn_action", "jn_typjou", "jn_table", "jn_datjou", "jn_heujou", "jn_codper", "jn_numdos", "jn_numdem", "jn_numexa", "jn_numdrv", "jn_numcr", "jn_numfus", "jn_comment", "jn_codsit", "jn_xmldata", "jn_prg_code", "jn_terminal", "jn_osuser", "jn_ip_address", "jn_flenv", "jn_datenv", "jn_nument", "jn_numstu", "jn_numser", "jn_numima", "jn_numrb", "jn_dursec" FROM "xplore2"."h_journal") as x) [numPartitions=1] [jn_numjou#630786,jn_action#630787,jn_typjou#630788,jn_table#630789,jn_datjou#630790,jn_heujou#630791,jn_codper#630792,jn_numdos#630793,jn_numdem#630794,jn_numexa#630795,jn_numdrv#630796,jn_numcr#630797,jn_numfus#630798,jn_comment#630799,jn_codsit#630800,jn_xmldata#630801,jn_prg_code#630802,jn_terminal#630803,jn_osuser#630804,jn_ip_address#630805,jn_flenv#630806,jn_datenv#630807,jn_nument#630808,jn_numstu#630809,... 4 more fields] PushedFilters: [], ReadSchema: struct<jn_numjou:string,jn_action:string,jn_typjou:string,jn_table:string,jn_datjou:string,jn_heu...

WholeStageCodegen (2)

Details

== Physical Plan ==
AdaptiveSparkPlan (16)
+- == Final Plan ==
   * HashAggregate (11)
   +- ShuffleQueryStage (10), Statistics(sizeInBytes=32.0 B, rowCount=2)
      +- Exchange (9)
         +- * HashAggregate (8)
            +- Union (7)
               :- * Project (3)
               :  +- * Filter (2)
               :     +- * Scan JDBCRelation((SELECT "jn_numjou", "jn_action", "jn_typjou", "jn_table", "jn_datjou", "jn_heujou", "jn_codper", "jn_numdos", "jn_numdem", "jn_numexa", "jn_numdrv", "jn_numcr", "jn_numfus", "jn_comment", "jn_codsit", "jn_xmldata", "jn_prg_code", "jn_terminal", "jn_osuser", "jn_ip_address", "jn_flenv", "jn_datenv", "jn_nument", "jn_numstu", "jn_numser", "jn_numima", "jn_numrb", "jn_dursec" FROM "xplore"."h_journal") as x) [numPartitions=1]  (1)
               +- * Project (6)
                  +- * Filter (5)
                     +- * Scan JDBCRelation((SELECT "jn_numjou", "jn_action", "jn_typjou", "jn_table", "jn_datjou", "jn_heujou", "jn_codper", "jn_numdos", "jn_numdem", "jn_numexa", "jn_numdrv", "jn_numcr", "jn_numfus", "jn_comment", "jn_codsit", "jn_xmldata", "jn_prg_code", "jn_terminal", "jn_osuser", "jn_ip_address", "jn_flenv", "jn_datenv", "jn_nument", "jn_numstu", "jn_numser", "jn_numima", "jn_numrb", "jn_dursec" FROM "xplore2"."h_journal") as x) [numPartitions=1]  (4)
+- == Initial Plan ==
   HashAggregate (15)
   +- Exchange (14)
      +- HashAggregate (13)
         +- Union (12)
            :- Project (3)
            :  +- Filter (2)
            :     +- Scan JDBCRelation((SELECT "jn_numjou", "jn_action", "jn_typjou", "jn_table", "jn_datjou", "jn_heujou", "jn_codper", "jn_numdos", "jn_numdem", "jn_numexa", "jn_numdrv", "jn_numcr", "jn_numfus", "jn_comment", "jn_codsit", "jn_xmldata", "jn_prg_code", "jn_terminal", "jn_osuser", "jn_ip_address", "jn_flenv", "jn_datenv", "jn_nument", "jn_numstu", "jn_numser", "jn_numima", "jn_numrb", "jn_dursec" FROM "xplore"."h_journal") as x) [numPartitions=1]  (1)
            +- Project (6)
               +- Filter (5)
                  +- Scan JDBCRelation((SELECT "jn_numjou", "jn_action", "jn_typjou", "jn_table", "jn_datjou", "jn_heujou", "jn_codper", "jn_numdos", "jn_numdem", "jn_numexa", "jn_numdrv", "jn_numcr", "jn_numfus", "jn_comment", "jn_codsit", "jn_xmldata", "jn_prg_code", "jn_terminal", "jn_osuser", "jn_ip_address", "jn_flenv", "jn_datenv", "jn_nument", "jn_numstu", "jn_numser", "jn_numima", "jn_numrb", "jn_dursec" FROM "xplore2"."h_journal") as x) [numPartitions=1]  (4)


(1) Scan JDBCRelation((SELECT "jn_numjou", "jn_action", "jn_typjou", "jn_table", "jn_datjou", "jn_heujou", "jn_codper", "jn_numdos", "jn_numdem", "jn_numexa", "jn_numdrv", "jn_numcr", "jn_numfus", "jn_comment", "jn_codsit", "jn_xmldata", "jn_prg_code", "jn_terminal", "jn_osuser", "jn_ip_address", "jn_flenv", "jn_datenv", "jn_nument", "jn_numstu", "jn_numser", "jn_numima", "jn_numrb", "jn_dursec" FROM "xplore"."h_journal") as x) [numPartitions=1]  [codegen id : 1]
Output [28]: [jn_numjou#630531, jn_action#630532, jn_typjou#630533, jn_table#630534, jn_datjou#630535, jn_heujou#630536, jn_codper#630537, jn_numdos#630538, jn_numdem#630539, jn_numexa#630540, jn_numdrv#630541, jn_numcr#630542, jn_numfus#630543, jn_comment#630544, jn_codsit#630545, jn_xmldata#630546, jn_prg_code#630547, jn_terminal#630548, jn_osuser#630549, jn_ip_address#630550, jn_flenv#630551, jn_datenv#630552, jn_nument#630553, jn_numstu#630554, jn_numser#630555, jn_numima#630556, jn_numrb#630557, jn_dursec#630558]
ReadSchema: struct<jn_numjou:string,jn_action:string,jn_typjou:string,jn_table:string,jn_datjou:string,jn_heujou:string,jn_codper:string,jn_numdos:string,jn_numdem:string,jn_numexa:string,jn_numdrv:string,jn_numcr:string,jn_numfus:string,jn_comment:string,jn_codsit:string,jn_xmldata:string,jn_prg_code:string,jn_terminal:string,jn_osuser:string,jn_ip_address:string,jn_flenv:string,jn_datenv:string,jn_nument:string,jn_numstu:string,jn_numser:string,jn_numima:string,jn_numrb:string,jn_dursec:string>

(2) Filter [codegen id : 1]
Input [28]: [jn_numjou#630531, jn_action#630532, jn_typjou#630533, jn_table#630534, jn_datjou#630535, jn_heujou#630536, jn_codper#630537, jn_numdos#630538, jn_numdem#630539, jn_numexa#630540, jn_numdrv#630541, jn_numcr#630542, jn_numfus#630543, jn_comment#630544, jn_codsit#630545, jn_xmldata#630546, jn_prg_code#630547, jn_terminal#630548, jn_osuser#630549, jn_ip_address#630550, jn_flenv#630551, jn_datenv#630552, jn_nument#630553, jn_numstu#630554, jn_numser#630555, jn_numima#630556, jn_numrb#630557, jn_dursec#630558]
Condition : ((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numjou#630531)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numjou#630531)), MARX) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_action#630532)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_action#630532)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_typjou#630533)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_typjou#630533)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_table#630534)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_table#630534)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_datjou#630535)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_datjou#630535)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_heujou#630536)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_heujou#630536)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_codper#630537)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_codper#630537)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numdos#630538)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numdos#630538)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numdem#630539)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numdem#630539)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numexa#630540)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numexa#630540)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numdrv#630541)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numdrv#630541)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numcr#630542)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numcr#630542)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numfus#630543)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numfus#630543)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_comment#630544)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_comment#630544)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_codsit#630545)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_codsit#630545)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_xmldata#630546)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_xmldata#630546)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_prg_code#630547)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_prg_code#630547)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_terminal#630548)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_terminal#630548)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_osuser#630549)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_osuser#630549)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_ip_address#630550)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_ip_address#630550)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_flenv#630551)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_flenv#630551)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_datenv#630552)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_datenv#630552)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_nument#630553)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_nument#630553)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numstu#630554)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numstu#630554)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numser#630555)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numser#630555)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numima#630556)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numima#630556)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numrb#630557)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numrb#630557)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_dursec#630558)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_dursec#630558)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_A))), MARX)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_A))), MARX) END)

(3) Project [codegen id : 1]
Output: []
Input [28]: [jn_numjou#630531, jn_action#630532, jn_typjou#630533, jn_table#630534, jn_datjou#630535, jn_heujou#630536, jn_codper#630537, jn_numdos#630538, jn_numdem#630539, jn_numexa#630540, jn_numdrv#630541, jn_numcr#630542, jn_numfus#630543, jn_comment#630544, jn_codsit#630545, jn_xmldata#630546, jn_prg_code#630547, jn_terminal#630548, jn_osuser#630549, jn_ip_address#630550, jn_flenv#630551, jn_datenv#630552, jn_nument#630553, jn_numstu#630554, jn_numser#630555, jn_numima#630556, jn_numrb#630557, jn_dursec#630558]

(4) Scan JDBCRelation((SELECT "jn_numjou", "jn_action", "jn_typjou", "jn_table", "jn_datjou", "jn_heujou", "jn_codper", "jn_numdos", "jn_numdem", "jn_numexa", "jn_numdrv", "jn_numcr", "jn_numfus", "jn_comment", "jn_codsit", "jn_xmldata", "jn_prg_code", "jn_terminal", "jn_osuser", "jn_ip_address", "jn_flenv", "jn_datenv", "jn_nument", "jn_numstu", "jn_numser", "jn_numima", "jn_numrb", "jn_dursec" FROM "xplore2"."h_journal") as x) [numPartitions=1]  [codegen id : 2]
Output [28]: [jn_numjou#630786, jn_action#630787, jn_typjou#630788, jn_table#630789, jn_datjou#630790, jn_heujou#630791, jn_codper#630792, jn_numdos#630793, jn_numdem#630794, jn_numexa#630795, jn_numdrv#630796, jn_numcr#630797, jn_numfus#630798, jn_comment#630799, jn_codsit#630800, jn_xmldata#630801, jn_prg_code#630802, jn_terminal#630803, jn_osuser#630804, jn_ip_address#630805, jn_flenv#630806, jn_datenv#630807, jn_nument#630808, jn_numstu#630809, jn_numser#630810, jn_numima#630811, jn_numrb#630812, jn_dursec#630813]
ReadSchema: struct<jn_numjou:string,jn_action:string,jn_typjou:string,jn_table:string,jn_datjou:string,jn_heujou:string,jn_codper:string,jn_numdos:string,jn_numdem:string,jn_numexa:string,jn_numdrv:string,jn_numcr:string,jn_numfus:string,jn_comment:string,jn_codsit:string,jn_xmldata:string,jn_prg_code:string,jn_terminal:string,jn_osuser:string,jn_ip_address:string,jn_flenv:string,jn_datenv:string,jn_nument:string,jn_numstu:string,jn_numser:string,jn_numima:string,jn_numrb:string,jn_dursec:string>

(5) Filter [codegen id : 2]
Input [28]: [jn_numjou#630786, jn_action#630787, jn_typjou#630788, jn_table#630789, jn_datjou#630790, jn_heujou#630791, jn_codper#630792, jn_numdos#630793, jn_numdem#630794, jn_numexa#630795, jn_numdrv#630796, jn_numcr#630797, jn_numfus#630798, jn_comment#630799, jn_codsit#630800, jn_xmldata#630801, jn_prg_code#630802, jn_terminal#630803, jn_osuser#630804, jn_ip_address#630805, jn_flenv#630806, jn_datenv#630807, jn_nument#630808, jn_numstu#630809, jn_numser#630810, jn_numima#630811, jn_numrb#630812, jn_dursec#630813]
Condition : ((((((((((((((((((((((((((((CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numjou#630786)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numjou#630786)), MARX) END OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_action#630787)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_action#630787)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_typjou#630788)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_typjou#630788)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_table#630789)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_table#630789)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_datjou#630790)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_datjou#630790)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_heujou#630791)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_heujou#630791)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_codper#630792)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_codper#630792)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numdos#630793)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numdos#630793)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numdem#630794)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numdem#630794)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numexa#630795)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numexa#630795)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numdrv#630796)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numdrv#630796)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numcr#630797)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numcr#630797)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numfus#630798)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numfus#630798)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_comment#630799)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_comment#630799)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_codsit#630800)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_codsit#630800)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_xmldata#630801)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_xmldata#630801)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_prg_code#630802)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_prg_code#630802)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_terminal#630803)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_terminal#630803)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_osuser#630804)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_osuser#630804)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_ip_address#630805)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_ip_address#630805)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_flenv#630806)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_flenv#630806)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_datenv#630807)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_datenv#630807)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_nument#630808)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_nument#630808)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numstu#630809)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numstu#630809)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numser#630810)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numser#630810)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numima#630811)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numima#630811)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_numrb#630812)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_numrb#630812)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(jn_dursec#630813)), MARX)) THEN false ELSE Contains(str_remove_accent(upper(jn_dursec#630813)), MARX) END) OR CASE WHEN isnull(Contains(str_remove_accent(upper(str_create(Cab_B))), MARX)) THEN false ELSE Contains(str_remove_accent(upper(str_create(Cab_B))), MARX) END)

(6) Project [codegen id : 2]
Output: []
Input [28]: [jn_numjou#630786, jn_action#630787, jn_typjou#630788, jn_table#630789, jn_datjou#630790, jn_heujou#630791, jn_codper#630792, jn_numdos#630793, jn_numdem#630794, jn_numexa#630795, jn_numdrv#630796, jn_numcr#630797, jn_numfus#630798, jn_comment#630799, jn_codsit#630800, jn_xmldata#630801, jn_prg_code#630802, jn_terminal#630803, jn_osuser#630804, jn_ip_address#630805, jn_flenv#630806, jn_datenv#630807, jn_nument#630808, jn_numstu#630809, jn_numser#630810, jn_numima#630811, jn_numrb#630812, jn_dursec#630813]

(7) Union

(8) HashAggregate [codegen id : 3]
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#632176L]
Results [1]: [count#632177L]

(9) Exchange
Input [1]: [count#632177L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=34414]

(10) ShuffleQueryStage
Output [1]: [count#632177L]
Arguments: 0

(11) HashAggregate [codegen id : 4]
Input [1]: [count#632177L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#631573L]
Results [1]: [count(1)#631573L AS COL_0b85e8eb-0401-4241-9678-d24ef2916108#631575L]

(12) Union

(13) HashAggregate
Input: []
Keys: []
Functions [1]: [partial_count(1)]
Aggregate Attributes [1]: [count#632176L]
Results [1]: [count#632177L]

(14) Exchange
Input [1]: [count#632177L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=34394]

(15) HashAggregate
Input [1]: [count#632177L]
Keys: []
Functions [1]: [count(1)]
Aggregate Attributes [1]: [count(1)#631573L]
Results [1]: [count(1)#631573L AS COL_0b85e8eb-0401-4241-9678-d24ef2916108#631575L]

(16) AdaptiveSparkPlan
Output [1]: [COL_0b85e8eb-0401-4241-9678-d24ef2916108#631575L]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet