SP1 - Details for Query 996

Submitted Time: 2026/02/24 10:25:06
Duration: 0.5 s
Succeeded Jobs: 1358 1359 1360 1362 1363

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (8)\n \nduration: 0 ms"; 2 [labelType="html" label="HashAggregate time in aggregation build: 0 ms number of output rows: 1"]; } 3 [labelType="html" label="Exchange shuffle records written: 1 local merged chunks fetched: 0 shuffle write time: 0 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 1 local bytes read: 88.0 B fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 104.0 B local merged bytes read: 0.0 B number of partitions: 1 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 88.0 B"]; subgraph cluster4 { isCluster="true"; label="WholeStageCodegen (7)\n \nduration: 18 ms"; 5 [labelType="html" label="HashAggregate spill size: 0.0 B time in aggregation build: 17 ms peak memory: 0.0 B number of output rows: 1 number of sort fallback tasks: 0 avg hash probes per key: 0"]; 6 [labelType="html" label=" Project "]; 7 [labelType="html" label="SortMergeJoin number of output rows: 503 spill size: 0.0 B"]; } subgraph cluster8 { isCluster="true"; label="WholeStageCodegen (5)\n \nduration: 59 ms"; 9 [labelType="html" label="Sort sort time: 0 ms peak memory: 16.1 MiB spill size: 0.0 B"]; } 10 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 10.7 KiB number of coalesced partitions: 1"]; 11 [labelType="html" label="Exchange shuffle records written: 741 local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 741 local bytes read: 10.3 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 23.2 KiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 10.3 KiB"]; 12 [labelType="html" label=" Project "]; 13 [labelType="html" label=" Project "]; 14 [labelType="html" label="Filter number of output rows: 741"]; subgraph cluster15 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 171 ms"; 16 [labelType="html" label="Generate number of output rows: 1,002"]; } 17 [labelType="html" label=" Project "]; 18 [labelType="html" label="Filter number of output rows: 1"]; 19 [labelType="html" label="Scan text number of output rows: 1 number of files read: 1 metadata time: 0 ms size of files read: 599.6 KiB"]; subgraph cluster20 { isCluster="true"; label="WholeStageCodegen (6)\n \nduration: 0 ms"; 21 [labelType="html" label="Sort sort time: 0 ms peak memory: 16.1 MiB spill size: 0.0 B"]; } 22 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 18.3 KiB number of coalesced partitions: 1"]; 23 [labelType="html" label="Exchange shuffle records written: 1,505 local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 1,505 local bytes read: 17.3 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 47.0 KiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 17.3 KiB"]; subgraph cluster24 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: 11 ms"; 25 [labelType="html" label="HashAggregate spill size: 0.0 B time in aggregation build: 5 ms peak memory: 256.0 KiB number of output rows: 1,505 number of sort fallback tasks: 0 avg hash probes per key: 0"]; } 26 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 128.6 KiB number of coalesced partitions: 1"]; 27 [labelType="html" label="Exchange shuffle records written: 1,505 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 9 ms (1 ms, 1 ms, 1 ms (stage 2100.0: task 2512)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 1,505 local bytes read: 123.2 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 6 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 184.0 KiB (880.0 B, 36.6 KiB, 37.1 KiB (stage 2100.0: task 2508)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 123.2 KiB (1008.0 B, 24.4 KiB, 24.7 KiB (stage 2100.0: task 2508))"]; subgraph cluster28 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: total (min, med, max (stageId: taskId))\n147 ms (11 ms, 17 ms, 23 ms (stage 2100.0: task 2510))"; 29 [labelType="html" label="HashAggregate spill size: 0.0 B time in aggregation build total (min, med, max (stageId: taskId)) 109 ms (7 ms, 13 ms, 19 ms (stage 2100.0: task 2510)) peak memory total (min, med, max (stageId: taskId)) 2.3 MiB (256.0 KiB, 256.0 KiB, 256.0 KiB (stage 2100.0: task 2513)) number of output rows: 1,505 number of sort fallback tasks: 0 avg hash probes per key: 0"]; } 30 [labelType="html" label=" Project "]; subgraph cluster31 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: total (min, med, max (stageId: taskId))\n147 ms (12 ms, 16 ms, 22 ms (stage 2100.0: task 2508))"; 32 [labelType="html" label="Filter number of output rows: 1,505"]; 33 [labelType="html" label="Generate number of output rows: 1,507"]; } 34 [labelType="html" label=" Project "]; 35 [labelType="html" label="Filter number of output rows: 16"]; 36 [labelType="html" label="Scan text number of output rows: 30 number of files read: 30 metadata time: 1 ms size of files read: 266.0 KiB"]; 2->0; 3->2; 5->3; 6->5; 7->6; 9->7; 10->9; 11->10; 12->11; 13->12; 14->13; 16->14; 17->16; 18->17; 19->18; 21->7; 22->21; 23->22; 25->23; 26->25; 27->26; 29->27; 30->29; 32->30; 33->32; 34->33; 35->34; 36->35; }

AdaptiveSparkPlan isFinalPlan=true

HashAggregate(keys=[], functions=[avg(COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698), avg(COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618), avg(COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725), avg(COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753), avg(COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782), avg(COL_CA890354_B95E_461B_87B4_7F83650C3820#314813)])

WholeStageCodegen (8)

Exchange SinglePartition, ENSURE_REQUIREMENTS, [plan_id=38682]

HashAggregate(keys=[], functions=[partial_avg(COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698), partial_avg(COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618), partial_avg(COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725), partial_avg(COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753), partial_avg(COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782), partial_avg(COL_CA890354_B95E_461B_87B4_7F83650C3820#314813)])

Project [dec_to_int(dec_round(dec_operator(PRODUIT, array(dec_operator(DIVISION, array(COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818, int_sum(array(bigint_to_int(INFORMATION_STA_119303_CAPACITY_119304#313847L), COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818)))), 100.0)), 2)) AS COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618, str_to_integer(str_create(0)) AS COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698, str_to_integer(str_create(100)) AS COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725, str_to_integer(str_create(25)) AS COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753, str_to_integer(str_create(50)) AS COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782, str_to_integer(str_create(75)) AS COL_CA890354_B95E_461B_87B4_7F83650C3820#314813]

SortMergeJoin [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805], [INFORMATION_STA_119303_STATIONCODE_119307#313850], Inner, CASE WHEN isnull(dec_to_int(dec_round(dec_operator(PRODUIT, array(dec_operator(DIVISION, array(COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818, int_sum(array(bigint_to_int(INFORMATION_STA_119303_CAPACITY_119304#313847L), COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818)))), 100.0)), 2))) THEN false ELSE (dec_to_int(dec_round(dec_operator(PRODUIT, array(dec_operator(DIVISION, array(COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818, int_sum(array(bigint_to_int(INFORMATION_STA_119303_CAPACITY_119304#313847L), COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818)))), 100.0)), 2)) > 20) END

WholeStageCodegen (7)

Sort [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805 ASC NULLS FIRST], false, 0

WholeStageCodegen (5)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, 10), ENSURE_REQUIREMENTS, [plan_id=38452]

Project [get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#313344, $.stationcode) AS COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#313344, $.numbikesavailable)) AS COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818]

Project [to_json(root#311994, Some(Etc/UTC)) AS COL_9091B58C_8072_40BA_9B1C_4828078CF13A#313344]

Filter ((str_remove_accent(upper(str_if_with_rule((CASE WHEN isnull(str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.ebike))) THEN false ELSE (str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.ebike)) > 0) END AND CASE WHEN isnull(str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.mechanical))) THEN false ELSE (str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.mechanical)) > 0) END), Mécaniques + Electriques, str_if_with_rule(CASE WHEN isnull(str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.mechanical))) THEN false ELSE (str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.mechanical)) > 0) END, Mécaniques, str_if_with_rule(CASE WHEN isnull(str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.ebike))) THEN false ELSE (str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.ebike)) > 0) END, Electriques, Pas de disponibilité))))) <=> MECANIQUES + ELECTRIQUES) AND isnotnull(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.stationcode)))

Generate explode(_extract_fields#314961), false, [root#311994]

WholeStageCodegen (1)

Project [from_json(ArrayType(StructType(StructField(fields,StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,ArrayType(DoubleType,true),true),StructField(duedate,StringType,true),StructField(ebike,LongType,true),StructField(is_installed,StringType,true),StructField(is_renting,StringType,true),StructField(is_returning,StringType,true),StructField(mechanical,LongType,true),StructField(name,StringType,true),StructField(nom_arrondissement_communes,StringType,true),StructField(numbikesavailable,LongType,true),StructField(numdocksavailable,LongType,true),StructField(stationcode,StringType,true)),true)),true), get_json_object(value#311976, $.records), Some(Etc/UTC)).fields AS _extract_fields#314961]

Filter ((size(from_json(ArrayType(StructType(StructField(fields,StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,ArrayType(DoubleType,true),true),StructField(duedate,StringType,true),StructField(ebike,LongType,true),StructField(is_installed,StringType,true),StructField(is_renting,StringType,true),StructField(is_returning,StringType,true),StructField(mechanical,LongType,true),StructField(name,StringType,true),StructField(nom_arrondissement_communes,StringType,true),StructField(numbikesavailable,LongType,true),StructField(numdocksavailable,LongType,true),StructField(stationcode,StringType,true)),true)),true), get_json_object(value#311976, $.records), Some(Etc/UTC)).fields, true) > 0) AND isnotnull(from_json(ArrayType(StructType(StructField(fields,StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,ArrayType(DoubleType,true),true),StructField(duedate,StringType,true),StructField(ebike,LongType,true),StructField(is_installed,StringType,true),StructField(is_renting,StringType,true),StructField(is_returning,StringType,true),StructField(mechanical,LongType,true),StructField(name,StringType,true),StructField(nom_arrondissement_communes,StringType,true),StructField(numbikesavailable,LongType,true),StructField(numdocksavailable,LongType,true),StructField(stationcode,StringType,true)),true)),true), get_json_object(value#311976, $.records), Some(Etc/UTC)).fields))

FileScan text [value#311976] Batched: false, DataFilters: [(size(from_json(ArrayType(StructType(StructField(fields,StructType(StructField(capacity,LongType..., Format: Text, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/json/tmp/VLIB_JSON_119256169/HTTP_FILE_0.json], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<value:string>

Sort [INFORMATION_STA_119303_STATIONCODE_119307#313850 ASC NULLS FIRST], false, 0

WholeStageCodegen (6)

AQEShuffleRead coalesced

Exchange hashpartitioning(INFORMATION_STA_119303_STATIONCODE_119307#313850, 10), ENSURE_REQUIREMENTS, [plan_id=38592]

HashAggregate(keys=[CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190], functions=[])

WholeStageCodegen (4)

AQEShuffleRead coalesced

Exchange hashpartitioning(CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190, 10), ENSURE_REQUIREMENTS, [plan_id=38475]

HashAggregate(keys=[CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190], functions=[])

WholeStageCodegen (3)

Project [root#313104.capacity AS CAPACITY_119304#313187L, to_json(root#313104.coordonnees_geo, Some(Etc/UTC)) AS COORDONNEES_GEO_119305#313188, root#313104.name AS NAME_119306#313189, root#313104.stationcode AS STATIONCODE_119307#313190]

Filter (CASE WHEN isnull(bigint_to_int(root#313104.capacity)) THEN false ELSE (bigint_to_int(root#313104.capacity) > 0) END AND isnotnull(root#313104.stationcode))

Generate explode(root#313101), false, [root#313104]

WholeStageCodegen (2)

Project [from_json(ArrayType(StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,StructType(StructField(lat,DoubleType,true),StructField(lon,DoubleType,true)),true),StructField(name,StringType,true),StructField(station_opening_hours,StringType,true),StructField(stationcode,StringType,true)),true), get_json_object(value#312790, $.results), Some(Etc/UTC)) AS root#313101]

Filter ((size(from_json(ArrayType(StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,StructType(StructField(lat,DoubleType,true),StructField(lon,DoubleType,true)),true),StructField(name,StringType,true),StructField(station_opening_hours,StringType,true),StructField(stationcode,StringType,true)),true), get_json_object(value#312790, $.results), Some(Etc/UTC)), true) > 0) AND isnotnull(from_json(ArrayType(StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,StructType(StructField(lat,DoubleType,true),StructField(lon,DoubleType,true)),true),StructField(name,StringType,true),StructField(station_opening_hours,StringType,true),StructField(stationcode,StringType,true)),true), get_json_object(value#312790, $.results), Some(Etc/UTC))))

FileScan text [value#312790] Batched: false, DataFilters: [(size(from_json(ArrayType(StructType(StructField(capacity,LongType,true),StructField(coordonnees..., Format: Text, Location: InMemoryFileIndex(30 paths)[file:/data/input/depot/json/tmp/INFORMATION_STA_119302169/HTTP_FILE_0..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<value:string>

Details

== Physical Plan ==
AdaptiveSparkPlan (52)
+- == Final Plan ==
   * HashAggregate (32)
   +- ShuffleQueryStage (31), Statistics(sizeInBytes=104.0 B, rowCount=1)
      +- Exchange (30)
         +- * HashAggregate (29)
            +- * Project (28)
               +- * SortMergeJoin Inner (27)
                  :- * Sort (11)
                  :  +- AQEShuffleRead (10)
                  :     +- ShuffleQueryStage (9), Statistics(sizeInBytes=23.2 KiB, rowCount=741)
                  :        +- Exchange (8)
                  :           +- Project (7)
                  :              +- Project (6)
                  :                 +- Filter (5)
                  :                    +- * Generate (4)
                  :                       +- Project (3)
                  :                          +- Filter (2)
                  :                             +- Scan text  (1)
                  +- * Sort (26)
                     +- AQEShuffleRead (25)
                        +- ShuffleQueryStage (24), Statistics(sizeInBytes=47.0 KiB, rowCount=1.51E+3)
                           +- Exchange (23)
                              +- * HashAggregate (22)
                                 +- AQEShuffleRead (21)
                                    +- ShuffleQueryStage (20), Statistics(sizeInBytes=184.0 KiB, rowCount=1.51E+3)
                                       +- Exchange (19)
                                          +- * HashAggregate (18)
                                             +- Project (17)
                                                +- * Filter (16)
                                                   +- * Generate (15)
                                                      +- Project (14)
                                                         +- Filter (13)
                                                            +- Scan text  (12)
+- == Initial Plan ==
   HashAggregate (51)
   +- Exchange (50)
      +- HashAggregate (49)
         +- Project (48)
            +- SortMergeJoin Inner (47)
               :- Sort (38)
               :  +- Exchange (37)
               :     +- Project (36)
               :        +- Project (35)
               :           +- Filter (34)
               :              +- Generate (33)
               :                 +- Project (3)
               :                    +- Filter (2)
               :                       +- Scan text  (1)
               +- Sort (46)
                  +- Exchange (45)
                     +- HashAggregate (44)
                        +- Exchange (43)
                           +- HashAggregate (42)
                              +- Project (41)
                                 +- Filter (40)
                                    +- Generate (39)
                                       +- Project (14)
                                          +- Filter (13)
                                             +- Scan text  (12)


(1) Scan text 
Output [1]: [value#311976]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/json/tmp/VLIB_JSON_119256169/HTTP_FILE_0.json]
ReadSchema: struct<value:string>

(2) Filter
Input [1]: [value#311976]
Condition : ((size(from_json(ArrayType(StructType(StructField(fields,StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,ArrayType(DoubleType,true),true),StructField(duedate,StringType,true),StructField(ebike,LongType,true),StructField(is_installed,StringType,true),StructField(is_renting,StringType,true),StructField(is_returning,StringType,true),StructField(mechanical,LongType,true),StructField(name,StringType,true),StructField(nom_arrondissement_communes,StringType,true),StructField(numbikesavailable,LongType,true),StructField(numdocksavailable,LongType,true),StructField(stationcode,StringType,true)),true)),true), get_json_object(value#311976, $.records), Some(Etc/UTC)).fields, true) > 0) AND isnotnull(from_json(ArrayType(StructType(StructField(fields,StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,ArrayType(DoubleType,true),true),StructField(duedate,StringType,true),StructField(ebike,LongType,true),StructField(is_installed,StringType,true),StructField(is_renting,StringType,true),StructField(is_returning,StringType,true),StructField(mechanical,LongType,true),StructField(name,StringType,true),StructField(nom_arrondissement_communes,StringType,true),StructField(numbikesavailable,LongType,true),StructField(numdocksavailable,LongType,true),StructField(stationcode,StringType,true)),true)),true), get_json_object(value#311976, $.records), Some(Etc/UTC)).fields))

(3) Project
Output [1]: [from_json(ArrayType(StructType(StructField(fields,StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,ArrayType(DoubleType,true),true),StructField(duedate,StringType,true),StructField(ebike,LongType,true),StructField(is_installed,StringType,true),StructField(is_renting,StringType,true),StructField(is_returning,StringType,true),StructField(mechanical,LongType,true),StructField(name,StringType,true),StructField(nom_arrondissement_communes,StringType,true),StructField(numbikesavailable,LongType,true),StructField(numdocksavailable,LongType,true),StructField(stationcode,StringType,true)),true)),true), get_json_object(value#311976, $.records), Some(Etc/UTC)).fields AS _extract_fields#314961]
Input [1]: [value#311976]

(4) Generate [codegen id : 1]
Input [1]: [_extract_fields#314961]
Arguments: explode(_extract_fields#314961), false, [root#311994]

(5) Filter
Input [1]: [root#311994]
Condition : ((str_remove_accent(upper(str_if_with_rule((CASE WHEN isnull(str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.ebike))) THEN false ELSE (str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.ebike)) > 0) END AND CASE WHEN isnull(str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.mechanical))) THEN false ELSE (str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.mechanical)) > 0) END), Mécaniques + Electriques, str_if_with_rule(CASE WHEN isnull(str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.mechanical))) THEN false ELSE (str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.mechanical)) > 0) END, Mécaniques, str_if_with_rule(CASE WHEN isnull(str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.ebike))) THEN false ELSE (str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.ebike)) > 0) END, Electriques, Pas de disponibilité))))) <=> MECANIQUES + ELECTRIQUES) AND isnotnull(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.stationcode)))

(6) Project
Output [1]: [to_json(root#311994, Some(Etc/UTC)) AS COL_9091B58C_8072_40BA_9B1C_4828078CF13A#313344]
Input [1]: [root#311994]

(7) Project
Output [2]: [get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#313344, $.stationcode) AS COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#313344, $.numbikesavailable)) AS COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818]
Input [1]: [COL_9091B58C_8072_40BA_9B1C_4828078CF13A#313344]

(8) Exchange
Input [2]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818]
Arguments: hashpartitioning(COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, 10), ENSURE_REQUIREMENTS, [plan_id=38452]

(9) ShuffleQueryStage
Output [2]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818]
Arguments: 0

(10) AQEShuffleRead
Input [2]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818]
Arguments: coalesced

(11) Sort [codegen id : 5]
Input [2]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818]
Arguments: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805 ASC NULLS FIRST], false, 0

(12) Scan text 
Output [1]: [value#312790]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/json/tmp/INFORMATION_STA_119302169/HTTP_FILE_0.json, ... 29 entries]
ReadSchema: struct<value:string>

(13) Filter
Input [1]: [value#312790]
Condition : ((size(from_json(ArrayType(StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,StructType(StructField(lat,DoubleType,true),StructField(lon,DoubleType,true)),true),StructField(name,StringType,true),StructField(station_opening_hours,StringType,true),StructField(stationcode,StringType,true)),true), get_json_object(value#312790, $.results), Some(Etc/UTC)), true) > 0) AND isnotnull(from_json(ArrayType(StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,StructType(StructField(lat,DoubleType,true),StructField(lon,DoubleType,true)),true),StructField(name,StringType,true),StructField(station_opening_hours,StringType,true),StructField(stationcode,StringType,true)),true), get_json_object(value#312790, $.results), Some(Etc/UTC))))

(14) Project
Output [1]: [from_json(ArrayType(StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,StructType(StructField(lat,DoubleType,true),StructField(lon,DoubleType,true)),true),StructField(name,StringType,true),StructField(station_opening_hours,StringType,true),StructField(stationcode,StringType,true)),true), get_json_object(value#312790, $.results), Some(Etc/UTC)) AS root#313101]
Input [1]: [value#312790]

(15) Generate [codegen id : 2]
Input [1]: [root#313101]
Arguments: explode(root#313101), false, [root#313104]

(16) Filter [codegen id : 2]
Input [1]: [root#313104]
Condition : (CASE WHEN isnull(bigint_to_int(root#313104.capacity)) THEN false ELSE (bigint_to_int(root#313104.capacity) > 0) END AND isnotnull(root#313104.stationcode))

(17) Project
Output [4]: [root#313104.capacity AS CAPACITY_119304#313187L, to_json(root#313104.coordonnees_geo, Some(Etc/UTC)) AS COORDONNEES_GEO_119305#313188, root#313104.name AS NAME_119306#313189, root#313104.stationcode AS STATIONCODE_119307#313190]
Input [1]: [root#313104]

(18) HashAggregate [codegen id : 3]
Input [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]
Keys [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]
Functions: []
Aggregate Attributes: []
Results [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]

(19) Exchange
Input [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]
Arguments: hashpartitioning(CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190, 10), ENSURE_REQUIREMENTS, [plan_id=38475]

(20) ShuffleQueryStage
Output [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]
Arguments: 1

(21) AQEShuffleRead
Input [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]
Arguments: coalesced

(22) HashAggregate [codegen id : 4]
Input [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]
Keys [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]
Functions: []
Aggregate Attributes: []
Results [2]: [CAPACITY_119304#313187L AS INFORMATION_STA_119303_CAPACITY_119304#313847L, STATIONCODE_119307#313190 AS INFORMATION_STA_119303_STATIONCODE_119307#313850]

(23) Exchange
Input [2]: [INFORMATION_STA_119303_CAPACITY_119304#313847L, INFORMATION_STA_119303_STATIONCODE_119307#313850]
Arguments: hashpartitioning(INFORMATION_STA_119303_STATIONCODE_119307#313850, 10), ENSURE_REQUIREMENTS, [plan_id=38592]

(24) ShuffleQueryStage
Output [2]: [INFORMATION_STA_119303_CAPACITY_119304#313847L, INFORMATION_STA_119303_STATIONCODE_119307#313850]
Arguments: 2

(25) AQEShuffleRead
Input [2]: [INFORMATION_STA_119303_CAPACITY_119304#313847L, INFORMATION_STA_119303_STATIONCODE_119307#313850]
Arguments: coalesced

(26) Sort [codegen id : 6]
Input [2]: [INFORMATION_STA_119303_CAPACITY_119304#313847L, INFORMATION_STA_119303_STATIONCODE_119307#313850]
Arguments: [INFORMATION_STA_119303_STATIONCODE_119307#313850 ASC NULLS FIRST], false, 0

(27) SortMergeJoin [codegen id : 7]
Left keys [1]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805]
Right keys [1]: [INFORMATION_STA_119303_STATIONCODE_119307#313850]
Join type: Inner
Join condition: CASE WHEN isnull(dec_to_int(dec_round(dec_operator(PRODUIT, array(dec_operator(DIVISION, array(COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818, int_sum(array(bigint_to_int(INFORMATION_STA_119303_CAPACITY_119304#313847L), COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818)))), 100.0)), 2))) THEN false ELSE (dec_to_int(dec_round(dec_operator(PRODUIT, array(dec_operator(DIVISION, array(COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818, int_sum(array(bigint_to_int(INFORMATION_STA_119303_CAPACITY_119304#313847L), COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818)))), 100.0)), 2)) > 20) END

(28) Project [codegen id : 7]
Output [6]: [dec_to_int(dec_round(dec_operator(PRODUIT, array(dec_operator(DIVISION, array(COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818, int_sum(array(bigint_to_int(INFORMATION_STA_119303_CAPACITY_119304#313847L), COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818)))), 100.0)), 2)) AS COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618, str_to_integer(str_create(0)) AS COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698, str_to_integer(str_create(100)) AS COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725, str_to_integer(str_create(25)) AS COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753, str_to_integer(str_create(50)) AS COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782, str_to_integer(str_create(75)) AS COL_CA890354_B95E_461B_87B4_7F83650C3820#314813]
Input [4]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818, INFORMATION_STA_119303_CAPACITY_119304#313847L, INFORMATION_STA_119303_STATIONCODE_119307#313850]

(29) HashAggregate [codegen id : 7]
Input [6]: [COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618, COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698, COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725, COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753, COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782, COL_CA890354_B95E_461B_87B4_7F83650C3820#314813]
Keys: []
Functions [6]: [partial_avg(COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698), partial_avg(COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618), partial_avg(COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725), partial_avg(COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753), partial_avg(COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782), partial_avg(COL_CA890354_B95E_461B_87B4_7F83650C3820#314813)]
Aggregate Attributes [12]: [sum#314962, count#314963L, sum#314964, count#314965L, sum#314966, count#314967L, sum#314968, count#314969L, sum#314970, count#314971L, sum#314972, count#314973L]
Results [12]: [sum#314974, count#314975L, sum#314976, count#314977L, sum#314978, count#314979L, sum#314980, count#314981L, sum#314982, count#314983L, sum#314984, count#314985L]

(30) Exchange
Input [12]: [sum#314974, count#314975L, sum#314976, count#314977L, sum#314978, count#314979L, sum#314980, count#314981L, sum#314982, count#314983L, sum#314984, count#314985L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=38682]

(31) ShuffleQueryStage
Output [12]: [sum#314974, count#314975L, sum#314976, count#314977L, sum#314978, count#314979L, sum#314980, count#314981L, sum#314982, count#314983L, sum#314984, count#314985L]
Arguments: 3

(32) HashAggregate [codegen id : 8]
Input [12]: [sum#314974, count#314975L, sum#314976, count#314977L, sum#314978, count#314979L, sum#314980, count#314981L, sum#314982, count#314983L, sum#314984, count#314985L]
Keys: []
Functions [6]: [avg(COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698), avg(COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618), avg(COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725), avg(COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753), avg(COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782), avg(COL_CA890354_B95E_461B_87B4_7F83650C3820#314813)]
Aggregate Attributes [6]: [avg(COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698)#314874, avg(COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618)#314876, avg(COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725)#314878, avg(COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753)#314880, avg(COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782)#314882, avg(COL_CA890354_B95E_461B_87B4_7F83650C3820#314813)#314884]
Results [6]: [avg(COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698)#314874 AS COL_AF54A9F5_CBB6_427F_8667_E83447A8F563#314875, avg(COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618)#314876 AS COL_E6BCD687_4596_4D15_AC59_90CC70C1343C#314877, avg(COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725)#314878 AS COL_87C3F2BB_CE4E_4CDA_AF24_91837AEFBAEE#314879, avg(COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753)#314880 AS COL_0EAD41C8_A8B9_4F0A_B4DC_674252979444#314881, avg(COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782)#314882 AS COL_F0B1090B_BD84_43C1_B441_5177DBAEEEAF#314883, avg(COL_CA890354_B95E_461B_87B4_7F83650C3820#314813)#314884 AS COL_A41EC495_BE1A_414F_B81F_12D4C98892DE#314885]

(33) Generate
Input [1]: [_extract_fields#314961]
Arguments: explode(_extract_fields#314961), false, [root#311994]

(34) Filter
Input [1]: [root#311994]
Condition : ((str_remove_accent(upper(str_if_with_rule((CASE WHEN isnull(str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.ebike))) THEN false ELSE (str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.ebike)) > 0) END AND CASE WHEN isnull(str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.mechanical))) THEN false ELSE (str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.mechanical)) > 0) END), Mécaniques + Electriques, str_if_with_rule(CASE WHEN isnull(str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.mechanical))) THEN false ELSE (str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.mechanical)) > 0) END, Mécaniques, str_if_with_rule(CASE WHEN isnull(str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.ebike))) THEN false ELSE (str_to_integer(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.ebike)) > 0) END, Electriques, Pas de disponibilité))))) <=> MECANIQUES + ELECTRIQUES) AND isnotnull(get_json_object(to_json(root#311994, Some(Etc/UTC)), $.stationcode)))

(35) Project
Output [1]: [to_json(root#311994, Some(Etc/UTC)) AS COL_9091B58C_8072_40BA_9B1C_4828078CF13A#313344]
Input [1]: [root#311994]

(36) Project
Output [2]: [get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#313344, $.stationcode) AS COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#313344, $.numbikesavailable)) AS COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818]
Input [1]: [COL_9091B58C_8072_40BA_9B1C_4828078CF13A#313344]

(37) Exchange
Input [2]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818]
Arguments: hashpartitioning(COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, 10), ENSURE_REQUIREMENTS, [plan_id=38368]

(38) Sort
Input [2]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818]
Arguments: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805 ASC NULLS FIRST], false, 0

(39) Generate
Input [1]: [root#313101]
Arguments: explode(root#313101), false, [root#313104]

(40) Filter
Input [1]: [root#313104]
Condition : (CASE WHEN isnull(bigint_to_int(root#313104.capacity)) THEN false ELSE (bigint_to_int(root#313104.capacity) > 0) END AND isnotnull(root#313104.stationcode))

(41) Project
Output [4]: [root#313104.capacity AS CAPACITY_119304#313187L, to_json(root#313104.coordonnees_geo, Some(Etc/UTC)) AS COORDONNEES_GEO_119305#313188, root#313104.name AS NAME_119306#313189, root#313104.stationcode AS STATIONCODE_119307#313190]
Input [1]: [root#313104]

(42) HashAggregate
Input [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]
Keys [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]
Functions: []
Aggregate Attributes: []
Results [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]

(43) Exchange
Input [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]
Arguments: hashpartitioning(CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190, 10), ENSURE_REQUIREMENTS, [plan_id=38360]

(44) HashAggregate
Input [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]
Keys [4]: [CAPACITY_119304#313187L, COORDONNEES_GEO_119305#313188, NAME_119306#313189, STATIONCODE_119307#313190]
Functions: []
Aggregate Attributes: []
Results [2]: [CAPACITY_119304#313187L AS INFORMATION_STA_119303_CAPACITY_119304#313847L, STATIONCODE_119307#313190 AS INFORMATION_STA_119303_STATIONCODE_119307#313850]

(45) Exchange
Input [2]: [INFORMATION_STA_119303_CAPACITY_119304#313847L, INFORMATION_STA_119303_STATIONCODE_119307#313850]
Arguments: hashpartitioning(INFORMATION_STA_119303_STATIONCODE_119307#313850, 10), ENSURE_REQUIREMENTS, [plan_id=38369]

(46) Sort
Input [2]: [INFORMATION_STA_119303_CAPACITY_119304#313847L, INFORMATION_STA_119303_STATIONCODE_119307#313850]
Arguments: [INFORMATION_STA_119303_STATIONCODE_119307#313850 ASC NULLS FIRST], false, 0

(47) SortMergeJoin
Left keys [1]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805]
Right keys [1]: [INFORMATION_STA_119303_STATIONCODE_119307#313850]
Join type: Inner
Join condition: CASE WHEN isnull(dec_to_int(dec_round(dec_operator(PRODUIT, array(dec_operator(DIVISION, array(COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818, int_sum(array(bigint_to_int(INFORMATION_STA_119303_CAPACITY_119304#313847L), COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818)))), 100.0)), 2))) THEN false ELSE (dec_to_int(dec_round(dec_operator(PRODUIT, array(dec_operator(DIVISION, array(COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818, int_sum(array(bigint_to_int(INFORMATION_STA_119303_CAPACITY_119304#313847L), COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818)))), 100.0)), 2)) > 20) END

(48) Project
Output [6]: [dec_to_int(dec_round(dec_operator(PRODUIT, array(dec_operator(DIVISION, array(COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818, int_sum(array(bigint_to_int(INFORMATION_STA_119303_CAPACITY_119304#313847L), COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818)))), 100.0)), 2)) AS COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618, str_to_integer(str_create(0)) AS COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698, str_to_integer(str_create(100)) AS COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725, str_to_integer(str_create(25)) AS COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753, str_to_integer(str_create(50)) AS COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782, str_to_integer(str_create(75)) AS COL_CA890354_B95E_461B_87B4_7F83650C3820#314813]
Input [4]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#313805, COL_222816E0_1771_4A96_9C59_DB1900C311FE#313818, INFORMATION_STA_119303_CAPACITY_119304#313847L, INFORMATION_STA_119303_STATIONCODE_119307#313850]

(49) HashAggregate
Input [6]: [COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618, COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698, COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725, COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753, COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782, COL_CA890354_B95E_461B_87B4_7F83650C3820#314813]
Keys: []
Functions [6]: [partial_avg(COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698), partial_avg(COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618), partial_avg(COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725), partial_avg(COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753), partial_avg(COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782), partial_avg(COL_CA890354_B95E_461B_87B4_7F83650C3820#314813)]
Aggregate Attributes [12]: [sum#314962, count#314963L, sum#314964, count#314965L, sum#314966, count#314967L, sum#314968, count#314969L, sum#314970, count#314971L, sum#314972, count#314973L]
Results [12]: [sum#314974, count#314975L, sum#314976, count#314977L, sum#314978, count#314979L, sum#314980, count#314981L, sum#314982, count#314983L, sum#314984, count#314985L]

(50) Exchange
Input [12]: [sum#314974, count#314975L, sum#314976, count#314977L, sum#314978, count#314979L, sum#314980, count#314981L, sum#314982, count#314983L, sum#314984, count#314985L]
Arguments: SinglePartition, ENSURE_REQUIREMENTS, [plan_id=38376]

(51) HashAggregate
Input [12]: [sum#314974, count#314975L, sum#314976, count#314977L, sum#314978, count#314979L, sum#314980, count#314981L, sum#314982, count#314983L, sum#314984, count#314985L]
Keys: []
Functions [6]: [avg(COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698), avg(COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618), avg(COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725), avg(COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753), avg(COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782), avg(COL_CA890354_B95E_461B_87B4_7F83650C3820#314813)]
Aggregate Attributes [6]: [avg(COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698)#314874, avg(COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618)#314876, avg(COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725)#314878, avg(COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753)#314880, avg(COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782)#314882, avg(COL_CA890354_B95E_461B_87B4_7F83650C3820#314813)#314884]
Results [6]: [avg(COL_60710BBB_84E6_4D82_BF64_43AD7277D805#314698)#314874 AS COL_AF54A9F5_CBB6_427F_8667_E83447A8F563#314875, avg(COL_72171A9C_F337_4AD3_8511_8797B9778C04#314618)#314876 AS COL_E6BCD687_4596_4D15_AC59_90CC70C1343C#314877, avg(COL_CED3F36A_E724_46B8_A288_EEE4FE1ED252#314725)#314878 AS COL_87C3F2BB_CE4E_4CDA_AF24_91837AEFBAEE#314879, avg(COL_51C8BEA6_620D_446F_8AB6_19853E93FD0E#314753)#314880 AS COL_0EAD41C8_A8B9_4F0A_B4DC_674252979444#314881, avg(COL_97F2AE14_003B_420E_B9D6_E6D0C34DCE18#314782)#314882 AS COL_F0B1090B_BD84_43C1_B441_5177DBAEEEAF#314883, avg(COL_CA890354_B95E_461B_87B4_7F83650C3820#314813)#314884 AS COL_A41EC495_BE1A_414F_B81F_12D4C98892DE#314885]

(52) AdaptiveSparkPlan
Output [6]: [COL_AF54A9F5_CBB6_427F_8667_E83447A8F563#314875, COL_E6BCD687_4596_4D15_AC59_90CC70C1343C#314877, COL_87C3F2BB_CE4E_4CDA_AF24_91837AEFBAEE#314879, COL_0EAD41C8_A8B9_4F0A_B4DC_674252979444#314881, COL_F0B1090B_BD84_43C1_B441_5177DBAEEEAF#314883, COL_A41EC495_BE1A_414F_B81F_12D4C98892DE#314885]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet