hdh-spark-job - Details for Query 46

Submitted Time: 2026/10/26 16:41:51
Duration: 0.5 s
Succeeded Jobs: 52 53 54

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; 1 [labelType="html" label="Execute InsertIntoHadoopFsRelationCommand task commit time: 1 ms number of written files: 1 job commit time: 12 ms number of output rows: 613 number of dynamic part: 0 written output: 136.8 KiB"]; 2 [labelType="html" label=" WriteFiles "]; subgraph cluster3 { isCluster="true"; label="WholeStageCodegen (5)\n \nduration: 66 ms"; 4 [labelType="html" label=" Project "]; 5 [labelType="html" label=" Project "]; 6 [labelType="html" label=" Project "]; 7 [labelType="html" label="SortMergeJoin number of output rows: 613 spill size: 0.0 B"]; } subgraph cluster8 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: 70 ms"; 9 [labelType="html" label="Sort sort time: 1 ms peak memory: 64.1 MiB spill size: 0.0 B"]; } 10 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 256.7 KiB number of coalesced partitions: 1"]; 11 [labelType="html" label="Exchange shuffle records written: 1,005 local merged chunks fetched: 0 shuffle write time: 2 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 1,005 local bytes read: 245.7 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 767.4 KiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 245.7 KiB"]; 12 [labelType="html" label=" Project "]; 13 [labelType="html" label=" Project "]; 14 [labelType="html" label="Filter number of output rows: 1,005"]; subgraph cluster15 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 177 ms"; 16 [labelType="html" label="Generate number of output rows: 1,005"]; } 17 [labelType="html" label=" Project "]; 18 [labelType="html" label="Filter number of output rows: 1"]; 19 [labelType="html" label="Scan text number of output rows: 1 number of files read: 1 metadata time: 0 ms size of files read: 600.7 KiB"]; subgraph cluster20 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: 0 ms"; 21 [labelType="html" label="Sort sort time: 1 ms peak memory: 64.1 MiB spill size: 0.0 B"]; } 22 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 11.7 KiB number of coalesced partitions: 1"]; 23 [labelType="html" label="Exchange shuffle records written: 918 local merged chunks fetched: 0 shuffle write time: 2 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 918 local bytes read: 11.1 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 28.7 KiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 11.1 KiB"]; subgraph cluster24 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: 11 ms"; 25 [labelType="html" label=" Project "]; 26 [labelType="html" label="Filter number of output rows: 918"]; 27 [labelType="html" label="ColumnarToRow number of output rows: 919 number of input batches: 1"]; } 28 [labelType="html" label="Scan parquet number of files read: 1 scan time: 7 ms metadata time: 0 ms size of files read: 45.6 KiB number of output rows: 919"]; 1->0; 2->1; 4->2; 5->4; 6->5; 7->6; 9->7; 10->9; 11->10; 12->11; 13->12; 14->13; 16->14; 17->16; 18->17; 19->18; 21->7; 22->21; 23->22; 25->23; 26->25; 27->26; 28->27; }

AdaptiveSparkPlan isFinalPlan=true

Execute InsertIntoHadoopFsRelationCommand file:/data/output/cache/parquet/datablock/VLIB_JSON_119279, false, Parquet, [path=file:///data/output/cache/parquet/datablock/VLIB_JSON_119279], Overwrite, [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86, COL_8A096969_1374_4168_B930_C219BC1F0591, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5, COL_AEF551A3_1A52_41DE_834C_26049DF5418E, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B, COL_9091B58C_8072_40BA_9B1C_4828078CF13A, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6, COL_5AF84147_5C5A_4A25_947C_12826B5080D0, COL_2F07F797_35B4_491C_8255_10445B86EEB9, COL_222816E0_1771_4A96_9C59_DB1900C311FE, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC, COL_4886635E_35B3_4E90_94E4_401045F89277, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86, COL_53FAED45_3ABA_424E_8D67_03AC323B7720, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D, COL_C263C963_DBFC_4CA5_8638_D9F3EF4E4057, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42, COL_69842CB9_D407_4477_8F44_680AF6209358]

WriteFiles

Project [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_4886635E_35B3_4E90_94E4_401045F89277#7524, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546, COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, RANKING_RESULTS_CONNECTOR(STOP_IF_TRUE, null, array(RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, < 10 %, less_or_equal, [10], [0], #EE4806, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 10 à 20 %, between, [10], [20], #E47F0A, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 20 à 30 %, between, [20], [30], #D7A80D, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 30 à 40 %, between, [30], [40], #CECE11, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 40 à 50 %, between, [40], [50], #99C515, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 50 à 60 %, between, [50], [60], #6BB918, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 60 à 70 %, between, [60], [70], #45B01B, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 70 à 80 %, between, [70], [80], #2BA91D, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 80 à 90, between, [80], [90], #1FA133, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, > 90 %, greater_or_equal, [90], [0], #219A48, , null))) AS COL_C263C963_DBFC_4CA5_8638_D9F3EF4E4057#7860, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_69842CB9_D407_4477_8F44_680AF6209358#7689]

Project [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_4886635E_35B3_4E90_94E4_401045F89277#7524, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546, dec_to_int(dec_round(dec_operator(PRODUIT, array(dec_operator(DIVISION, array(COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, int_sum(array(COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340)))), 100.0)), 2)) AS COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, int_sum(array(COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502)) AS COL_69842CB9_D407_4477_8F44_680AF6209358#7689]

Project [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, bigint_to_int(INFORMATION_STA_119303_CAPACITY_119304#7369L) AS COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, dec_operator(SOMME, array(COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343)) AS COL_4886635E_35B3_4E90_94E4_401045F89277#7524, str_if_with_rule((CASE WHEN isnull(COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342) THEN false ELSE (COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342 > 0) END AND CASE WHEN isnull(COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343) THEN false ELSE (COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343 > 0) END), Mécaniques + Electriques, str_if_with_rule(CASE WHEN isnull(COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343) THEN false ELSE (COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343 > 0) END, Mécaniques, str_if_with_rule(CASE WHEN isnull(COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342) THEN false ELSE (COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342 > 0) END, Electriques, Pas de disponibilité))) AS COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546]

SortMergeJoin [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327], [INFORMATION_STA_119303_STATIONCODE_119307#7372], Inner

WholeStageCodegen (5)

Sort [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327 ASC NULLS FIRST], false, 0

WholeStageCodegen (3)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, 10), ENSURE_REQUIREMENTS, [plan_id=2151]

Project [get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.stationcode) AS COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.nom_arrondissement_communes) AS COL_8A096969_1374_4168_B930_C219BC1F0591#7328, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.coordonnees_geo[0]) AS COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.coordonnees_geo[1]) AS COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, str_to_datez(COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, yyyy-MM-dd'T'HH:mm:ss.SSSXXX, Europe/Paris, fr_FR) AS COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.is_renting) AS COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.is_installed) AS COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.is_returning) AS COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.numbikesavailable)) AS COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.numdocksavailable)) AS COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.ebike)) AS COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.mechanical)) AS COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.name) AS COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.stationcode) AS COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345]

Project [root#7003.datasetid AS COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, to_json(root#7003.fields, Some(Etc/UTC)) AS COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, to_json(root#7003.geometry, Some(Etc/UTC)) AS COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, root#7003.record_timestamp AS COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, root#7003.recordid AS COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094]

Filter isnotnull(get_json_object(to_json(root#7003.fields, Some(Etc/UTC)), $.stationcode))

Generate explode(root#7000), false, [root#7003]

WholeStageCodegen (1)

Project [from_json(ArrayType(StructType(StructField(datasetid,StringType,true),StructField(fields,StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,ArrayType(DoubleType,true),true),StructField(duedate,StringType,true),StructField(ebike,LongType,true),StructField(is_installed,StringType,true),StructField(is_renting,StringType,true),StructField(is_returning,StringType,true),StructField(mechanical,LongType,true),StructField(name,StringType,true),StructField(nom_arrondissement_communes,StringType,true),StructField(numbikesavailable,LongType,true),StructField(numdocksavailable,LongType,true),StructField(stationcode,StringType,true)),true),StructField(geometry,StructType(StructField(coordinates,ArrayType(DoubleType,true),true),StructField(type,StringType,true)),true),StructField(record_timestamp,StringType,true),StructField(recordid,StringType,true)),true), get_json_object(value#6985, $.records), Some(Etc/UTC)) AS root#7000]

Filter ((size(from_json(ArrayType(StructType(StructField(datasetid,StringType,true),StructField(fields,StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,ArrayType(DoubleType,true),true),StructField(duedate,StringType,true),StructField(ebike,LongType,true),StructField(is_installed,StringType,true),StructField(is_renting,StringType,true),StructField(is_returning,StringType,true),StructField(mechanical,LongType,true),StructField(name,StringType,true),StructField(nom_arrondissement_communes,StringType,true),StructField(numbikesavailable,LongType,true),StructField(numdocksavailable,LongType,true),StructField(stationcode,StringType,true)),true),StructField(geometry,StructType(StructField(coordinates,ArrayType(DoubleType,true),true),StructField(type,StringType,true)),true),StructField(record_timestamp,StringType,true),StructField(recordid,StringType,true)),true), get_json_object(value#6985, $.records), Some(Etc/UTC)), true) > 0) AND isnotnull(from_json(ArrayType(StructType(StructField(datasetid,StringType,true),StructField(fields,StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,ArrayType(DoubleType,true),true),StructField(duedate,StringType,true),StructField(ebike,LongType,true),StructField(is_installed,StringType,true),StructField(is_renting,StringType,true),StructField(is_returning,StringType,true),StructField(mechanical,LongType,true),StructField(name,StringType,true),StructField(nom_arrondissement_communes,StringType,true),StructField(numbikesavailable,LongType,true),StructField(numdocksavailable,LongType,true),StructField(stationcode,StringType,true)),true),StructField(geometry,StructType(StructField(coordinates,ArrayType(DoubleType,true),true),StructField(type,StringType,true)),true),StructField(record_timestamp,StringType,true),StructField(recordid,StringType,true)),true), get_json_object(value#6985, $.records), Some(Etc/UTC))))

FileScan text [value#6985] Batched: false, DataFilters: [(size(from_json(ArrayType(StructType(StructField(datasetid,StringType,true),StructField(fields,S..., Format: Text, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/json/tmp/VLIB_JSON_119256143/HTTP_FILE_0.json], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<value:string>

Sort [INFORMATION_STA_119303_STATIONCODE_119307#7372 ASC NULLS FIRST], false, 0

WholeStageCodegen (4)

AQEShuffleRead coalesced

Exchange hashpartitioning(INFORMATION_STA_119303_STATIONCODE_119307#7372, 10), ENSURE_REQUIREMENTS, [plan_id=2182]

Project [CAPACITY_119304#7052L AS INFORMATION_STA_119303_CAPACITY_119304#7369L, STATIONCODE_119307#7055 AS INFORMATION_STA_119303_STATIONCODE_119307#7372]

Filter (CASE WHEN isnull(bigint_to_int(CAPACITY_119304#7052L)) THEN false ELSE (bigint_to_int(CAPACITY_119304#7052L) > 0) END AND isnotnull(STATIONCODE_119307#7055))

ColumnarToRow

WholeStageCodegen (2)

FileScan parquet [CAPACITY_119304#7052L,STATIONCODE_119307#7055] Batched: true, DataFilters: [CASE WHEN isnull(bigint_to_int(CAPACITY_119304#7052L)) THEN false ELSE (bigint_to_int(CAPACITY_1..., Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/output/cache/parquet/uet/INFORMATION_STA_119303], PartitionFilters: [], PushedFilters: [IsNotNull(STATIONCODE_119307)], ReadSchema: struct<CAPACITY_119304:bigint,STATIONCODE_119307:string>

Details

== Physical Plan ==
AdaptiveSparkPlan (42)
+- == Final Plan ==
   Execute InsertIntoHadoopFsRelationCommand (25)
   +- WriteFiles (24)
      +- * Project (23)
         +- * Project (22)
            +- * Project (21)
               +- * SortMergeJoin Inner (20)
                  :- * Sort (11)
                  :  +- AQEShuffleRead (10)
                  :     +- ShuffleQueryStage (9), Statistics(sizeInBytes=767.4 KiB, rowCount=1.01E+3)
                  :        +- Exchange (8)
                  :           +- Project (7)
                  :              +- Project (6)
                  :                 +- Filter (5)
                  :                    +- * Generate (4)
                  :                       +- Project (3)
                  :                          +- Filter (2)
                  :                             +- Scan text  (1)
                  +- * Sort (19)
                     +- AQEShuffleRead (18)
                        +- ShuffleQueryStage (17), Statistics(sizeInBytes=28.7 KiB, rowCount=918)
                           +- Exchange (16)
                              +- * Project (15)
                                 +- * Filter (14)
                                    +- * ColumnarToRow (13)
                                       +- Scan parquet  (12)
+- == Initial Plan ==
   Execute InsertIntoHadoopFsRelationCommand (41)
   +- WriteFiles (40)
      +- Project (39)
         +- Project (38)
            +- Project (37)
               +- SortMergeJoin Inner (36)
                  :- Sort (31)
                  :  +- Exchange (30)
                  :     +- Project (29)
                  :        +- Project (28)
                  :           +- Filter (27)
                  :              +- Generate (26)
                  :                 +- Project (3)
                  :                    +- Filter (2)
                  :                       +- Scan text  (1)
                  +- Sort (35)
                     +- Exchange (34)
                        +- Project (33)
                           +- Filter (32)
                              +- Scan parquet  (12)


(1) Scan text 
Output [1]: [value#6985]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/json/tmp/VLIB_JSON_119256143/HTTP_FILE_0.json]
ReadSchema: struct<value:string>

(2) Filter
Input [1]: [value#6985]
Condition : ((size(from_json(ArrayType(StructType(StructField(datasetid,StringType,true),StructField(fields,StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,ArrayType(DoubleType,true),true),StructField(duedate,StringType,true),StructField(ebike,LongType,true),StructField(is_installed,StringType,true),StructField(is_renting,StringType,true),StructField(is_returning,StringType,true),StructField(mechanical,LongType,true),StructField(name,StringType,true),StructField(nom_arrondissement_communes,StringType,true),StructField(numbikesavailable,LongType,true),StructField(numdocksavailable,LongType,true),StructField(stationcode,StringType,true)),true),StructField(geometry,StructType(StructField(coordinates,ArrayType(DoubleType,true),true),StructField(type,StringType,true)),true),StructField(record_timestamp,StringType,true),StructField(recordid,StringType,true)),true), get_json_object(value#6985, $.records), Some(Etc/UTC)), true) > 0) AND isnotnull(from_json(ArrayType(StructType(StructField(datasetid,StringType,true),StructField(fields,StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,ArrayType(DoubleType,true),true),StructField(duedate,StringType,true),StructField(ebike,LongType,true),StructField(is_installed,StringType,true),StructField(is_renting,StringType,true),StructField(is_returning,StringType,true),StructField(mechanical,LongType,true),StructField(name,StringType,true),StructField(nom_arrondissement_communes,StringType,true),StructField(numbikesavailable,LongType,true),StructField(numdocksavailable,LongType,true),StructField(stationcode,StringType,true)),true),StructField(geometry,StructType(StructField(coordinates,ArrayType(DoubleType,true),true),StructField(type,StringType,true)),true),StructField(record_timestamp,StringType,true),StructField(recordid,StringType,true)),true), get_json_object(value#6985, $.records), Some(Etc/UTC))))

(3) Project
Output [1]: [from_json(ArrayType(StructType(StructField(datasetid,StringType,true),StructField(fields,StructType(StructField(capacity,LongType,true),StructField(coordonnees_geo,ArrayType(DoubleType,true),true),StructField(duedate,StringType,true),StructField(ebike,LongType,true),StructField(is_installed,StringType,true),StructField(is_renting,StringType,true),StructField(is_returning,StringType,true),StructField(mechanical,LongType,true),StructField(name,StringType,true),StructField(nom_arrondissement_communes,StringType,true),StructField(numbikesavailable,LongType,true),StructField(numdocksavailable,LongType,true),StructField(stationcode,StringType,true)),true),StructField(geometry,StructType(StructField(coordinates,ArrayType(DoubleType,true),true),StructField(type,StringType,true)),true),StructField(record_timestamp,StringType,true),StructField(recordid,StringType,true)),true), get_json_object(value#6985, $.records), Some(Etc/UTC)) AS root#7000]
Input [1]: [value#6985]

(4) Generate [codegen id : 1]
Input [1]: [root#7000]
Arguments: explode(root#7000), false, [root#7003]

(5) Filter
Input [1]: [root#7003]
Condition : isnotnull(get_json_object(to_json(root#7003.fields, Some(Etc/UTC)), $.stationcode))

(6) Project
Output [5]: [root#7003.datasetid AS COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, to_json(root#7003.fields, Some(Etc/UTC)) AS COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, to_json(root#7003.geometry, Some(Etc/UTC)) AS COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, root#7003.record_timestamp AS COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, root#7003.recordid AS COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094]
Input [1]: [root#7003]

(7) Project
Output [19]: [get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.stationcode) AS COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.nom_arrondissement_communes) AS COL_8A096969_1374_4168_B930_C219BC1F0591#7328, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.coordonnees_geo[0]) AS COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.coordonnees_geo[1]) AS COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, str_to_datez(COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, yyyy-MM-dd'T'HH:mm:ss.SSSXXX, Europe/Paris, fr_FR) AS COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.is_renting) AS COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.is_installed) AS COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.is_returning) AS COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.numbikesavailable)) AS COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.numdocksavailable)) AS COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.ebike)) AS COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.mechanical)) AS COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.name) AS COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.stationcode) AS COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345]
Input [5]: [COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094]

(8) Exchange
Input [19]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345]
Arguments: hashpartitioning(COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, 10), ENSURE_REQUIREMENTS, [plan_id=2151]

(9) ShuffleQueryStage
Output [19]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345]
Arguments: 0

(10) AQEShuffleRead
Input [19]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345]
Arguments: coalesced

(11) Sort [codegen id : 3]
Input [19]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345]
Arguments: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327 ASC NULLS FIRST], false, 0

(12) Scan parquet 
Output [2]: [CAPACITY_119304#7052L, STATIONCODE_119307#7055]
Batched: true
Location: InMemoryFileIndex [file:/data/output/cache/parquet/uet/INFORMATION_STA_119303]
PushedFilters: [IsNotNull(STATIONCODE_119307)]
ReadSchema: struct<CAPACITY_119304:bigint,STATIONCODE_119307:string>

(13) ColumnarToRow [codegen id : 2]
Input [2]: [CAPACITY_119304#7052L, STATIONCODE_119307#7055]

(14) Filter [codegen id : 2]
Input [2]: [CAPACITY_119304#7052L, STATIONCODE_119307#7055]
Condition : (CASE WHEN isnull(bigint_to_int(CAPACITY_119304#7052L)) THEN false ELSE (bigint_to_int(CAPACITY_119304#7052L) > 0) END AND isnotnull(STATIONCODE_119307#7055))

(15) Project [codegen id : 2]
Output [2]: [CAPACITY_119304#7052L AS INFORMATION_STA_119303_CAPACITY_119304#7369L, STATIONCODE_119307#7055 AS INFORMATION_STA_119303_STATIONCODE_119307#7372]
Input [2]: [CAPACITY_119304#7052L, STATIONCODE_119307#7055]

(16) Exchange
Input [2]: [INFORMATION_STA_119303_CAPACITY_119304#7369L, INFORMATION_STA_119303_STATIONCODE_119307#7372]
Arguments: hashpartitioning(INFORMATION_STA_119303_STATIONCODE_119307#7372, 10), ENSURE_REQUIREMENTS, [plan_id=2182]

(17) ShuffleQueryStage
Output [2]: [INFORMATION_STA_119303_CAPACITY_119304#7369L, INFORMATION_STA_119303_STATIONCODE_119307#7372]
Arguments: 1

(18) AQEShuffleRead
Input [2]: [INFORMATION_STA_119303_CAPACITY_119304#7369L, INFORMATION_STA_119303_STATIONCODE_119307#7372]
Arguments: coalesced

(19) Sort [codegen id : 4]
Input [2]: [INFORMATION_STA_119303_CAPACITY_119304#7369L, INFORMATION_STA_119303_STATIONCODE_119307#7372]
Arguments: [INFORMATION_STA_119303_STATIONCODE_119307#7372 ASC NULLS FIRST], false, 0

(20) SortMergeJoin [codegen id : 5]
Left keys [1]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327]
Right keys [1]: [INFORMATION_STA_119303_STATIONCODE_119307#7372]
Join type: Inner
Join condition: None

(21) Project [codegen id : 5]
Output [22]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, bigint_to_int(INFORMATION_STA_119303_CAPACITY_119304#7369L) AS COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, dec_operator(SOMME, array(COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343)) AS COL_4886635E_35B3_4E90_94E4_401045F89277#7524, str_if_with_rule((CASE WHEN isnull(COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342) THEN false ELSE (COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342 > 0) END AND CASE WHEN isnull(COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343) THEN false ELSE (COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343 > 0) END), Mécaniques + Electriques, str_if_with_rule(CASE WHEN isnull(COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343) THEN false ELSE (COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343 > 0) END, Mécaniques, str_if_with_rule(CASE WHEN isnull(COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342) THEN false ELSE (COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342 > 0) END, Electriques, Pas de disponibilité))) AS COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546]
Input [21]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, INFORMATION_STA_119303_CAPACITY_119304#7369L, INFORMATION_STA_119303_STATIONCODE_119307#7372]

(22) Project [codegen id : 5]
Output [24]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_4886635E_35B3_4E90_94E4_401045F89277#7524, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546, dec_to_int(dec_round(dec_operator(PRODUIT, array(dec_operator(DIVISION, array(COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, int_sum(array(COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340)))), 100.0)), 2)) AS COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, int_sum(array(COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502)) AS COL_69842CB9_D407_4477_8F44_680AF6209358#7689]
Input [22]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, COL_4886635E_35B3_4E90_94E4_401045F89277#7524, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546]

(23) Project [codegen id : 5]
Output [25]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_4886635E_35B3_4E90_94E4_401045F89277#7524, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546, COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, RANKING_RESULTS_CONNECTOR(STOP_IF_TRUE, null, array(RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, < 10 %, less_or_equal, [10], [0], #EE4806, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 10 à 20 %, between, [10], [20], #E47F0A, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 20 à 30 %, between, [20], [30], #D7A80D, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 30 à 40 %, between, [30], [40], #CECE11, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 40 à 50 %, between, [40], [50], #99C515, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 50 à 60 %, between, [50], [60], #6BB918, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 60 à 70 %, between, [60], [70], #45B01B, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 70 à 80 %, between, [70], [80], #2BA91D, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 80 à 90, between, [80], [90], #1FA133, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, > 90 %, greater_or_equal, [90], [0], #219A48, , null))) AS COL_C263C963_DBFC_4CA5_8638_D9F3EF4E4057#7860, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_69842CB9_D407_4477_8F44_680AF6209358#7689]
Input [24]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_4886635E_35B3_4E90_94E4_401045F89277#7524, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546, COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_69842CB9_D407_4477_8F44_680AF6209358#7689]

(24) WriteFiles
Input [25]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_4886635E_35B3_4E90_94E4_401045F89277#7524, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546, COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, COL_C263C963_DBFC_4CA5_8638_D9F3EF4E4057#7860, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_69842CB9_D407_4477_8F44_680AF6209358#7689]

(25) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/cache/parquet/datablock/VLIB_JSON_119279, false, Parquet, [path=file:///data/output/cache/parquet/datablock/VLIB_JSON_119279], Overwrite, [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86, COL_8A096969_1374_4168_B930_C219BC1F0591, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5, COL_AEF551A3_1A52_41DE_834C_26049DF5418E, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B, COL_9091B58C_8072_40BA_9B1C_4828078CF13A, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6, COL_5AF84147_5C5A_4A25_947C_12826B5080D0, COL_2F07F797_35B4_491C_8255_10445B86EEB9, COL_222816E0_1771_4A96_9C59_DB1900C311FE, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC, COL_4886635E_35B3_4E90_94E4_401045F89277, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86, COL_53FAED45_3ABA_424E_8D67_03AC323B7720, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D, COL_C263C963_DBFC_4CA5_8638_D9F3EF4E4057, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42, COL_69842CB9_D407_4477_8F44_680AF6209358]

(26) Generate
Input [1]: [root#7000]
Arguments: explode(root#7000), false, [root#7003]

(27) Filter
Input [1]: [root#7003]
Condition : isnotnull(get_json_object(to_json(root#7003.fields, Some(Etc/UTC)), $.stationcode))

(28) Project
Output [5]: [root#7003.datasetid AS COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, to_json(root#7003.fields, Some(Etc/UTC)) AS COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, to_json(root#7003.geometry, Some(Etc/UTC)) AS COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, root#7003.record_timestamp AS COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, root#7003.recordid AS COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094]
Input [1]: [root#7003]

(29) Project
Output [19]: [get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.stationcode) AS COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.nom_arrondissement_communes) AS COL_8A096969_1374_4168_B930_C219BC1F0591#7328, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.coordonnees_geo[0]) AS COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.coordonnees_geo[1]) AS COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, str_to_datez(COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, yyyy-MM-dd'T'HH:mm:ss.SSSXXX, Europe/Paris, fr_FR) AS COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.is_renting) AS COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.is_installed) AS COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.is_returning) AS COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.numbikesavailable)) AS COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.numdocksavailable)) AS COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.ebike)) AS COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, str_to_integer(get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.mechanical)) AS COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.name) AS COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, get_json_object(COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, $.stationcode) AS COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345]
Input [5]: [COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094]

(30) Exchange
Input [19]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345]
Arguments: hashpartitioning(COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, 10), ENSURE_REQUIREMENTS, [plan_id=2120]

(31) Sort
Input [19]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345]
Arguments: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327 ASC NULLS FIRST], false, 0

(32) Filter
Input [2]: [CAPACITY_119304#7052L, STATIONCODE_119307#7055]
Condition : (CASE WHEN isnull(bigint_to_int(CAPACITY_119304#7052L)) THEN false ELSE (bigint_to_int(CAPACITY_119304#7052L) > 0) END AND isnotnull(STATIONCODE_119307#7055))

(33) Project
Output [2]: [CAPACITY_119304#7052L AS INFORMATION_STA_119303_CAPACITY_119304#7369L, STATIONCODE_119307#7055 AS INFORMATION_STA_119303_STATIONCODE_119307#7372]
Input [2]: [CAPACITY_119304#7052L, STATIONCODE_119307#7055]

(34) Exchange
Input [2]: [INFORMATION_STA_119303_CAPACITY_119304#7369L, INFORMATION_STA_119303_STATIONCODE_119307#7372]
Arguments: hashpartitioning(INFORMATION_STA_119303_STATIONCODE_119307#7372, 10), ENSURE_REQUIREMENTS, [plan_id=2121]

(35) Sort
Input [2]: [INFORMATION_STA_119303_CAPACITY_119304#7369L, INFORMATION_STA_119303_STATIONCODE_119307#7372]
Arguments: [INFORMATION_STA_119303_STATIONCODE_119307#7372 ASC NULLS FIRST], false, 0

(36) SortMergeJoin
Left keys [1]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327]
Right keys [1]: [INFORMATION_STA_119303_STATIONCODE_119307#7372]
Join type: Inner
Join condition: None

(37) Project
Output [22]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, bigint_to_int(INFORMATION_STA_119303_CAPACITY_119304#7369L) AS COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, dec_operator(SOMME, array(COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343)) AS COL_4886635E_35B3_4E90_94E4_401045F89277#7524, str_if_with_rule((CASE WHEN isnull(COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342) THEN false ELSE (COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342 > 0) END AND CASE WHEN isnull(COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343) THEN false ELSE (COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343 > 0) END), Mécaniques + Electriques, str_if_with_rule(CASE WHEN isnull(COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343) THEN false ELSE (COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343 > 0) END, Mécaniques, str_if_with_rule(CASE WHEN isnull(COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342) THEN false ELSE (COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342 > 0) END, Electriques, Pas de disponibilité))) AS COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546]
Input [21]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, INFORMATION_STA_119303_CAPACITY_119304#7369L, INFORMATION_STA_119303_STATIONCODE_119307#7372]

(38) Project
Output [24]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_4886635E_35B3_4E90_94E4_401045F89277#7524, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546, dec_to_int(dec_round(dec_operator(PRODUIT, array(dec_operator(DIVISION, array(COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, int_sum(array(COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340)))), 100.0)), 2)) AS COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, int_sum(array(COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502)) AS COL_69842CB9_D407_4477_8F44_680AF6209358#7689]
Input [22]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, COL_4886635E_35B3_4E90_94E4_401045F89277#7524, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546]

(39) Project
Output [25]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_4886635E_35B3_4E90_94E4_401045F89277#7524, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546, COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, RANKING_RESULTS_CONNECTOR(STOP_IF_TRUE, null, array(RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, < 10 %, less_or_equal, [10], [0], #EE4806, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 10 à 20 %, between, [10], [20], #E47F0A, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 20 à 30 %, between, [20], [30], #D7A80D, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 30 à 40 %, between, [30], [40], #CECE11, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 40 à 50 %, between, [40], [50], #99C515, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 50 à 60 %, between, [50], [60], #6BB918, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 60 à 70 %, between, [60], [70], #45B01B, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 70 à 80 %, between, [70], [80], #2BA91D, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, de 80 à 90, between, [80], [90], #1FA133, , null), RANKING_INTEGER(COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, > 90 %, greater_or_equal, [90], [0], #219A48, , null))) AS COL_C263C963_DBFC_4CA5_8638_D9F3EF4E4057#7860, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_69842CB9_D407_4477_8F44_680AF6209358#7689]
Input [24]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_4886635E_35B3_4E90_94E4_401045F89277#7524, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546, COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_69842CB9_D407_4477_8F44_680AF6209358#7689]

(40) WriteFiles
Input [25]: [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86#7327, COL_8A096969_1374_4168_B930_C219BC1F0591#7328, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69#7331, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3#7332, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5#7333, COL_AEF551A3_1A52_41DE_834C_26049DF5418E#7334, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B#7090, COL_9091B58C_8072_40BA_9B1C_4828078CF13A#7091, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07#7092, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522#7093, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859#7094, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6#7342, COL_5AF84147_5C5A_4A25_947C_12826B5080D0#7343, COL_2F07F797_35B4_491C_8255_10445B86EEB9#7344, COL_222816E0_1771_4A96_9C59_DB1900C311FE#7340, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC#7341, COL_4886635E_35B3_4E90_94E4_401045F89277#7524, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86#7546, COL_53FAED45_3ABA_424E_8D67_03AC323B7720#7686, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D#7345, COL_C263C963_DBFC_4CA5_8638_D9F3EF4E4057#7860, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE#7502, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1#7329, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42#7330, COL_69842CB9_D407_4477_8F44_680AF6209358#7689]

(41) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/cache/parquet/datablock/VLIB_JSON_119279, false, Parquet, [path=file:///data/output/cache/parquet/datablock/VLIB_JSON_119279], Overwrite, [COL_613DB6B3_74E6_4C99_93FD_E5777B617C86, COL_8A096969_1374_4168_B930_C219BC1F0591, COL_97AB7E74_3BCE_49E7_8A3B_33031418EF69, COL_AD1312C1_6861_42B9_A7D0_EA7744E2B8A3, COL_7FD543F8_0D7D_449F_A24D_451CCEB7A4C5, COL_AEF551A3_1A52_41DE_834C_26049DF5418E, COL_5420F0A0_5A46_4C41_B880_E8F826EA971B, COL_9091B58C_8072_40BA_9B1C_4828078CF13A, COL_CC9E2BDB_C960_436A_982D_74C88CB1DD07, COL_23FAB29C_0A26_4042_8FB0_7DE3807A5522, COL_3A63BBB5_425C_465D_B8B3_D2E0C982E859, COL_5A4A810B_AA07_436A_BF5B_A1602E4CABC6, COL_5AF84147_5C5A_4A25_947C_12826B5080D0, COL_2F07F797_35B4_491C_8255_10445B86EEB9, COL_222816E0_1771_4A96_9C59_DB1900C311FE, COL_3E307331_E38A_4A82_B27C_DCEDD6728DCC, COL_4886635E_35B3_4E90_94E4_401045F89277, COL_A5D96D13_F6F6_434E_A452_7C76A1CECD86, COL_53FAED45_3ABA_424E_8D67_03AC323B7720, COL_709AD995_7169_493D_9A7D_D64AFB1CC85D, COL_C263C963_DBFC_4CA5_8638_D9F3EF4E4057, COL_1D0F6719_56CC_493A_8046_1C0E7DFF06FE, COL_D8B2CF53_3DEF_4008_84F6_ABD7C7D519D1, COL_38FFE468_A29D_4849_A2C9_0363FA03FF42, COL_69842CB9_D407_4477_8F44_680AF6209358]

(42) AdaptiveSparkPlan
Output: []
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet