== Physical Plan ==
AdaptiveSparkPlan (9)
+- == Final Plan ==
Execute InsertIntoHadoopFsRelationCommand (5)
+- WriteFiles (4)
+- ShuffleQueryStage (3), Statistics(sizeInBytes=2028.6 KiB, rowCount=5.07E+3)
+- Exchange (2)
+- * Scan ExistingRDD (1)
+- == Initial Plan ==
Execute InsertIntoHadoopFsRelationCommand (8)
+- WriteFiles (7)
+- Exchange (6)
+- Scan ExistingRDD (1)
(1) Scan ExistingRDD [codegen id : 1]
Output [33]: [Produit_ID#122517, Quantite#122518, Code_promo#122519, Prix_unitaire_facture#122520, Montant_facture#122521, Client_ID#122522, Date#122523, Annee_mois#122524, Transaction_ID#122525, Region-[Norm]#122526, Currency-[Norm]#122527, Date-[Norm]#122528, Campagne_ID#122529, Jour-Semaine#122530, Freebe#122531, Premium#122532, Categorie_Products_ref#122533, Type_Products_ref#122534, Prix_unitaire#122535, Prix_revient#122536, Client_premium#122537, Client_region#122538, GBP#122539, USD#122540, JPY#122541, PrixUnitaireFacture-Euros#122542, MontantFacture-Euros#122543, Ecart-PrixUnitaireReference#122544, Ecart-PrixRevientReference#122545, Ecart-PrixFactureReferent#122546, Ecart-PrixFacturerevientReference#122547, Marge-Therorique#122548, Marge-Reelle#122549]
Arguments: [Produit_ID#122517, Quantite#122518, Code_promo#122519, Prix_unitaire_facture#122520, Montant_facture#122521, Client_ID#122522, Date#122523, Annee_mois#122524, Transaction_ID#122525, Region-[Norm]#122526, Currency-[Norm]#122527, Date-[Norm]#122528, Campagne_ID#122529, Jour-Semaine#122530, Freebe#122531, Premium#122532, Categorie_Products_ref#122533, Type_Products_ref#122534, Prix_unitaire#122535, Prix_revient#122536, Client_premium#122537, Client_region#122538, GBP#122539, USD#122540, ... 9 more fields], MapPartitionsRDD[1577] at createDataFrame at AbsExportExecutor.java:55, ExistingRDD, UnknownPartitioning(0)
(2) Exchange
Input [33]: [Produit_ID#122517, Quantite#122518, Code_promo#122519, Prix_unitaire_facture#122520, Montant_facture#122521, Client_ID#122522, Date#122523, Annee_mois#122524, Transaction_ID#122525, Region-[Norm]#122526, Currency-[Norm]#122527, Date-[Norm]#122528, Campagne_ID#122529, Jour-Semaine#122530, Freebe#122531, Premium#122532, Categorie_Products_ref#122533, Type_Products_ref#122534, Prix_unitaire#122535, Prix_revient#122536, Client_premium#122537, Client_region#122538, GBP#122539, USD#122540, JPY#122541, PrixUnitaireFacture-Euros#122542, MontantFacture-Euros#122543, Ecart-PrixUnitaireReference#122544, Ecart-PrixRevientReference#122545, Ecart-PrixFactureReferent#122546, Ecart-PrixFacturerevientReference#122547, Marge-Therorique#122548, Marge-Reelle#122549]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=10324]
(3) ShuffleQueryStage
Output [33]: [Produit_ID#122517, Quantite#122518, Code_promo#122519, Prix_unitaire_facture#122520, Montant_facture#122521, Client_ID#122522, Date#122523, Annee_mois#122524, Transaction_ID#122525, Region-[Norm]#122526, Currency-[Norm]#122527, Date-[Norm]#122528, Campagne_ID#122529, Jour-Semaine#122530, Freebe#122531, Premium#122532, Categorie_Products_ref#122533, Type_Products_ref#122534, Prix_unitaire#122535, Prix_revient#122536, Client_premium#122537, Client_region#122538, GBP#122539, USD#122540, JPY#122541, PrixUnitaireFacture-Euros#122542, MontantFacture-Euros#122543, Ecart-PrixUnitaireReference#122544, Ecart-PrixRevientReference#122545, Ecart-PrixFactureReferent#122546, Ecart-PrixFacturerevientReference#122547, Marge-Therorique#122548, Marge-Reelle#122549]
Arguments: 0
(4) WriteFiles
Input [33]: [Produit_ID#122517, Quantite#122518, Code_promo#122519, Prix_unitaire_facture#122520, Montant_facture#122521, Client_ID#122522, Date#122523, Annee_mois#122524, Transaction_ID#122525, Region-[Norm]#122526, Currency-[Norm]#122527, Date-[Norm]#122528, Campagne_ID#122529, Jour-Semaine#122530, Freebe#122531, Premium#122532, Categorie_Products_ref#122533, Type_Products_ref#122534, Prix_unitaire#122535, Prix_revient#122536, Client_premium#122537, Client_region#122538, GBP#122539, USD#122540, JPY#122541, PrixUnitaireFacture-Euros#122542, MontantFacture-Euros#122543, Ecart-PrixUnitaireReference#122544, Ecart-PrixRevientReference#122545, Ecart-PrixFactureReferent#122546, Ecart-PrixFacturerevientReference#122547, Marge-Therorique#122548, Marge-Reelle#122549]
(5) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/export/parquet/e0c0d51d-9f21-4da1-ade6-0146295e65a4, false, Parquet, [path=file:///data/output/export/parquet/e0c0d51d-9f21-4da1-ade6-0146295e65a4], ErrorIfExists, [Produit_ID, Quantite, Code_promo, Prix_unitaire_facture, Montant_facture, Client_ID, Date, Annee_mois, Transaction_ID, Region-[Norm], Currency-[Norm], Date-[Norm], Campagne_ID, Jour-Semaine, Freebe, Premium, Categorie_Products_ref, Type_Products_ref, Prix_unitaire, Prix_revient, Client_premium, Client_region, GBP, USD, ... 9 more fields]
(6) Exchange
Input [33]: [Produit_ID#122517, Quantite#122518, Code_promo#122519, Prix_unitaire_facture#122520, Montant_facture#122521, Client_ID#122522, Date#122523, Annee_mois#122524, Transaction_ID#122525, Region-[Norm]#122526, Currency-[Norm]#122527, Date-[Norm]#122528, Campagne_ID#122529, Jour-Semaine#122530, Freebe#122531, Premium#122532, Categorie_Products_ref#122533, Type_Products_ref#122534, Prix_unitaire#122535, Prix_revient#122536, Client_premium#122537, Client_region#122538, GBP#122539, USD#122540, JPY#122541, PrixUnitaireFacture-Euros#122542, MontantFacture-Euros#122543, Ecart-PrixUnitaireReference#122544, Ecart-PrixRevientReference#122545, Ecart-PrixFactureReferent#122546, Ecart-PrixFacturerevientReference#122547, Marge-Therorique#122548, Marge-Reelle#122549]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=10317]
(7) WriteFiles
Input [33]: [Produit_ID#122517, Quantite#122518, Code_promo#122519, Prix_unitaire_facture#122520, Montant_facture#122521, Client_ID#122522, Date#122523, Annee_mois#122524, Transaction_ID#122525, Region-[Norm]#122526, Currency-[Norm]#122527, Date-[Norm]#122528, Campagne_ID#122529, Jour-Semaine#122530, Freebe#122531, Premium#122532, Categorie_Products_ref#122533, Type_Products_ref#122534, Prix_unitaire#122535, Prix_revient#122536, Client_premium#122537, Client_region#122538, GBP#122539, USD#122540, JPY#122541, PrixUnitaireFacture-Euros#122542, MontantFacture-Euros#122543, Ecart-PrixUnitaireReference#122544, Ecart-PrixRevientReference#122545, Ecart-PrixFactureReferent#122546, Ecart-PrixFacturerevientReference#122547, Marge-Therorique#122548, Marge-Reelle#122549]
(8) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/export/parquet/e0c0d51d-9f21-4da1-ade6-0146295e65a4, false, Parquet, [path=file:///data/output/export/parquet/e0c0d51d-9f21-4da1-ade6-0146295e65a4], ErrorIfExists, [Produit_ID, Quantite, Code_promo, Prix_unitaire_facture, Montant_facture, Client_ID, Date, Annee_mois, Transaction_ID, Region-[Norm], Currency-[Norm], Date-[Norm], Campagne_ID, Jour-Semaine, Freebe, Premium, Categorie_Products_ref, Type_Products_ref, Prix_unitaire, Prix_revient, Client_premium, Client_region, GBP, USD, ... 9 more fields]
(9) AdaptiveSparkPlan
Output: []
Arguments: isFinalPlan=true