SP1 - Details for Query 336

Submitted Time: 2026/04/21 12:03:49
Duration: 63 ms
Succeeded Jobs: 359

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" CollectLimit "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 5 ms"; 2 [labelType="html" label=" Project "]; } 3 [labelType="html" label="Scan csv number of output rows: 0 number of files read: 1 metadata time: 0 ms size of files read: 2.0 B"]; 2->0; 3->2; }

CollectLimit 1500

Project [c0#87119 AS COL_COLONNE_390645#87727, c0#87119 AS COL_DTYPE_PANDAS_390646#87728, c0#87119 AS COL_TYPE_INFERE_390647#87729, cast(c0#87119 as bigint) AS COL_ANALYSE_NB_TOTA_390648#87730L, cast(c0#87119 as bigint) AS COL_ANALYSE_NB_NULL_390649#87731L, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_PCT_NUL_390650#87732, cast(c0#87119 as bigint) AS COL_ANALYSE_NB_NON__390651#87733L, cast(c0#87119 as bigint) AS COL_ANALYSE_NB_DIST_390652#87734L, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_MIN_390653#87735, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_MAX_390654#87736, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_ETENDUE_390655#87737, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_MOYENNE_390656#87738, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_MEDIANE_390657#87739, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_VARIANC_390658#87740, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_ECART_T_390659#87741, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_SKEWNES_390660#87742, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_KURTOSI_390661#87743, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_Q1_390662#87744, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_MEDIANE_390663#87745, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_Q3_390664#87746, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_IQR_390665#87747, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_OUTL_390666#87748, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_PCT_OUT_390667#87749, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_ZERO_390668#87750, ... 36 more fields]

WholeStageCodegen (1)

FileScan csv [c0#87119] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/execution/empty.csv], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<c0:string>

Details

== Physical Plan ==
CollectLimit (3)
+- * Project (2)
   +- Scan csv  (1)


(1) Scan csv 
Output [1]: [c0#87119]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/execution/empty.csv]
ReadSchema: struct<c0:string>

(2) Project [codegen id : 1]
Output [60]: [c0#87119 AS COL_COLONNE_390645#87727, c0#87119 AS COL_DTYPE_PANDAS_390646#87728, c0#87119 AS COL_TYPE_INFERE_390647#87729, cast(c0#87119 as bigint) AS COL_ANALYSE_NB_TOTA_390648#87730L, cast(c0#87119 as bigint) AS COL_ANALYSE_NB_NULL_390649#87731L, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_PCT_NUL_390650#87732, cast(c0#87119 as bigint) AS COL_ANALYSE_NB_NON__390651#87733L, cast(c0#87119 as bigint) AS COL_ANALYSE_NB_DIST_390652#87734L, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_MIN_390653#87735, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_MAX_390654#87736, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_ETENDUE_390655#87737, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_MOYENNE_390656#87738, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_MEDIANE_390657#87739, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_VARIANC_390658#87740, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_ECART_T_390659#87741, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_SKEWNES_390660#87742, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_KURTOSI_390661#87743, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_Q1_390662#87744, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_MEDIANE_390663#87745, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_Q3_390664#87746, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_IQR_390665#87747, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_OUTL_390666#87748, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_PCT_OUT_390667#87749, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_ZERO_390668#87750, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_NEGA_390669#87751, c0#87119 AS COL_ANALYSE_TOP_10__390670#87752, c0#87119 AS COL_ANALYSE_DISTRIB_390671#87753, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_VIDE_390672#87754, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_PCT_VID_390673#87755, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_WHIT_390674#87756, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_LEAD_390675#87757, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_TRAI_390676#87758, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_LEAD_390677#87759, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_LONGUEU_390678#87760, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_LONGUEU_390679#87761, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_LONGUEU_390680#87762, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_LONGUEU_390681#87763, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_LONGUEU_390682#87764, c0#87119 AS COL_ANALYSE_VALEUR__390683#87765, c0#87119 AS COL_ANALYSE_VALEUR__390684#87766, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_AVEC_390685#87767, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_AVEC_390686#87768, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_UPPE_390687#87769, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_LOWE_390688#87770, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_MIXT_390689#87771, c0#87119 AS COL_ANALYSE_DATETIM_390690#87772, c0#87119 AS COL_ANALYSE_DATETIM_390691#87773, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_ETENDUE_390692#87774, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_ETENDUE_390693#87775, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_ANNEE_M_390694#87776, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_ANNEE_M_390695#87777, c0#87119 AS COL_ANALYSE_TIMEZON_390696#87778, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_WEEK_390697#87779, cast(REFORMAT_FOR_DOUBLE(c0#87119) as double) AS COL_ANALYSE_NB_SEMA_390698#87780, c0#87119 AS COL_ANALYSE_DISTRIB_390699#87781, c0#87119 AS COL_ANALYSE_DISTRIB_390700#87782, c0#87119 AS COL_ANALYSE_DISTRIB_390701#87783, c0#87119 AS COL_ANALYSE_DISTRIB_390702#87784, c0#87119 AS COL_SOURCE_390703#87785, c0#87119 AS COL_HORODATAGE_TRAI_390704#87786]
Input [1]: [c0#87119]

(3) CollectLimit
Input [60]: [COL_COLONNE_390645#87727, COL_DTYPE_PANDAS_390646#87728, COL_TYPE_INFERE_390647#87729, COL_ANALYSE_NB_TOTA_390648#87730L, COL_ANALYSE_NB_NULL_390649#87731L, COL_ANALYSE_PCT_NUL_390650#87732, COL_ANALYSE_NB_NON__390651#87733L, COL_ANALYSE_NB_DIST_390652#87734L, COL_ANALYSE_MIN_390653#87735, COL_ANALYSE_MAX_390654#87736, COL_ANALYSE_ETENDUE_390655#87737, COL_ANALYSE_MOYENNE_390656#87738, COL_ANALYSE_MEDIANE_390657#87739, COL_ANALYSE_VARIANC_390658#87740, COL_ANALYSE_ECART_T_390659#87741, COL_ANALYSE_SKEWNES_390660#87742, COL_ANALYSE_KURTOSI_390661#87743, COL_ANALYSE_Q1_390662#87744, COL_ANALYSE_MEDIANE_390663#87745, COL_ANALYSE_Q3_390664#87746, COL_ANALYSE_IQR_390665#87747, COL_ANALYSE_NB_OUTL_390666#87748, COL_ANALYSE_PCT_OUT_390667#87749, COL_ANALYSE_NB_ZERO_390668#87750, COL_ANALYSE_NB_NEGA_390669#87751, COL_ANALYSE_TOP_10__390670#87752, COL_ANALYSE_DISTRIB_390671#87753, COL_ANALYSE_NB_VIDE_390672#87754, COL_ANALYSE_PCT_VID_390673#87755, COL_ANALYSE_NB_WHIT_390674#87756, COL_ANALYSE_NB_LEAD_390675#87757, COL_ANALYSE_NB_TRAI_390676#87758, COL_ANALYSE_NB_LEAD_390677#87759, COL_ANALYSE_LONGUEU_390678#87760, COL_ANALYSE_LONGUEU_390679#87761, COL_ANALYSE_LONGUEU_390680#87762, COL_ANALYSE_LONGUEU_390681#87763, COL_ANALYSE_LONGUEU_390682#87764, COL_ANALYSE_VALEUR__390683#87765, COL_ANALYSE_VALEUR__390684#87766, COL_ANALYSE_NB_AVEC_390685#87767, COL_ANALYSE_NB_AVEC_390686#87768, COL_ANALYSE_NB_UPPE_390687#87769, COL_ANALYSE_NB_LOWE_390688#87770, COL_ANALYSE_NB_MIXT_390689#87771, COL_ANALYSE_DATETIM_390690#87772, COL_ANALYSE_DATETIM_390691#87773, COL_ANALYSE_ETENDUE_390692#87774, COL_ANALYSE_ETENDUE_390693#87775, COL_ANALYSE_ANNEE_M_390694#87776, COL_ANALYSE_ANNEE_M_390695#87777, COL_ANALYSE_TIMEZON_390696#87778, COL_ANALYSE_NB_WEEK_390697#87779, COL_ANALYSE_NB_SEMA_390698#87780, COL_ANALYSE_DISTRIB_390699#87781, COL_ANALYSE_DISTRIB_390700#87782, COL_ANALYSE_DISTRIB_390701#87783, COL_ANALYSE_DISTRIB_390702#87784, COL_SOURCE_390703#87785, COL_HORODATAGE_TRAI_390704#87786]
Arguments: 1500

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet