SP1 - Details for Query 34

Submitted Time: 2026/04/20 11:08:34
Duration: 0.6 s
Succeeded Jobs: 27

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" DeserializeToObject "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: total (min, med, max (stageId: taskId))\n701 ms (338 ms, 363 ms, 363 ms (stage 42.0: task 33))"; 2 [labelType="html" label=" Project "]; 3 [labelType="html" label="Scan ExistingRDD number of output rows: 11,307"]; } 2->0; 3->2; }

DeserializeToObject createexternalrow(staticinvoke(class java.lang.Long, ObjectType(class java.lang.Long), valueOf, delai_1#6032L, true, false, true), libelle_unite_medicale#6033.toString, staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, valeur_ref_min#6034, true, false, true), id_patient#6035.toString, date_naissance#6036.toString, unite#6037.toString, libelle_analyse#6038.toString, sexe#6039.toString, staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, valeur#6040, true, false, true), staticinvoke(class org.apache.spark.sql.catalyst.util.DateTimeUtils$, ObjectType(class java.sql.Timestamp), toJavaTimestamp, date_debut_sejour#6041, true, false, true), code_unite_medicale#6042.toString, staticinvoke(class org.apache.spark.sql.catalyst.util.DateTimeUtils$, ObjectType(class java.sql.Timestamp), toJavaTimestamp, date_fin_sejour#6043, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, valeur_ref_max#6044, true, false, true), staticinvoke(class java.lang.Long, ObjectType(class java.lang.Long), valueOf, delai_2#6045L, true, false, true), staticinvoke(class org.apache.spark.sql.catalyst.util.DateTimeUtils$, ObjectType(class java.sql.Timestamp), toJavaTimestamp, date_prelevement#6046, true, false, true), code_analyse#6047.toString, staticinvoke(class java.lang.Long, ObjectType(class java.lang.Long), valueOf, id_dc_do_not_overwrite_biologie_patien_388165#6064L, true, false, true), StructField(delai_1,LongType,true), StructField(libelle_unite_medicale,StringType,true), StructField(valeur_ref_min,DoubleType,true), StructField(id_patient,StringType,true), StructField(date_naissance,StringType,true), StructField(unite,StringType,true), StructField(libelle_analyse,StringType,true), ... 10 more fields), obj#6116: org.apache.spark.sql.Row

Project [delai_1#6032L, libelle_unite_medicale#6033, valeur_ref_min#6034, id_patient#6035, date_naissance#6036, unite#6037, libelle_analyse#6038, sexe#6039, valeur#6040, date_debut_sejour#6041, code_unite_medicale#6042, date_fin_sejour#6043, valeur_ref_max#6044, delai_2#6045L, date_prelevement#6046, code_analyse#6047, monotonically_increasing_id() AS id_dc_do_not_overwrite_biologie_patien_388165#6064L]

Scan ExistingRDD[delai_1#6032L,libelle_unite_medicale#6033,valeur_ref_min#6034,id_patient#6035,date_naissance#6036,unite#6037,libelle_analyse#6038,sexe#6039,valeur#6040,date_debut_sejour#6041,code_unite_medicale#6042,date_fin_sejour#6043,valeur_ref_max#6044,delai_2#6045L,date_prelevement#6046,code_analyse#6047]

WholeStageCodegen (1)

Details

== Physical Plan ==
DeserializeToObject (3)
+- * Project (2)
   +- * Scan ExistingRDD (1)


(1) Scan ExistingRDD [codegen id : 1]
Output [16]: [delai_1#6032L, libelle_unite_medicale#6033, valeur_ref_min#6034, id_patient#6035, date_naissance#6036, unite#6037, libelle_analyse#6038, sexe#6039, valeur#6040, date_debut_sejour#6041, code_unite_medicale#6042, date_fin_sejour#6043, valeur_ref_max#6044, delai_2#6045L, date_prelevement#6046, code_analyse#6047]
Arguments: [delai_1#6032L, libelle_unite_medicale#6033, valeur_ref_min#6034, id_patient#6035, date_naissance#6036, unite#6037, libelle_analyse#6038, sexe#6039, valeur#6040, date_debut_sejour#6041, code_unite_medicale#6042, date_fin_sejour#6043, valeur_ref_max#6044, delai_2#6045L, date_prelevement#6046, code_analyse#6047], MapPartitionsRDD[187] at createDataFrame at AbsExportExecutor.java:55, ExistingRDD, UnknownPartitioning(0)

(2) Project [codegen id : 1]
Output [17]: [delai_1#6032L, libelle_unite_medicale#6033, valeur_ref_min#6034, id_patient#6035, date_naissance#6036, unite#6037, libelle_analyse#6038, sexe#6039, valeur#6040, date_debut_sejour#6041, code_unite_medicale#6042, date_fin_sejour#6043, valeur_ref_max#6044, delai_2#6045L, date_prelevement#6046, code_analyse#6047, monotonically_increasing_id() AS id_dc_do_not_overwrite_biologie_patien_388165#6064L]
Input [16]: [delai_1#6032L, libelle_unite_medicale#6033, valeur_ref_min#6034, id_patient#6035, date_naissance#6036, unite#6037, libelle_analyse#6038, sexe#6039, valeur#6040, date_debut_sejour#6041, code_unite_medicale#6042, date_fin_sejour#6043, valeur_ref_max#6044, delai_2#6045L, date_prelevement#6046, code_analyse#6047]

(3) DeserializeToObject
Input [17]: [delai_1#6032L, libelle_unite_medicale#6033, valeur_ref_min#6034, id_patient#6035, date_naissance#6036, unite#6037, libelle_analyse#6038, sexe#6039, valeur#6040, date_debut_sejour#6041, code_unite_medicale#6042, date_fin_sejour#6043, valeur_ref_max#6044, delai_2#6045L, date_prelevement#6046, code_analyse#6047, id_dc_do_not_overwrite_biologie_patien_388165#6064L]
Arguments: createexternalrow(staticinvoke(class java.lang.Long, ObjectType(class java.lang.Long), valueOf, delai_1#6032L, true, false, true), libelle_unite_medicale#6033.toString, staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, valeur_ref_min#6034, true, false, true), id_patient#6035.toString, date_naissance#6036.toString, unite#6037.toString, libelle_analyse#6038.toString, sexe#6039.toString, staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, valeur#6040, true, false, true), staticinvoke(class org.apache.spark.sql.catalyst.util.DateTimeUtils$, ObjectType(class java.sql.Timestamp), toJavaTimestamp, date_debut_sejour#6041, true, false, true), code_unite_medicale#6042.toString, staticinvoke(class org.apache.spark.sql.catalyst.util.DateTimeUtils$, ObjectType(class java.sql.Timestamp), toJavaTimestamp, date_fin_sejour#6043, true, false, true), staticinvoke(class java.lang.Double, ObjectType(class java.lang.Double), valueOf, valeur_ref_max#6044, true, false, true), staticinvoke(class java.lang.Long, ObjectType(class java.lang.Long), valueOf, delai_2#6045L, true, false, true), staticinvoke(class org.apache.spark.sql.catalyst.util.DateTimeUtils$, ObjectType(class java.sql.Timestamp), toJavaTimestamp, date_prelevement#6046, true, false, true), code_analyse#6047.toString, staticinvoke(class java.lang.Long, ObjectType(class java.lang.Long), valueOf, id_dc_do_not_overwrite_biologie_patien_388165#6064L, true, false, true), StructField(delai_1,LongType,true), StructField(libelle_unite_medicale,StringType,true), StructField(valeur_ref_min,DoubleType,true), StructField(id_patient,StringType,true), StructField(date_naissance,StringType,true), StructField(unite,StringType,true), StructField(libelle_analyse,StringType,true), ... 10 more fields), obj#6116: org.apache.spark.sql.Row

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet