SP1 - Details for Query 3093

Submitted Time: 2026/09/24 14:22:06
Duration: 0.4 s
Succeeded Jobs: 4491

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label="Execute InsertIntoHadoopFsRelationCommand task commit time: 1 ms number of written files: 1 job commit time: 21 ms number of output rows: 8 number of dynamic part: 0 written output: 2.5 KiB"]; 1 [labelType="html" label=" WriteFiles "]; subgraph cluster2 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 164 ms"; 3 [labelType="html" label=" Project "]; } 4 [labelType="html" label="BatchScan excel file:/data/input/depot/excel/tmp/07_SPECIALITE_S_216174/Info_Etab_init-XX.xlsx number of output rows: 8"]; 1->0; 3->1; 4->3; }

Execute InsertIntoHadoopFsRelationCommand file:/data/input/depot/excel/cache/07_SPECIALITE_S_216174_8c37e738f7546e6ed725ce5ec8cb0bd0/Info_Etab_init-XX.xlsx_6908a71dbe13128b9ab4dd7707cb93e4, false, Parquet, [path=file:///data/input/depot/excel/cache/07_SPECIALITE_S_216174_8c37e738f7546e6ed725ce5ec8cb0bd0/Info_Etab_init-XX.xlsx_6908a71dbe13128b9ab4dd7707cb93e4], ErrorIfExists, [Sp%C3%A9cialit%C3%A9+etab, Code+Etab, Codes+officiels, UF+exclue, 07_SPECIALITE_S_216174HEADER_COL_DETAIL_DEPOT]

WriteFiles

Project [Spécialité etab#727744 AS Sp%C3%A9cialit%C3%A9+etab#727762, Code Etab#727745 AS Code+Etab#727768, Codes officiels#727746 AS Codes+officiels#727774, UF exclue#727747 AS UF+exclue#727780, file:/data/input/depot/excel/tmp/07_SPECIALITE_S_216174/Info_Etab_init-XX.xlsx AS 07_SPECIALITE_S_216174HEADER_COL_DETAIL_DEPOT#727786]

WholeStageCodegen (1)

BatchScan excel file:/data/input/depot/excel/tmp/07_SPECIALITE_S_216174/Info_Etab_init-XX.xlsx[Spécialité etab#727744, Code Etab#727745, Codes officiels#727746, UF exclue#727747] ExcelScan DataFilters: [], Format: excel, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/excel/tmp/07_SPECIALITE_S_216174/Info_Etab_init..., PartitionFilters: [], ReadSchema: struct<Spécialité etab:string,Code Etab:string,Codes officiels:string,UF exclue:string>, PushedFilters: [] RuntimeFilters: []

Details

== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (4)
+- WriteFiles (3)
   +- * Project (2)
      +- BatchScan excel file:/data/input/depot/excel/tmp/07_SPECIALITE_S_216174/Info_Etab_init-XX.xlsx (1)


(1) BatchScan excel file:/data/input/depot/excel/tmp/07_SPECIALITE_S_216174/Info_Etab_init-XX.xlsx
Output [4]: [Spécialité etab#727744, Code Etab#727745, Codes officiels#727746, UF exclue#727747]
Format: excel
Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/excel/tmp/07_SPECIALITE_S_216174/Info_Etab_init-XX.xlsx]
ReadSchema: struct<Spécialité etab:string,Code Etab:string,Codes officiels:string,UF exclue:string>

(2) Project [codegen id : 1]
Output [5]: [Spécialité etab#727744 AS Sp%C3%A9cialit%C3%A9+etab#727762, Code Etab#727745 AS Code+Etab#727768, Codes officiels#727746 AS Codes+officiels#727774, UF exclue#727747 AS UF+exclue#727780, file:/data/input/depot/excel/tmp/07_SPECIALITE_S_216174/Info_Etab_init-XX.xlsx AS 07_SPECIALITE_S_216174HEADER_COL_DETAIL_DEPOT#727786]
Input [4]: [Spécialité etab#727744, Code Etab#727745, Codes officiels#727746, UF exclue#727747]

(3) WriteFiles
Input [5]: [Sp%C3%A9cialit%C3%A9+etab#727762, Code+Etab#727768, Codes+officiels#727774, UF+exclue#727780, 07_SPECIALITE_S_216174HEADER_COL_DETAIL_DEPOT#727786]

(4) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/input/depot/excel/cache/07_SPECIALITE_S_216174_8c37e738f7546e6ed725ce5ec8cb0bd0/Info_Etab_init-XX.xlsx_6908a71dbe13128b9ab4dd7707cb93e4, false, Parquet, [path=file:///data/input/depot/excel/cache/07_SPECIALITE_S_216174_8c37e738f7546e6ed725ce5ec8cb0bd0/Info_Etab_init-XX.xlsx_6908a71dbe13128b9ab4dd7707cb93e4], ErrorIfExists, [Sp%C3%A9cialit%C3%A9+etab, Code+Etab, Codes+officiels, UF+exclue, 07_SPECIALITE_S_216174HEADER_COL_DETAIL_DEPOT]

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet