SP1 - Details for Query 7033

Submitted Time: 2026/10/27 17:44:24
Duration: 0.2 s
Succeeded Jobs: 10530 10531 10532

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" CollectLimit "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: total (min, med, max (stageId: taskId))\n66 ms (6 ms, 12 ms, 15 ms (stage 21053.0: task 27279))"; 2 [labelType="html" label=" Project "]; 3 [labelType="html" label="ColumnarToRow number of output rows: 1,201 number of input batches: 12"]; } 4 [labelType="html" label="Scan parquet number of files read: 12 scan time total (min, med, max (stageId: taskId)) 50 ms (5 ms, 9 ms, 12 ms (stage 21053.0: task 27279)) metadata time: 0 ms size of files read: 175.2 KiB number of output rows: 1,201"]; 2->0; 3->2; 4->3; }

CollectLimit 1500

Project [N%C2%B0#1691985 AS COL__N#1692763, null AS COL__IPP#1692764, str_complete(N%C2%B0+s%C3%A9jour#1691987, 0, 20, LEFT) AS COL__N_S_JOUR#1692765, initiales#1691988 AS COL__INITIALES#1692766, date+pose#1691989 AS COL__DATE_POSE#1692767, code+LPP#1691990 AS COL__CODE_LPP#1692768, libell%C3%A9+LPP#1691991 AS COL__LIBELL_LPP#1692769, quantit%C3%A9#1691992 AS COL__QUANTIT#1692770, prix+d%27achat+unitaire+%28%E2%82%AC+ttc%29#1691993 AS COL__PRIX_D_ACHAT_UNITAIRE_TTC#1692771, tarif+responsabilit%C3%A9+LPP+%28%E2%82%AC+ttc%29#1691994 AS COL__TARIF_RESPONSABILIT_LPP_TTC#1692772, d%C3%A9penses+d%C3%A9clar%C3%A9es+%28%E2%82%AC+ttc%29#1691995 AS COL__D_PENSES_D_CLAR_ES_TTC#1692773, d%C3%A9penses+au+tarif+LPP#1691996 AS COL__D_PENSES_AU_TARIF_LPP#1692774, majoration+%28%E2%82%AC+ttc%29#1691997 AS COL__MAJORATION_TTC#1692775, d%C3%A9penses+accord%C3%A9es+%28%E2%82%AC+ttc%29#1691998 AS COL__D_PENSES_ACCORD_ES_TTC#1692776, Fournisseur%2C+Libell%C3%A9+DMI#1692001 AS COL__FOURNISSEUR_LIBELL_DMI#1692777, commentaire#1692002 AS COL__COMMENTAIRE#1692778]

ColumnarToRow

WholeStageCodegen (1)

FileScan parquet [N%C2%B0#1691985,N%C2%B0+s%C3%A9jour#1691987,initiales#1691988,date+pose#1691989,code+LPP#1691990,libell%C3%A9+LPP#1691991,quantit%C3%A9#1691992,prix+d%27achat+unitaire+%28%E2%82%AC+ttc%29#1691993,tarif+responsabilit%C3%A9+LPP+%28%E2%82%AC+ttc%29#1691994,d%C3%A9penses+d%C3%A9clar%C3%A9es+%28%E2%82%AC+ttc%29#1691995,d%C3%A9penses+au+tarif+LPP#1691996,majoration+%28%E2%82%AC+ttc%29#1691997,d%C3%A9penses+accord%C3%A9es+%28%E2%82%AC+ttc%29#1691998,Fournisseur%2C+Libell%C3%A9+DMI#1692001,commentaire#1692002] Batched: true, DataFilters: [], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/excel/cache/SYNTHESE_DMI_20_237789_b7c9fcd90987..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<N%C2%B0:string,N%C2%B0+s%C3%A9jour:string,initiales:string,date+pose:string,code+LPP:strin...

Details

== Physical Plan ==
CollectLimit (4)
+- * Project (3)
   +- * ColumnarToRow (2)
      +- Scan parquet  (1)


(1) Scan parquet 
Output [15]: [N%C2%B0#1691985, N%C2%B0+s%C3%A9jour#1691987, initiales#1691988, date+pose#1691989, code+LPP#1691990, libell%C3%A9+LPP#1691991, quantit%C3%A9#1691992, prix+d%27achat+unitaire+%28%E2%82%AC+ttc%29#1691993, tarif+responsabilit%C3%A9+LPP+%28%E2%82%AC+ttc%29#1691994, d%C3%A9penses+d%C3%A9clar%C3%A9es+%28%E2%82%AC+ttc%29#1691995, d%C3%A9penses+au+tarif+LPP#1691996, majoration+%28%E2%82%AC+ttc%29#1691997, d%C3%A9penses+accord%C3%A9es+%28%E2%82%AC+ttc%29#1691998, Fournisseur%2C+Libell%C3%A9+DMI#1692001, commentaire#1692002]
Batched: true
Location: InMemoryFileIndex [file:/data/input/depot/excel/cache/SYNTHESE_DMI_20_237789_b7c9fcd90987f45e4002171a5d87dfdd/synthèse-DMI-2025.xls_41d136f5d26b76a99c371a1af7fc9e64]
ReadSchema: struct<N%C2%B0:string,N%C2%B0+s%C3%A9jour:string,initiales:string,date+pose:string,code+LPP:string,libell%C3%A9+LPP:string,quantit%C3%A9:string,prix+d%27achat+unitaire+%28%E2%82%AC+ttc%29:string,tarif+responsabilit%C3%A9+LPP+%28%E2%82%AC+ttc%29:string,d%C3%A9penses+d%C3%A9clar%C3%A9es+%28%E2%82%AC+ttc%29:string,d%C3%A9penses+au+tarif+LPP:string,majoration+%28%E2%82%AC+ttc%29:string,d%C3%A9penses+accord%C3%A9es+%28%E2%82%AC+ttc%29:string,Fournisseur%2C+Libell%C3%A9+DMI:string,commentaire:string>

(2) ColumnarToRow [codegen id : 1]
Input [15]: [N%C2%B0#1691985, N%C2%B0+s%C3%A9jour#1691987, initiales#1691988, date+pose#1691989, code+LPP#1691990, libell%C3%A9+LPP#1691991, quantit%C3%A9#1691992, prix+d%27achat+unitaire+%28%E2%82%AC+ttc%29#1691993, tarif+responsabilit%C3%A9+LPP+%28%E2%82%AC+ttc%29#1691994, d%C3%A9penses+d%C3%A9clar%C3%A9es+%28%E2%82%AC+ttc%29#1691995, d%C3%A9penses+au+tarif+LPP#1691996, majoration+%28%E2%82%AC+ttc%29#1691997, d%C3%A9penses+accord%C3%A9es+%28%E2%82%AC+ttc%29#1691998, Fournisseur%2C+Libell%C3%A9+DMI#1692001, commentaire#1692002]

(3) Project [codegen id : 1]
Output [16]: [N%C2%B0#1691985 AS COL__N#1692763, null AS COL__IPP#1692764, str_complete(N%C2%B0+s%C3%A9jour#1691987, 0, 20, LEFT) AS COL__N_S_JOUR#1692765, initiales#1691988 AS COL__INITIALES#1692766, date+pose#1691989 AS COL__DATE_POSE#1692767, code+LPP#1691990 AS COL__CODE_LPP#1692768, libell%C3%A9+LPP#1691991 AS COL__LIBELL_LPP#1692769, quantit%C3%A9#1691992 AS COL__QUANTIT#1692770, prix+d%27achat+unitaire+%28%E2%82%AC+ttc%29#1691993 AS COL__PRIX_D_ACHAT_UNITAIRE_TTC#1692771, tarif+responsabilit%C3%A9+LPP+%28%E2%82%AC+ttc%29#1691994 AS COL__TARIF_RESPONSABILIT_LPP_TTC#1692772, d%C3%A9penses+d%C3%A9clar%C3%A9es+%28%E2%82%AC+ttc%29#1691995 AS COL__D_PENSES_D_CLAR_ES_TTC#1692773, d%C3%A9penses+au+tarif+LPP#1691996 AS COL__D_PENSES_AU_TARIF_LPP#1692774, majoration+%28%E2%82%AC+ttc%29#1691997 AS COL__MAJORATION_TTC#1692775, d%C3%A9penses+accord%C3%A9es+%28%E2%82%AC+ttc%29#1691998 AS COL__D_PENSES_ACCORD_ES_TTC#1692776, Fournisseur%2C+Libell%C3%A9+DMI#1692001 AS COL__FOURNISSEUR_LIBELL_DMI#1692777, commentaire#1692002 AS COL__COMMENTAIRE#1692778]
Input [15]: [N%C2%B0#1691985, N%C2%B0+s%C3%A9jour#1691987, initiales#1691988, date+pose#1691989, code+LPP#1691990, libell%C3%A9+LPP#1691991, quantit%C3%A9#1691992, prix+d%27achat+unitaire+%28%E2%82%AC+ttc%29#1691993, tarif+responsabilit%C3%A9+LPP+%28%E2%82%AC+ttc%29#1691994, d%C3%A9penses+d%C3%A9clar%C3%A9es+%28%E2%82%AC+ttc%29#1691995, d%C3%A9penses+au+tarif+LPP#1691996, majoration+%28%E2%82%AC+ttc%29#1691997, d%C3%A9penses+accord%C3%A9es+%28%E2%82%AC+ttc%29#1691998, Fournisseur%2C+Libell%C3%A9+DMI#1692001, commentaire#1692002]

(4) CollectLimit
Input [16]: [COL__N#1692763, COL__IPP#1692764, COL__N_S_JOUR#1692765, COL__INITIALES#1692766, COL__DATE_POSE#1692767, COL__CODE_LPP#1692768, COL__LIBELL_LPP#1692769, COL__QUANTIT#1692770, COL__PRIX_D_ACHAT_UNITAIRE_TTC#1692771, COL__TARIF_RESPONSABILIT_LPP_TTC#1692772, COL__D_PENSES_D_CLAR_ES_TTC#1692773, COL__D_PENSES_AU_TARIF_LPP#1692774, COL__MAJORATION_TTC#1692775, COL__D_PENSES_ACCORD_ES_TTC#1692776, COL__FOURNISSEUR_LIBELL_DMI#1692777, COL__COMMENTAIRE#1692778]
Arguments: 1500

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet