SP1 - Details for Query 7038

Submitted Time: 2026/10/27 18:15:11
Duration: 73 ms
Succeeded Jobs: 10538

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" CollectLimit "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 6 ms"; 2 [labelType="html" label=" Project "]; 3 [labelType="html" label="ColumnarToRow number of output rows: 295 number of input batches: 1"]; } 4 [labelType="html" label="Scan parquet number of files read: 1 scan time: 3 ms metadata time: 0 ms size of files read: 16.7 KiB number of output rows: 295"]; 2->0; 3->2; 4->3; }

CollectLimit 1500

Project [num%C3%A9ro+suivi+DIM#1693902 AS COL__NUM_RO_SUIVI_DIM#1694454, date+envoi+DIM#1693903 AS COL__DATE_ENVOI_DIM#1694455, null AS COL__IPP#1694456, N%C2%B0+SEJOUR#1693905 AS COL__N_SEJOUR#1694457, Type+de+prestation#1693906 AS COL__TYPE_DE_PRESTATION#1694458, UCD#1693907 AS COL__UCD#1694459, produit#1693908 AS COL__PRODUIT#1694460, quantit%C3%A9s#1693909 AS COL__QUANTIT_S#1694461, prix+d%27achat%0Aunitaire+%28%E2%82%AC+ttc%29#1693910 AS COL__PRIX_D_ACHAT_UNITAIRE_TTC#1694462, tarif+de+responsabilit%C3%A9+%28%E2%82%AC+ttc%29#1693911 AS COL__TARIF_DE_RESPONSABILIT_TTC#1694463, montant+d%C3%A9clar%C3%A9%0Atotal+%28%E2%82%AC+ttc%29#1693912 AS COL__MONTANT_D_CLAR_TOTAL_TTC#1694464, majoration+%28%E2%82%AC+ttc%29#1693913 AS COL__MAJORATION_TTC#1694465, montant+total+accord%C3%A9+%28%E2%82%AC+ttc%29#1693914 AS COL__MONTANT_TOTAL_ACCORD_TTC#1694466, SERVICE#1693915 AS COL__SERVICE#1694467, INDICATION#1693916 AS COL__INDICATION#1694468, ADMIN.#1693917 AS COL__ADMIN#1694469]

ColumnarToRow

WholeStageCodegen (1)

FileScan parquet [num%C3%A9ro+suivi+DIM#1693902,date+envoi+DIM#1693903,N%C2%B0+SEJOUR#1693905,Type+de+prestation#1693906,UCD#1693907,produit#1693908,quantit%C3%A9s#1693909,prix+d%27achat%0Aunitaire+%28%E2%82%AC+ttc%29#1693910,tarif+de+responsabilit%C3%A9+%28%E2%82%AC+ttc%29#1693911,montant+d%C3%A9clar%C3%A9%0Atotal+%28%E2%82%AC+ttc%29#1693912,majoration+%28%E2%82%AC+ttc%29#1693913,montant+total+accord%C3%A9+%28%E2%82%AC+ttc%29#1693914,SERVICE#1693915,INDICATION#1693916,ADMIN.#1693917] Batched: true, DataFilters: [], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/excel/cache/SYNTHESE_MO_202_237812_bd57d7746602..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<num%C3%A9ro+suivi+DIM:string,date+envoi+DIM:string,N%C2%B0+SEJOUR:string,Type+de+prestatio...

Details

== Physical Plan ==
CollectLimit (4)
+- * Project (3)
   +- * ColumnarToRow (2)
      +- Scan parquet  (1)


(1) Scan parquet 
Output [15]: [num%C3%A9ro+suivi+DIM#1693902, date+envoi+DIM#1693903, N%C2%B0+SEJOUR#1693905, Type+de+prestation#1693906, UCD#1693907, produit#1693908, quantit%C3%A9s#1693909, prix+d%27achat%0Aunitaire+%28%E2%82%AC+ttc%29#1693910, tarif+de+responsabilit%C3%A9+%28%E2%82%AC+ttc%29#1693911, montant+d%C3%A9clar%C3%A9%0Atotal+%28%E2%82%AC+ttc%29#1693912, majoration+%28%E2%82%AC+ttc%29#1693913, montant+total+accord%C3%A9+%28%E2%82%AC+ttc%29#1693914, SERVICE#1693915, INDICATION#1693916, ADMIN.#1693917]
Batched: true
Location: InMemoryFileIndex [file:/data/input/depot/excel/cache/SYNTHESE_MO_202_237812_bd57d77466024fccdf18ace5a6e64d03/synthèse-MO-2025.xlsx_6fa2b969a426becf7b2379293a107a75]
ReadSchema: struct<num%C3%A9ro+suivi+DIM:string,date+envoi+DIM:string,N%C2%B0+SEJOUR:string,Type+de+prestation:string,UCD:string,produit:string,quantit%C3%A9s:string,prix+d%27achat%0Aunitaire+%28%E2%82%AC+ttc%29:string,tarif+de+responsabilit%C3%A9+%28%E2%82%AC+ttc%29:string,montant+d%C3%A9clar%C3%A9%0Atotal+%28%E2%82%AC+ttc%29:string,majoration+%28%E2%82%AC+ttc%29:string,montant+total+accord%C3%A9+%28%E2%82%AC+ttc%29:string,SERVICE:string,INDICATION:string,ADMIN.:string>

(2) ColumnarToRow [codegen id : 1]
Input [15]: [num%C3%A9ro+suivi+DIM#1693902, date+envoi+DIM#1693903, N%C2%B0+SEJOUR#1693905, Type+de+prestation#1693906, UCD#1693907, produit#1693908, quantit%C3%A9s#1693909, prix+d%27achat%0Aunitaire+%28%E2%82%AC+ttc%29#1693910, tarif+de+responsabilit%C3%A9+%28%E2%82%AC+ttc%29#1693911, montant+d%C3%A9clar%C3%A9%0Atotal+%28%E2%82%AC+ttc%29#1693912, majoration+%28%E2%82%AC+ttc%29#1693913, montant+total+accord%C3%A9+%28%E2%82%AC+ttc%29#1693914, SERVICE#1693915, INDICATION#1693916, ADMIN.#1693917]

(3) Project [codegen id : 1]
Output [16]: [num%C3%A9ro+suivi+DIM#1693902 AS COL__NUM_RO_SUIVI_DIM#1694454, date+envoi+DIM#1693903 AS COL__DATE_ENVOI_DIM#1694455, null AS COL__IPP#1694456, N%C2%B0+SEJOUR#1693905 AS COL__N_SEJOUR#1694457, Type+de+prestation#1693906 AS COL__TYPE_DE_PRESTATION#1694458, UCD#1693907 AS COL__UCD#1694459, produit#1693908 AS COL__PRODUIT#1694460, quantit%C3%A9s#1693909 AS COL__QUANTIT_S#1694461, prix+d%27achat%0Aunitaire+%28%E2%82%AC+ttc%29#1693910 AS COL__PRIX_D_ACHAT_UNITAIRE_TTC#1694462, tarif+de+responsabilit%C3%A9+%28%E2%82%AC+ttc%29#1693911 AS COL__TARIF_DE_RESPONSABILIT_TTC#1694463, montant+d%C3%A9clar%C3%A9%0Atotal+%28%E2%82%AC+ttc%29#1693912 AS COL__MONTANT_D_CLAR_TOTAL_TTC#1694464, majoration+%28%E2%82%AC+ttc%29#1693913 AS COL__MAJORATION_TTC#1694465, montant+total+accord%C3%A9+%28%E2%82%AC+ttc%29#1693914 AS COL__MONTANT_TOTAL_ACCORD_TTC#1694466, SERVICE#1693915 AS COL__SERVICE#1694467, INDICATION#1693916 AS COL__INDICATION#1694468, ADMIN.#1693917 AS COL__ADMIN#1694469]
Input [15]: [num%C3%A9ro+suivi+DIM#1693902, date+envoi+DIM#1693903, N%C2%B0+SEJOUR#1693905, Type+de+prestation#1693906, UCD#1693907, produit#1693908, quantit%C3%A9s#1693909, prix+d%27achat%0Aunitaire+%28%E2%82%AC+ttc%29#1693910, tarif+de+responsabilit%C3%A9+%28%E2%82%AC+ttc%29#1693911, montant+d%C3%A9clar%C3%A9%0Atotal+%28%E2%82%AC+ttc%29#1693912, majoration+%28%E2%82%AC+ttc%29#1693913, montant+total+accord%C3%A9+%28%E2%82%AC+ttc%29#1693914, SERVICE#1693915, INDICATION#1693916, ADMIN.#1693917]

(4) CollectLimit
Input [16]: [COL__NUM_RO_SUIVI_DIM#1694454, COL__DATE_ENVOI_DIM#1694455, COL__IPP#1694456, COL__N_SEJOUR#1694457, COL__TYPE_DE_PRESTATION#1694458, COL__UCD#1694459, COL__PRODUIT#1694460, COL__QUANTIT_S#1694461, COL__PRIX_D_ACHAT_UNITAIRE_TTC#1694462, COL__TARIF_DE_RESPONSABILIT_TTC#1694463, COL__MONTANT_D_CLAR_TOTAL_TTC#1694464, COL__MAJORATION_TTC#1694465, COL__MONTANT_TOTAL_ACCORD_TTC#1694466, COL__SERVICE#1694467, COL__INDICATION#1694468, COL__ADMIN#1694469]
Arguments: 1500

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet