SP1 - Details for Query 3104

Submitted Time: 2026/09/24 14:23:13
Duration: 0.2 s
Succeeded Jobs: 4508 4509

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" CollectLimit "]; 1 [labelType="html" label=" Union "]; subgraph cluster2 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 6 ms"; 3 [labelType="html" label=" LocalLimit "]; 4 [labelType="html" label=" Project "]; 5 [labelType="html" label="ColumnarToRow number of output rows: 166 number of input batches: 1"]; } 6 [labelType="html" label="Scan parquet number of files read: 1 scan time: 2 ms metadata time: 0 ms size of files read: 4.3 KiB number of output rows: 166"]; subgraph cluster7 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: 6 ms"; 8 [labelType="html" label=" LocalLimit "]; 9 [labelType="html" label=" Project "]; 10 [labelType="html" label="ColumnarToRow number of output rows: 166 number of input batches: 1"]; } 11 [labelType="html" label="Scan parquet number of files read: 1 scan time: 2 ms metadata time: 0 ms size of files read: 4.3 KiB number of output rows: 166"]; subgraph cluster12 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: 7 ms"; 13 [labelType="html" label=" LocalLimit "]; 14 [labelType="html" label=" Project "]; 15 [labelType="html" label="ColumnarToRow number of output rows: 201 number of input batches: 1"]; } 16 [labelType="html" label="Scan parquet number of files read: 1 scan time: 2 ms metadata time: 0 ms size of files read: 4.4 KiB number of output rows: 201"]; 1->0; 3->1; 4->3; 5->4; 6->5; 8->1; 9->8; 10->9; 11->10; 13->1; 14->13; 15->14; 16->15; }

CollectLimit 1500

Union

LocalLimit 1500

Project [Code+Acte#728691 AS COL_CODE_ACTE_216267#728999, cast(REFORMAT_FOR_DOUBLE(Montant#728692) as double) AS COL_MONTANT_216268#729000, Ligne+RSF#728693 AS COL_LIGNE_RSF_216269#729001, str_to_datez(Date_effet#728694, dd/MM/yyyy, null, null) AS COL_DATE_EFFET_216270#729002, str_to_datez(Date_r%C3%A9vocation#728695, dd/MM/yyyy, null, null) AS COL_DATE_REVOCATION_216271#729003, Trigramme#728696 AS COL_TRIGRAMME_216272#729004]

ColumnarToRow

WholeStageCodegen (1)

FileScan parquet [Code+Acte#728691,Montant#728692,Ligne+RSF#728693,Date_effet#728694,Date_r%C3%A9vocation#728695,Trigramme#728696] Batched: true, DataFilters: [], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/excel/cache/TARIF_FORFAIT_S_216188_8c16894e8611..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<Code+Acte:string,Montant:string,Ligne+RSF:string,Date_effet:string,Date_r%C3%A9vocation:st...

LocalLimit 1500

Project [Code+Acte#728762 AS COL_CODE_ACTE_216267#729025, cast(REFORMAT_FOR_DOUBLE(Montant#728763) as double) AS COL_MONTANT_216268#729026, Ligne+RSF#728764 AS COL_LIGNE_RSF_216269#729027, str_to_datez(Date_effet#728765, dd/MM/yyyy, null, null) AS COL_DATE_EFFET_216270#729028, str_to_datez(Date_r%C3%A9vocation#728766, dd/MM/yyyy, null, null) AS COL_DATE_REVOCATION_216271#729029, Trigramme#728767 AS COL_TRIGRAMME_216272#729030]

ColumnarToRow

WholeStageCodegen (2)

FileScan parquet [Code+Acte#728762,Montant#728763,Ligne+RSF#728764,Date_effet#728765,Date_r%C3%A9vocation#728766,Trigramme#728767] Batched: true, DataFilters: [], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/excel/cache/TARIF_FORFAIT_S_216188_40efcfa797c9..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<Code+Acte:string,Montant:string,Ligne+RSF:string,Date_effet:string,Date_r%C3%A9vocation:st...

LocalLimit 1500

Project [Code+Acte#728840 AS COL_CODE_ACTE_216267#729031, cast(REFORMAT_FOR_DOUBLE(Montant#728841) as double) AS COL_MONTANT_216268#729032, Ligne+RSF#728842 AS COL_LIGNE_RSF_216269#729033, str_to_datez(Date_effet#728843, dd/MM/yyyy, null, null) AS COL_DATE_EFFET_216270#729034, str_to_datez(Date_r%C3%A9vocation#728844, dd/MM/yyyy, null, null) AS COL_DATE_REVOCATION_216271#729035, Trigramme#728845 AS COL_TRIGRAMME_216272#729036]

ColumnarToRow

WholeStageCodegen (3)

FileScan parquet [Code+Acte#728840,Montant#728841,Ligne+RSF#728842,Date_effet#728843,Date_r%C3%A9vocation#728844,Trigramme#728845] Batched: true, DataFilters: [], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/excel/cache/TARIF_FORFAIT_S_216188_808989d69c5c..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<Code+Acte:string,Montant:string,Ligne+RSF:string,Date_effet:string,Date_r%C3%A9vocation:st...

Details

== Physical Plan ==
CollectLimit (14)
+- Union (13)
   :- * LocalLimit (4)
   :  +- * Project (3)
   :     +- * ColumnarToRow (2)
   :        +- Scan parquet  (1)
   :- * LocalLimit (8)
   :  +- * Project (7)
   :     +- * ColumnarToRow (6)
   :        +- Scan parquet  (5)
   +- * LocalLimit (12)
      +- * Project (11)
         +- * ColumnarToRow (10)
            +- Scan parquet  (9)


(1) Scan parquet 
Output [6]: [Code+Acte#728691, Montant#728692, Ligne+RSF#728693, Date_effet#728694, Date_r%C3%A9vocation#728695, Trigramme#728696]
Batched: true
Location: InMemoryFileIndex [file:/data/input/depot/excel/cache/TARIF_FORFAIT_S_216188_8c16894e8611e2723038563a84e8f82e/Region-PUBGUAMAR_tarifs_forfait_urgences.xlsx_28c6b5cf2e17f093396d9005fd88426d]
ReadSchema: struct<Code+Acte:string,Montant:string,Ligne+RSF:string,Date_effet:string,Date_r%C3%A9vocation:string,Trigramme:string>

(2) ColumnarToRow [codegen id : 1]
Input [6]: [Code+Acte#728691, Montant#728692, Ligne+RSF#728693, Date_effet#728694, Date_r%C3%A9vocation#728695, Trigramme#728696]

(3) Project [codegen id : 1]
Output [6]: [Code+Acte#728691 AS COL_CODE_ACTE_216267#728999, cast(REFORMAT_FOR_DOUBLE(Montant#728692) as double) AS COL_MONTANT_216268#729000, Ligne+RSF#728693 AS COL_LIGNE_RSF_216269#729001, str_to_datez(Date_effet#728694, dd/MM/yyyy, null, null) AS COL_DATE_EFFET_216270#729002, str_to_datez(Date_r%C3%A9vocation#728695, dd/MM/yyyy, null, null) AS COL_DATE_REVOCATION_216271#729003, Trigramme#728696 AS COL_TRIGRAMME_216272#729004]
Input [6]: [Code+Acte#728691, Montant#728692, Ligne+RSF#728693, Date_effet#728694, Date_r%C3%A9vocation#728695, Trigramme#728696]

(4) LocalLimit [codegen id : 1]
Input [6]: [COL_CODE_ACTE_216267#728999, COL_MONTANT_216268#729000, COL_LIGNE_RSF_216269#729001, COL_DATE_EFFET_216270#729002, COL_DATE_REVOCATION_216271#729003, COL_TRIGRAMME_216272#729004]
Arguments: 1500

(5) Scan parquet 
Output [6]: [Code+Acte#728762, Montant#728763, Ligne+RSF#728764, Date_effet#728765, Date_r%C3%A9vocation#728766, Trigramme#728767]
Batched: true
Location: InMemoryFileIndex [file:/data/input/depot/excel/cache/TARIF_FORFAIT_S_216188_40efcfa797c91f7b2d91dc7e15554bab/Region-PUBGUYRE_tarifs_forfait_urgences.xlsx_46d8ee25493717864f5499570cb757fd]
ReadSchema: struct<Code+Acte:string,Montant:string,Ligne+RSF:string,Date_effet:string,Date_r%C3%A9vocation:string,Trigramme:string>

(6) ColumnarToRow [codegen id : 2]
Input [6]: [Code+Acte#728762, Montant#728763, Ligne+RSF#728764, Date_effet#728765, Date_r%C3%A9vocation#728766, Trigramme#728767]

(7) Project [codegen id : 2]
Output [6]: [Code+Acte#728762 AS COL_CODE_ACTE_216267#729025, cast(REFORMAT_FOR_DOUBLE(Montant#728763) as double) AS COL_MONTANT_216268#729026, Ligne+RSF#728764 AS COL_LIGNE_RSF_216269#729027, str_to_datez(Date_effet#728765, dd/MM/yyyy, null, null) AS COL_DATE_EFFET_216270#729028, str_to_datez(Date_r%C3%A9vocation#728766, dd/MM/yyyy, null, null) AS COL_DATE_REVOCATION_216271#729029, Trigramme#728767 AS COL_TRIGRAMME_216272#729030]
Input [6]: [Code+Acte#728762, Montant#728763, Ligne+RSF#728764, Date_effet#728765, Date_r%C3%A9vocation#728766, Trigramme#728767]

(8) LocalLimit [codegen id : 2]
Input [6]: [COL_CODE_ACTE_216267#729025, COL_MONTANT_216268#729026, COL_LIGNE_RSF_216269#729027, COL_DATE_EFFET_216270#729028, COL_DATE_REVOCATION_216271#729029, COL_TRIGRAMME_216272#729030]
Arguments: 1500

(9) Scan parquet 
Output [6]: [Code+Acte#728840, Montant#728841, Ligne+RSF#728842, Date_effet#728843, Date_r%C3%A9vocation#728844, Trigramme#728845]
Batched: true
Location: InMemoryFileIndex [file:/data/input/depot/excel/cache/TARIF_FORFAIT_S_216188_808989d69c5c26978e67dd7f41818400/Region-PUBMET_tarifs_forfait_urgences.xlsx_85117cb97629c9c4984158ba77dd1307]
ReadSchema: struct<Code+Acte:string,Montant:string,Ligne+RSF:string,Date_effet:string,Date_r%C3%A9vocation:string,Trigramme:string>

(10) ColumnarToRow [codegen id : 3]
Input [6]: [Code+Acte#728840, Montant#728841, Ligne+RSF#728842, Date_effet#728843, Date_r%C3%A9vocation#728844, Trigramme#728845]

(11) Project [codegen id : 3]
Output [6]: [Code+Acte#728840 AS COL_CODE_ACTE_216267#729031, cast(REFORMAT_FOR_DOUBLE(Montant#728841) as double) AS COL_MONTANT_216268#729032, Ligne+RSF#728842 AS COL_LIGNE_RSF_216269#729033, str_to_datez(Date_effet#728843, dd/MM/yyyy, null, null) AS COL_DATE_EFFET_216270#729034, str_to_datez(Date_r%C3%A9vocation#728844, dd/MM/yyyy, null, null) AS COL_DATE_REVOCATION_216271#729035, Trigramme#728845 AS COL_TRIGRAMME_216272#729036]
Input [6]: [Code+Acte#728840, Montant#728841, Ligne+RSF#728842, Date_effet#728843, Date_r%C3%A9vocation#728844, Trigramme#728845]

(12) LocalLimit [codegen id : 3]
Input [6]: [COL_CODE_ACTE_216267#729031, COL_MONTANT_216268#729032, COL_LIGNE_RSF_216269#729033, COL_DATE_EFFET_216270#729034, COL_DATE_REVOCATION_216271#729035, COL_TRIGRAMME_216272#729036]
Arguments: 1500

(13) Union

(14) CollectLimit
Input [6]: [COL_CODE_ACTE_216267#728999, COL_MONTANT_216268#729000, COL_LIGNE_RSF_216269#729001, COL_DATE_EFFET_216270#729002, COL_DATE_REVOCATION_216271#729003, COL_TRIGRAMME_216272#729004]
Arguments: 1500

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet