SP1 - Details for Query 2353

Submitted Time: 2026/09/17 16:20:21
Duration: 1.0 s
Succeeded Jobs: 3419 3420 3421 3423 3428

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; 1 [labelType="html" label="Execute InsertIntoHadoopFsRelationCommand task commit time: 1 ms number of written files: 1 job commit time: 16 ms number of output rows: 849 number of dynamic part: 0 written output: 24.1 KiB"]; 2 [labelType="html" label=" WriteFiles "]; subgraph cluster3 { isCluster="true"; label="WholeStageCodegen (10)\n \nduration: 166 ms"; 4 [labelType="html" label=" Project "]; 5 [labelType="html" label=" Project "]; 6 [labelType="html" label="Filter number of output rows: 849"]; 7 [labelType="html" label=" Project "]; 8 [labelType="html" label=" Project "]; 9 [labelType="html" label="SortMergeJoin number of output rows: 12,897 spill size: 0.0 B"]; } subgraph cluster10 { isCluster="true"; label="WholeStageCodegen (8)\n \nduration: 0 ms"; 11 [labelType="html" label="Sort sort time: 6 ms peak memory: 17.0 MiB spill size: 0.0 B"]; } 12 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 216.7 KiB number of coalesced partitions: 1"]; 13 [labelType="html" label="Exchange shuffle records written: 33,279 local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 33,279 local bytes read: 204.5 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 1819.9 KiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 204.5 KiB"]; subgraph cluster14 { isCluster="true"; label="WholeStageCodegen (7)\n \nduration: 69 ms"; 15 [labelType="html" label=" Project "]; } 16 [labelType="html" label="CartesianProduct number of output rows: 33,279"]; subgraph cluster17 { isCluster="true"; label="WholeStageCodegen (5)\n \nduration: 69 ms"; 18 [labelType="html" label=" Project "]; 19 [labelType="html" label="Filter number of output rows: 33,279"]; } 20 [labelType="html" label="Window spill size: 0.0 B"]; subgraph cluster21 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: 166 ms"; 22 [labelType="html" label="Sort sort time: 35 ms peak memory: 20.0 MiB spill size: 0.0 B"]; } 23 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 317.3 KiB number of coalesced partitions: 1"]; 24 [labelType="html" label="Exchange shuffle records written: 116,733 local merged chunks fetched: 0 shuffle write time: 2 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 116,733 local bytes read: 304.8 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 4.5 MiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 304.8 KiB"]; subgraph cluster25 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 210 ms"; 26 [labelType="html" label=" Project "]; 27 [labelType="html" label="Filter number of output rows: 116,733"]; } 28 [labelType="html" label="Scan csv number of output rows: 116,733 number of files read: 1 metadata time: 0 ms size of files read: 1938.1 KiB"]; subgraph cluster29 { isCluster="true"; label="WholeStageCodegen (6)\n \nduration: 5 ms"; 30 [labelType="html" label=" Project "]; 31 [labelType="html" label="Filter number of output rows: 1"]; } 32 [labelType="html" label="Scan csv number of output rows: 1 number of files read: 1 metadata time: 0 ms size of files read: 175.0 B"]; subgraph cluster33 { isCluster="true"; label="WholeStageCodegen (9)\n \nduration: 392 ms"; 34 [labelType="html" label="Sort sort time: 3 ms peak memory: 16.5 MiB spill size: 0.0 B"]; } 35 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 454.7 KiB number of coalesced partitions: 1"]; 36 [labelType="html" label="Exchange shuffle records written: 12,897 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 30 ms (2 ms, 3 ms, 3 ms (stage 7017.0: task 9144)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 12,897 local bytes read: 433.7 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 10 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 1330.6 KiB (126.2 KiB, 134.0 KiB, 139.5 KiB (stage 7017.0: task 9144)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 433.7 KiB (41.2 KiB, 43.6 KiB, 45.5 KiB (stage 7017.0: task 9144))"]; subgraph cluster37 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: total (min, med, max (stageId: taskId))\n263 ms (10 ms, 28 ms, 39 ms (stage 7017.0: task 9149))"; 38 [labelType="html" label=" Project "]; 39 [labelType="html" label="Filter number of output rows: 12,897"]; 40 [labelType="html" label="ColumnarToRow number of output rows: 12,897 number of input batches: 10"]; } 41 [labelType="html" label="Scan parquet number of files read: 10 scan time total (min, med, max (stageId: taskId)) 96 ms (4 ms, 9 ms, 17 ms (stage 7017.0: task 9149)) metadata time: 0 ms size of files read: 2041.6 KiB number of output rows: 12,897"]; 1->0; 2->1; 4->2; 5->4; 6->5; 7->6; 8->7; 9->8; 11->9; 12->11; 13->12; 15->13; 16->15; 18->16; 19->18; 20->19; 22->20; 23->22; 24->23; 26->24; 27->26; 28->27; 30->16; 31->30; 32->31; 34->9; 35->34; 36->35; 38->36; 39->38; 40->39; 41->40; }

AdaptiveSparkPlan isFinalPlan=true

Execute InsertIntoHadoopFsRelationCommand file:/data/output/cache/parquet/datablock/05_GR4_SUM_225765, false, Parquet, [path=file:///data/output/cache/parquet/datablock/05_GR4_SUM_225765], Overwrite, [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557, COL_5047AF2B_F05A_487E_9152_F4FE82797C45, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0, COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135, COL_786AACC4_3E04_4312_A7F0_A2F045C018D7]

WriteFiles

Project [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#588607, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, str_if_with_rule((isnotnull(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595) AND NOT (COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595 <=> )), str_join(array(str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, +)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, +) END, str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, -)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, -) END, Switch de forfait (SUM*), Ajout de forfait), str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, -)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, -) END, Suppression de Forfait, )), COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), @), ) AS COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569#588795, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, str_if_with_rule(isnotnull(COL_FD823B89_B169_4B25_9EAB_581D44D543B2#588581), str_join(array(Transport Eligible SUM, COL_FD823B89_B169_4B25_9EAB_581D44D543B2#588581), : ), str_join(array(Transport Non Eligible SUM , COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062), : )) AS COL_786AACC4_3E04_4312_A7F0_A2F045C018D7#588798]

Project [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, 06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372 AS COL_FD823B89_B169_4B25_9EAB_581D44D543B2#588581, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnotnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), null)) AS COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, str_create(RC-SUM) AS COL_5047AF2B_F05A_487E_9152_F4FE82797C45#588607]

Filter (isnotnull(str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnotnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), null))) AND NOT (str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnotnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), null)) <=> ))

Project [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, cast(null as string) AS 06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372]

Project [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189 AS COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, 03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177 AS COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182 AS COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]

SortMergeJoin [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060], [03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181], Inner

WholeStageCodegen (10)

Sort [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060 ASC NULLS FIRST], false, 0

WholeStageCodegen (8)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, 10), ENSURE_REQUIREMENTS, [plan_id=364494]

Project [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, REGLES_A_APPLIQ_225642_APPLICABLE_225644#588070 AS COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]

WholeStageCodegen (7)

CartesianProduct

Project [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405 AS COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407 AS COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062]

Filter (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#586421 <=> 1)

WholeStageCodegen (5)

Window [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#586421], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405], [1 DESC NULLS LAST]

Sort [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

WholeStageCodegen (4)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, 10), ENSURE_REQUIREMENTS, [plan_id=363804]

Project [Numéro Séjour#586289 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, str_remove_space(Transport admission#586293, ONLY_ONE) AS COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407]

Filter (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#586289, #)) THEN false ELSE StartsWith(Numéro Séjour#586289, #) END AND isnotnull(Numéro Séjour#586289))

WholeStageCodegen (1)

FileScan csv [Numéro Séjour#586289,Transport admission#586293] Batched: false, DataFilters: [NOT CASE WHEN isnull(StartsWith(Numéro Séjour#586289, #)) THEN false ELSE StartsWith(Numéro Séjo..., Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/02_PASSAGE_PATI_225508/passage_Patient...., PartitionFilters: [], PushedFilters: [IsNotNull(Numéro Séjour)], ReadSchema: struct<Numéro Séjour:string,Transport admission:string>

Project [APPLICABLE#586201 AS REGLES_A_APPLIQ_225642_APPLICABLE_225644#588070]

Filter ((isnotnull(REGLES#586200) AND (RC-SUM = REGLES#586200)) AND (APPLICABLE#586201 <=> O))

WholeStageCodegen (6)

FileScan csv [REGLES#586200,APPLICABLE#586201] Batched: false, DataFilters: [isnotnull(REGLES#586200), (RC-SUM = REGLES#586200), (APPLICABLE#586201 <=> O)], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/REGLES_APPLICAB_225515/REGLES-A-TTT new..., PartitionFilters: [], PushedFilters: [IsNotNull(REGLES), EqualTo(REGLES,RC-SUM), EqualNullSafe(APPLICABLE,O)], ReadSchema: struct<REGLES:string,APPLICABLE:string>

Sort [03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181 ASC NULLS FIRST], false, 0

WholeStageCodegen (9)

AQEShuffleRead coalesced

Exchange hashpartitioning(03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, 10), ENSURE_REQUIREMENTS, [plan_id=363831]

Project [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465 AS 03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469 AS 03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#586470 AS 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182, COL_60F7C888_9836_4535_A22F_D43D2994E019#586477 AS 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189]

Filter ((isnotnull(COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465) AND NOT CASE WHEN isnull(StartsWith(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469, #)) THEN false ELSE StartsWith(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469, #) END) AND isnotnull(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469))

ColumnarToRow

WholeStageCodegen (2)

FileScan parquet [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465,COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469,COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#586470,COL_60F7C888_9836_4535_A22F_D43D2994E019#586477] Batched: true, DataFilters: [isnotnull(COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465), NOT CASE WHEN isnull(StartsWith(COL_..., Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/output/cache/parquet/datablock/03_PIVOT_INFORM_225663], PartitionFilters: [], PushedFilters: [IsNotNull(COL_F1E7803C_F059_4667_8E32_963E2B3DA65F), IsNotNull(COL_582B8737_1AAE_44AC_AF57_EB71A..., ReadSchema: struct<COL_F1E7803C_F059_4667_8E32_963E2B3DA65F:string,COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8:s...

Details

== Physical Plan ==
AdaptiveSparkPlan (69)
+- == Final Plan ==
   Execute InsertIntoHadoopFsRelationCommand (35)
   +- WriteFiles (34)
      +- * Project (33)
         +- * Project (32)
            +- * Filter (31)
               +- * Project (30)
                  +- * Project (29)
                     +- * SortMergeJoin Inner (28)
                        :- * Sort (19)
                        :  +- AQEShuffleRead (18)
                        :     +- ShuffleQueryStage (17), Statistics(sizeInBytes=1819.9 KiB, rowCount=3.33E+4)
                        :        +- Exchange (16)
                        :           +- * Project (15)
                        :              +- CartesianProduct Inner (14)
                        :                 :- * Project (10)
                        :                 :  +- * Filter (9)
                        :                 :     +- Window (8)
                        :                 :        +- * Sort (7)
                        :                 :           +- AQEShuffleRead (6)
                        :                 :              +- ShuffleQueryStage (5), Statistics(sizeInBytes=4.5 MiB, rowCount=1.17E+5)
                        :                 :                 +- Exchange (4)
                        :                 :                    +- * Project (3)
                        :                 :                       +- * Filter (2)
                        :                 :                          +- Scan csv  (1)
                        :                 +- * Project (13)
                        :                    +- * Filter (12)
                        :                       +- Scan csv  (11)
                        +- * Sort (27)
                           +- AQEShuffleRead (26)
                              +- ShuffleQueryStage (25), Statistics(sizeInBytes=1330.6 KiB, rowCount=1.29E+4)
                                 +- Exchange (24)
                                    +- * Project (23)
                                       +- * Filter (22)
                                          +- * ColumnarToRow (21)
                                             +- Scan parquet  (20)
+- == Initial Plan ==
   Execute InsertIntoHadoopFsRelationCommand (68)
   +- WriteFiles (67)
      +- Project (66)
         +- Project (65)
            +- Filter (64)
               +- SortMergeJoin LeftOuter (63)
                  :- Sort (57)
                  :  +- Exchange (56)
                  :     +- Project (55)
                  :        +- SortMergeJoin Inner (54)
                  :           :- Sort (49)
                  :           :  +- Exchange (48)
                  :           :     +- Project (47)
                  :           :        +- CartesianProduct Inner (46)
                  :           :           :- Project (42)
                  :           :           :  +- Filter (41)
                  :           :           :     +- Window (40)
                  :           :           :        +- Sort (39)
                  :           :           :           +- Exchange (38)
                  :           :           :              +- Project (37)
                  :           :           :                 +- Filter (36)
                  :           :           :                    +- Scan csv  (1)
                  :           :           +- Project (45)
                  :           :              +- Filter (44)
                  :           :                 +- Scan csv  (43)
                  :           +- Sort (53)
                  :              +- Exchange (52)
                  :                 +- Project (51)
                  :                    +- Filter (50)
                  :                       +- Scan parquet  (20)
                  +- Sort (62)
                     +- Exchange (61)
                        +- Project (60)
                           +- Filter (59)
                              +- Scan parquet  (58)


(1) Scan csv 
Output [2]: [Numéro Séjour#586289, Transport admission#586293]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/02_PASSAGE_PATI_225508/passage_Patient.csv]
PushedFilters: [IsNotNull(Numéro Séjour)]
ReadSchema: struct<Numéro Séjour:string,Transport admission:string>

(2) Filter [codegen id : 1]
Input [2]: [Numéro Séjour#586289, Transport admission#586293]
Condition : (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#586289, #)) THEN false ELSE StartsWith(Numéro Séjour#586289, #) END AND isnotnull(Numéro Séjour#586289))

(3) Project [codegen id : 1]
Output [2]: [Numéro Séjour#586289 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, str_remove_space(Transport admission#586293, ONLY_ONE) AS COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407]
Input [2]: [Numéro Séjour#586289, Transport admission#586293]

(4) Exchange
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407]
Arguments: hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, 10), ENSURE_REQUIREMENTS, [plan_id=363804]

(5) ShuffleQueryStage
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407]
Arguments: 0

(6) AQEShuffleRead
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407]
Arguments: coalesced

(7) Sort [codegen id : 4]
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407]
Arguments: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(8) Window
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407]
Arguments: [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#586421], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405], [1 DESC NULLS LAST]

(9) Filter [codegen id : 5]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#586421]
Condition : (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#586421 <=> 1)

(10) Project [codegen id : 5]
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405 AS COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407 AS COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#586421]

(11) Scan csv 
Output [2]: [REGLES#586200, APPLICABLE#586201]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/REGLES_APPLICAB_225515/REGLES-A-TTT new.csv]
PushedFilters: [IsNotNull(REGLES), EqualTo(REGLES,RC-SUM), EqualNullSafe(APPLICABLE,O)]
ReadSchema: struct<REGLES:string,APPLICABLE:string>

(12) Filter [codegen id : 6]
Input [2]: [REGLES#586200, APPLICABLE#586201]
Condition : ((isnotnull(REGLES#586200) AND (RC-SUM = REGLES#586200)) AND (APPLICABLE#586201 <=> O))

(13) Project [codegen id : 6]
Output [1]: [APPLICABLE#586201 AS REGLES_A_APPLIQ_225642_APPLICABLE_225644#588070]
Input [2]: [REGLES#586200, APPLICABLE#586201]

(14) CartesianProduct
Join type: Inner
Join condition: None

(15) Project [codegen id : 7]
Output [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, REGLES_A_APPLIQ_225642_APPLICABLE_225644#588070 AS COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, REGLES_A_APPLIQ_225642_APPLICABLE_225644#588070]

(16) Exchange
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]
Arguments: hashpartitioning(COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, 10), ENSURE_REQUIREMENTS, [plan_id=364494]

(17) ShuffleQueryStage
Output [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]
Arguments: 3

(18) AQEShuffleRead
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]
Arguments: coalesced

(19) Sort [codegen id : 8]
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]
Arguments: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060 ASC NULLS FIRST], false, 0

(20) Scan parquet 
Output [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#586470, COL_60F7C888_9836_4535_A22F_D43D2994E019#586477]
Batched: true
Location: InMemoryFileIndex [file:/data/output/cache/parquet/datablock/03_PIVOT_INFORM_225663]
PushedFilters: [IsNotNull(COL_F1E7803C_F059_4667_8E32_963E2B3DA65F), IsNotNull(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8)]
ReadSchema: struct<COL_F1E7803C_F059_4667_8E32_963E2B3DA65F:string,COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8:string,COL_5F8E1D72_6344_42AB_A08C_3B4735439F46:string,COL_60F7C888_9836_4535_A22F_D43D2994E019:string>

(21) ColumnarToRow [codegen id : 2]
Input [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#586470, COL_60F7C888_9836_4535_A22F_D43D2994E019#586477]

(22) Filter [codegen id : 2]
Input [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#586470, COL_60F7C888_9836_4535_A22F_D43D2994E019#586477]
Condition : ((isnotnull(COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465) AND NOT CASE WHEN isnull(StartsWith(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469, #)) THEN false ELSE StartsWith(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469, #) END) AND isnotnull(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469))

(23) Project [codegen id : 2]
Output [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465 AS 03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469 AS 03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#586470 AS 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182, COL_60F7C888_9836_4535_A22F_D43D2994E019#586477 AS 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189]
Input [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#586470, COL_60F7C888_9836_4535_A22F_D43D2994E019#586477]

(24) Exchange
Input [4]: [03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177, 03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182, 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189]
Arguments: hashpartitioning(03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, 10), ENSURE_REQUIREMENTS, [plan_id=363831]

(25) ShuffleQueryStage
Output [4]: [03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177, 03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182, 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189]
Arguments: 1

(26) AQEShuffleRead
Input [4]: [03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177, 03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182, 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189]
Arguments: coalesced

(27) Sort [codegen id : 9]
Input [4]: [03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177, 03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182, 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189]
Arguments: [03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181 ASC NULLS FIRST], false, 0

(28) SortMergeJoin [codegen id : 10]
Left keys [1]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060]
Right keys [1]: [03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181]
Join type: Inner
Join condition: None

(29) Project [codegen id : 10]
Output [6]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189 AS COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, 03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177 AS COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182 AS COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]
Input [7]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, 03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177, 03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182, 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189]

(30) Project [codegen id : 10]
Output [7]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, cast(null as string) AS 06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372]
Input [6]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]

(31) Filter [codegen id : 10]
Input [7]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, 06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372]
Condition : (isnotnull(str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnotnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), null))) AND NOT (str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnotnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), null)) <=> ))

(32) Project [codegen id : 10]
Output [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, 06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372 AS COL_FD823B89_B169_4B25_9EAB_581D44D543B2#588581, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnotnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), null)) AS COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, str_create(RC-SUM) AS COL_5047AF2B_F05A_487E_9152_F4FE82797C45#588607]
Input [7]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, 06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372]

(33) Project [codegen id : 10]
Output [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#588607, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, str_if_with_rule((isnotnull(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595) AND NOT (COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595 <=> )), str_join(array(str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, +)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, +) END, str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, -)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, -) END, Switch de forfait (SUM*), Ajout de forfait), str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, -)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, -) END, Suppression de Forfait, )), COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), @), ) AS COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569#588795, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, str_if_with_rule(isnotnull(COL_FD823B89_B169_4B25_9EAB_581D44D543B2#588581), str_join(array(Transport Eligible SUM, COL_FD823B89_B169_4B25_9EAB_581D44D543B2#588581),  : ), str_join(array(Transport Non Eligible SUM , COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062),  : )) AS COL_786AACC4_3E04_4312_A7F0_A2F045C018D7#588798]
Input [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_FD823B89_B169_4B25_9EAB_581D44D543B2#588581, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#588607]

(34) WriteFiles
Input [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#588607, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569#588795, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, COL_786AACC4_3E04_4312_A7F0_A2F045C018D7#588798]

(35) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/cache/parquet/datablock/05_GR4_SUM_225765, false, Parquet, [path=file:///data/output/cache/parquet/datablock/05_GR4_SUM_225765], Overwrite, [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557, COL_5047AF2B_F05A_487E_9152_F4FE82797C45, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0, COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135, COL_786AACC4_3E04_4312_A7F0_A2F045C018D7]

(36) Filter
Input [2]: [Numéro Séjour#586289, Transport admission#586293]
Condition : (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#586289, #)) THEN false ELSE StartsWith(Numéro Séjour#586289, #) END AND isnotnull(Numéro Séjour#586289))

(37) Project
Output [2]: [Numéro Séjour#586289 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, str_remove_space(Transport admission#586293, ONLY_ONE) AS COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407]
Input [2]: [Numéro Séjour#586289, Transport admission#586293]

(38) Exchange
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407]
Arguments: hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, 10), ENSURE_REQUIREMENTS, [plan_id=363725]

(39) Sort
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407]
Arguments: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(40) Window
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407]
Arguments: [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#586421], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405], [1 DESC NULLS LAST]

(41) Filter
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#586421]
Condition : (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#586421 <=> 1)

(42) Project
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405 AS COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407 AS COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#586405, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#586407, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#586421]

(43) Scan csv 
Output [2]: [REGLES#586200, APPLICABLE#586201]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/REGLES_APPLICAB_225515/REGLES-A-TTT new.csv]
PushedFilters: [IsNotNull(REGLES), EqualTo(REGLES,RC-SUM), EqualNullSafe(APPLICABLE,O)]
ReadSchema: struct<REGLES:string,APPLICABLE:string>

(44) Filter
Input [2]: [REGLES#586200, APPLICABLE#586201]
Condition : ((isnotnull(REGLES#586200) AND (RC-SUM = REGLES#586200)) AND (APPLICABLE#586201 <=> O))

(45) Project
Output [1]: [APPLICABLE#586201 AS REGLES_A_APPLIQ_225642_APPLICABLE_225644#588070]
Input [2]: [REGLES#586200, APPLICABLE#586201]

(46) CartesianProduct
Join type: Inner
Join condition: None

(47) Project
Output [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, REGLES_A_APPLIQ_225642_APPLICABLE_225644#588070 AS COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, REGLES_A_APPLIQ_225642_APPLICABLE_225644#588070]

(48) Exchange
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]
Arguments: hashpartitioning(COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, 10), ENSURE_REQUIREMENTS, [plan_id=363736]

(49) Sort
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]
Arguments: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060 ASC NULLS FIRST], false, 0

(50) Filter
Input [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#586470, COL_60F7C888_9836_4535_A22F_D43D2994E019#586477]
Condition : ((isnotnull(COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465) AND NOT CASE WHEN isnull(StartsWith(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469, #)) THEN false ELSE StartsWith(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469, #) END) AND isnotnull(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469))

(51) Project
Output [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465 AS 03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469 AS 03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#586470 AS 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182, COL_60F7C888_9836_4535_A22F_D43D2994E019#586477 AS 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189]
Input [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#586465, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#586469, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#586470, COL_60F7C888_9836_4535_A22F_D43D2994E019#586477]

(52) Exchange
Input [4]: [03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177, 03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182, 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189]
Arguments: hashpartitioning(03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, 10), ENSURE_REQUIREMENTS, [plan_id=363737]

(53) Sort
Input [4]: [03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177, 03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182, 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189]
Arguments: [03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181 ASC NULLS FIRST], false, 0

(54) SortMergeJoin
Left keys [1]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060]
Right keys [1]: [03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181]
Join type: Inner
Join condition: None

(55) Project
Output [6]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189 AS COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, 03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177 AS COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182 AS COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]
Input [7]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, 03_PIVOT_INFORM_225663_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#588177, 03_PIVOT_INFORM_225663_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#588181, 03_PIVOT_INFORM_225663_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#588182, 03_PIVOT_INFORM_225663_COL_60F7C888_9836_4535_A22F_D43D2994E019#588189]

(56) Exchange
Input [6]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]
Arguments: hashpartitioning(COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, 10), ENSURE_REQUIREMENTS, [plan_id=363746]

(57) Sort
Input [6]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134]
Arguments: [COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062 ASC NULLS FIRST], false, 0

(58) Scan parquet 
Output [1]: [Transport+utilis%C3%A9+%C3%A0+l%27admission#587912]
Batched: true
Location: InMemoryFileIndex [file:/data/input/depot/excel/cache/06_ENTREE_URGEN_225520_3fd6e366cef94360ba899e06a1319b51/Info_Etab_init_v1.1.xlsx_48d47bafe9947a7b0f5a10f4c2c92d7e]
ReadSchema: struct<Transport+utilis%C3%A9+%C3%A0+l%27admission:string>

(59) Filter
Input [1]: [Transport+utilis%C3%A9+%C3%A0+l%27admission#587912]
Condition : isnotnull(str_remove_space(Transport+utilis%C3%A9+%C3%A0+l%27admission#587912, ONLY_ONE))

(60) Project
Output [1]: [str_remove_space(Transport+utilis%C3%A9+%C3%A0+l%27admission#587912, ONLY_ONE) AS 06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372]
Input [1]: [Transport+utilis%C3%A9+%C3%A0+l%27admission#587912]

(61) Exchange
Input [1]: [06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372]
Arguments: hashpartitioning(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372, 10), ENSURE_REQUIREMENTS, [plan_id=363747]

(62) Sort
Input [1]: [06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372]
Arguments: [06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372 ASC NULLS FIRST], false, 0

(63) SortMergeJoin
Left keys [1]: [COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062]
Right keys [1]: [06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372]
Join type: LeftOuter
Join condition: None

(64) Filter
Input [7]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, 06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372]
Condition : (isnotnull(str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnotnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), null))) AND NOT (str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnotnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), null)) <=> ))

(65) Project
Output [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, 06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372 AS COL_FD823B89_B169_4B25_9EAB_581D44D543B2#588581, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, SUM) END AND isnotnull(06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), ), null)) AS COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, str_create(RC-SUM) AS COL_5047AF2B_F05A_487E_9152_F4FE82797C45#588607]
Input [7]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#588357, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, 06_ENTREE_URGEN_225620_TRANSPORT_UTILI_225621#588372]

(66) Project
Output [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#588607, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, str_if_with_rule((isnotnull(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595) AND NOT (COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595 <=> )), str_join(array(str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, +)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, +) END, str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, -)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, -) END, Switch de forfait (SUM*), Ajout de forfait), str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, -)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, -) END, Suppression de Forfait, )), COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360), @), ) AS COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569#588795, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, str_if_with_rule(isnotnull(COL_FD823B89_B169_4B25_9EAB_581D44D543B2#588581), str_join(array(Transport Eligible SUM, COL_FD823B89_B169_4B25_9EAB_581D44D543B2#588581),  : ), str_join(array(Transport Non Eligible SUM , COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062),  : )) AS COL_786AACC4_3E04_4312_A7F0_A2F045C018D7#588798]
Input [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#588062, COL_FD823B89_B169_4B25_9EAB_581D44D543B2#588581, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#588607]

(67) WriteFiles
Input [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#588060, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#588359, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#588607, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#588595, COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569#588795, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#588360, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#588134, COL_786AACC4_3E04_4312_A7F0_A2F045C018D7#588798]

(68) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/cache/parquet/datablock/05_GR4_SUM_225765, false, Parquet, [path=file:///data/output/cache/parquet/datablock/05_GR4_SUM_225765], Overwrite, [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557, COL_5047AF2B_F05A_487E_9152_F4FE82797C45, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0, COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135, COL_786AACC4_3E04_4312_A7F0_A2F045C018D7]

(69) AdaptiveSparkPlan
Output: []
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet