SP1 - Details for Query 12049

Submitted Time: 2026/01/24 21:07:48
Duration: 1 s
Succeeded Jobs: 17930 17931 17932 17935 17936 17940

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; 1 [labelType="html" label="Execute InsertIntoHadoopFsRelationCommand task commit time: 0 ms number of written files: 1 job commit time: 12 ms number of output rows: 8,737 number of dynamic part: 0 written output: 189.4 KiB"]; 2 [labelType="html" label=" WriteFiles "]; subgraph cluster3 { isCluster="true"; label="WholeStageCodegen (13)\n \nduration: 454 ms"; 4 [labelType="html" label=" Project "]; 5 [labelType="html" label=" Project "]; 6 [labelType="html" label="Filter number of output rows: 8,737"]; 7 [labelType="html" label="SortMergeJoin number of output rows: 48,615 spill size: 0.0 B"]; } subgraph cluster8 { isCluster="true"; label="WholeStageCodegen (11)\n \nduration: 510 ms"; 9 [labelType="html" label="Sort sort time: 12 ms peak memory: 18.0 MiB spill size: 0.0 B"]; } 10 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 1737.6 KiB number of coalesced partitions: 1"]; 11 [labelType="html" label="Exchange shuffle records written: 48,615 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 7 ms (3 ms, 4 ms, 4 ms (stage 32560.0: task 39595)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 48,615 local bytes read: 1625.5 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 2 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 7.4 MiB (3.0 MiB, 4.4 MiB, 4.4 MiB (stage 32560.0: task 39595)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 1625.5 KiB (658.3 KiB, 967.2 KiB, 967.2 KiB (stage 32560.0: task 39595))"]; subgraph cluster12 { isCluster="true"; label="WholeStageCodegen (10)\n \nduration: total (min, med, max (stageId: taskId))\n201 ms (77 ms, 124 ms, 124 ms (stage 32560.0: task 39595))"; 13 [labelType="html" label=" Project "]; 14 [labelType="html" label="SortMergeJoin number of output rows: 48,615 spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 32560.0: task 39594))"]; } subgraph cluster15 { isCluster="true"; label="WholeStageCodegen (8)\n \nduration: 0 ms"; 16 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 12 ms (3 ms, 9 ms, 9 ms (stage 32560.0: task 39595)) peak memory total (min, med, max (stageId: taskId)) 35.0 MiB (17.0 MiB, 18.0 MiB, 18.0 MiB (stage 32560.0: task 39595)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 32560.0: task 39594))"]; } 17 [labelType="html" label="AQEShuffleRead number of partitions: 2 partition data size total (min, med, max (stageId: taskId)) 1128.3 KiB (460.1 KiB, 668.2 KiB, 668.2 KiB (driver)) number of coalesced partitions: 2"]; 18 [labelType="html" label="Exchange shuffle records written: 87,452 local merged chunks fetched: 0 shuffle write time: 4 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 87,452 local bytes read total (min, med, max (stageId: taskId)) 1083.8 KiB (434.3 KiB, 649.5 KiB, 649.5 KiB (stage 32560.0: task 39595)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 32560.0: task 39594)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 2 remote merged chunks fetched: 0 remote blocks read: 0 data size: 6.8 MiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 1083.8 KiB"]; subgraph cluster19 { isCluster="true"; label="WholeStageCodegen (7)\n \nduration: 152 ms"; 20 [labelType="html" label=" Project "]; } 21 [labelType="html" label="CartesianProduct number of output rows: 87,452"]; subgraph cluster22 { isCluster="true"; label="WholeStageCodegen (5)\n \nduration: 152 ms"; 23 [labelType="html" label=" Project "]; 24 [labelType="html" label="Filter number of output rows: 87,452"]; } 25 [labelType="html" label="Window spill size: 0.0 B"]; subgraph cluster26 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: 208 ms"; 27 [labelType="html" label="Sort sort time: 27 ms peak memory: 20.0 MiB spill size: 0.0 B"]; } 28 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 1163.0 KiB number of coalesced partitions: 1"]; 29 [labelType="html" label="Exchange shuffle records written: 87,452 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 7 ms (3 ms, 4 ms, 4 ms (stage 32550.0: task 39560)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 87,452 local bytes read: 1113.4 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 2 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 5.4 MiB (2.3 MiB, 3.1 MiB, 3.1 MiB (stage 32550.0: task 39560)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 1113.4 KiB (473.2 KiB, 640.2 KiB, 640.2 KiB (stage 32550.0: task 39560))"]; subgraph cluster30 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: total (min, med, max (stageId: taskId))\n352 ms (155 ms, 197 ms, 197 ms (stage 32550.0: task 39560))"; 31 [labelType="html" label=" Project "]; 32 [labelType="html" label="Filter number of output rows: 87,452"]; } 33 [labelType="html" label="Scan csv number of output rows: 87,452 number of files read: 1 metadata time: 0 ms size of files read: 7.0 MiB"]; subgraph cluster34 { isCluster="true"; label="WholeStageCodegen (6)\n \nduration: 2 ms"; 35 [labelType="html" label=" Project "]; 36 [labelType="html" label="Filter number of output rows: 1"]; } 37 [labelType="html" label="Scan csv number of output rows: 1 number of files read: 1 metadata time: 0 ms size of files read: 163.0 B"]; subgraph cluster38 { isCluster="true"; label="WholeStageCodegen (9)\n \nduration: total (min, med, max (stageId: taskId))\n404 ms (156 ms, 248 ms, 248 ms (stage 32560.0: task 39595))"; 39 [labelType="html" label="Sort sort time total (min, med, max (stageId: taskId)) 12 ms (3 ms, 9 ms, 9 ms (stage 32560.0: task 39595)) peak memory total (min, med, max (stageId: taskId)) 33.5 MiB (16.5 MiB, 17.0 MiB, 17.0 MiB (stage 32560.0: task 39595)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 32560.0: task 39594))"]; } 40 [labelType="html" label="AQEShuffleRead number of partitions: 2 partition data size total (min, med, max (stageId: taskId)) 1769.5 KiB (707.2 KiB, 1062.3 KiB, 1062.3 KiB (driver)) number of coalesced partitions: 2"]; 41 [labelType="html" label="Exchange shuffle records written: 48,615 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 83 ms (2 ms, 7 ms, 14 ms (stage 32551.0: task 39566)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 48,615 local bytes read total (min, med, max (stageId: taskId)) 1682.7 KiB (675.4 KiB, 1007.3 KiB, 1007.3 KiB (stage 32560.0: task 39595)) fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 32560.0: task 39594)) remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 20 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 5.1 MiB (508.7 KiB, 528.6 KiB, 540.7 KiB (stage 32551.0: task 39562)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 1682.7 KiB (162.9 KiB, 169.0 KiB, 172.2 KiB (stage 32551.0: task 39562))"]; subgraph cluster42 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: total (min, med, max (stageId: taskId))\n235 ms (16 ms, 23 ms, 32 ms (stage 32551.0: task 39562))"; 43 [labelType="html" label=" Project "]; 44 [labelType="html" label="Filter number of output rows: 48,615"]; 45 [labelType="html" label="ColumnarToRow number of output rows: 48,615 number of input batches: 20"]; } 46 [labelType="html" label="Scan parquet number of files read: 10 scan time total (min, med, max (stageId: taskId)) 116 ms (6 ms, 13 ms, 19 ms (stage 32551.0: task 39562)) metadata time: 0 ms size of files read: 7.8 MiB number of output rows: 48,615"]; subgraph cluster47 { isCluster="true"; label="WholeStageCodegen (12)\n \nduration: 0 ms"; 48 [labelType="html" label="Sort sort time: 0 ms peak memory: 16.1 MiB spill size: 0.0 B"]; } 49 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 3.6 KiB number of coalesced partitions: 1"]; 50 [labelType="html" label="Exchange shuffle records written: 88 local merged chunks fetched: 0 shuffle write time: 2 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 88 local bytes read: 3.4 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 4.2 KiB local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 3.4 KiB"]; subgraph cluster51 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: 5 ms"; 52 [labelType="html" label=" Project "]; 53 [labelType="html" label="Filter number of output rows: 88"]; 54 [labelType="html" label="ColumnarToRow number of output rows: 88 number of input batches: 1"]; } 55 [labelType="html" label="Scan parquet number of files read: 1 scan time: 2 ms metadata time: 0 ms size of files read: 3.3 KiB number of output rows: 88"]; 1->0; 2->1; 4->2; 5->4; 6->5; 7->6; 9->7; 10->9; 11->10; 13->11; 14->13; 16->14; 17->16; 18->17; 20->18; 21->20; 23->21; 24->23; 25->24; 27->25; 28->27; 29->28; 31->29; 32->31; 33->32; 35->21; 36->35; 37->36; 39->14; 40->39; 41->40; 43->41; 44->43; 45->44; 46->45; 48->7; 49->48; 50->49; 52->50; 53->52; 54->53; 55->54; }

AdaptiveSparkPlan isFinalPlan=true

Execute InsertIntoHadoopFsRelationCommand file:/data/output/cache/parquet/datablock/05_GR4_SUM_161915, false, Parquet, [path=file:///data/output/cache/parquet/datablock/05_GR4_SUM_161915], Overwrite, [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557, COL_5047AF2B_F05A_487E_9152_F4FE82797C45, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0, COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135, COL_786AACC4_3E04_4312_A7F0_A2F045C018D7]

WriteFiles

Project [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#2464739, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, str_if_with_rule((isnotnull(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727) AND NOT (COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727 <=> )), str_join(array(str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, +)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, +) END, str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, -)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, -) END, Switch de forfait (SUM*), Ajout de forfait), str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, -)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, -) END, Suppression de Forfait, )), COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), @), ) AS COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569#2464841, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, str_if_with_rule(isnotnull(COL_FD823B89_B169_4B25_9EAB_581D44D543B2#2464705), str_join(array(Transport Eligible SUM, COL_FD823B89_B169_4B25_9EAB_581D44D543B2#2464705), : ), str_join(array(Transport Non Eligible SUM , COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320), : )) AS COL_786AACC4_3E04_4312_A7F0_A2F045C018D7#2464844]

Project [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, 06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622 AS COL_FD823B89_B169_4B25_9EAB_581D44D543B2#2464705, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnotnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), null)) AS COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, str_create(RC-SUM) AS COL_5047AF2B_F05A_487E_9152_F4FE82797C45#2464739]

Filter (isnotnull(str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnotnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), null))) AND NOT (str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnotnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), null)) <=> ))

SortMergeJoin [COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320], [06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622], LeftOuter

WholeStageCodegen (13)

Sort [COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320 ASC NULLS FIRST], false, 0

WholeStageCodegen (11)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, 10), ENSURE_REQUIREMENTS, [plan_id=1221673]

Project [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435 AS COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, 03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423 AS COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428 AS COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]

SortMergeJoin [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318], [03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427], Inner

WholeStageCodegen (10)

Sort [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318 ASC NULLS FIRST], false, 0

WholeStageCodegen (8)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, 10), ENSURE_REQUIREMENTS, [plan_id=1221538]

Project [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, REGLES_A_APPLIQ_161538_APPLICABLE_161540#2464328 AS COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]

WholeStageCodegen (7)

CartesianProduct

Project [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646 AS COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648 AS COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320]

Filter (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#2462662 <=> 1)

WholeStageCodegen (5)

Window [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#2462662], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646], [1 DESC NULLS LAST]

Sort [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

WholeStageCodegen (4)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, 10), ENSURE_REQUIREMENTS, [plan_id=1220882]

Project [Numéro Séjour#2462504 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, str_remove_space(Transport admission#2462508, ONLY_ONE) AS COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648]

Filter (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#2462504, #)) THEN false ELSE StartsWith(Numéro Séjour#2462504, #) END AND isnotnull(Numéro Séjour#2462504))

WholeStageCodegen (1)

FileScan csv [Numéro Séjour#2462504,Transport admission#2462508] Batched: false, DataFilters: [NOT CASE WHEN isnull(StartsWith(Numéro Séjour#2462504, #)) THEN false ELSE StartsWith(Numéro Séj..., Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/02_PASSAGE_PATI_161404/passage_patient_..., PartitionFilters: [], PushedFilters: [IsNotNull(Numéro Séjour)], ReadSchema: struct<Numéro Séjour:string,Transport admission:string>

Project [APPLICABLE#2464013 AS REGLES_A_APPLIQ_161538_APPLICABLE_161540#2464328]

Filter ((isnotnull(REGLES#2464012) AND (RC-SUM = REGLES#2464012)) AND (APPLICABLE#2464013 <=> O))

WholeStageCodegen (6)

FileScan csv [REGLES#2464012,APPLICABLE#2464013] Batched: false, DataFilters: [isnotnull(REGLES#2464012), (RC-SUM = REGLES#2464012), (APPLICABLE#2464013 <=> O)], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/REGLES_APPLICAB_161411/REGLES-A-TTT.csv], PartitionFilters: [], PushedFilters: [IsNotNull(REGLES), EqualTo(REGLES,RC-SUM), EqualNullSafe(APPLICABLE,O)], ReadSchema: struct<REGLES:string,APPLICABLE:string>

Sort [03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427 ASC NULLS FIRST], false, 0

WholeStageCodegen (9)

AQEShuffleRead coalesced

Exchange hashpartitioning(03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, 10), ENSURE_REQUIREMENTS, [plan_id=1220909]

Project [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098 AS 03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102 AS 03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464103 AS 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428, COL_60F7C888_9836_4535_A22F_D43D2994E019#2464110 AS 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435]

Filter ((isnotnull(COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098) AND NOT CASE WHEN isnull(StartsWith(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102, #)) THEN false ELSE StartsWith(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102, #) END) AND isnotnull(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102))

ColumnarToRow

WholeStageCodegen (2)

FileScan parquet [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098,COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102,COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464103,COL_60F7C888_9836_4535_A22F_D43D2994E019#2464110] Batched: true, DataFilters: [isnotnull(COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098), NOT CASE WHEN isnull(StartsWith(COL..., Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/output/cache/parquet/datablock/03_PIVOT_INFORM_161568], PartitionFilters: [], PushedFilters: [IsNotNull(COL_F1E7803C_F059_4667_8E32_963E2B3DA65F), IsNotNull(COL_582B8737_1AAE_44AC_AF57_EB71A..., ReadSchema: struct<COL_F1E7803C_F059_4667_8E32_963E2B3DA65F:string,COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8:s...

Sort [06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622 ASC NULLS FIRST], false, 0

WholeStageCodegen (12)

AQEShuffleRead coalesced

Exchange hashpartitioning(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622, 10), ENSURE_REQUIREMENTS, [plan_id=1220941]

Project [str_remove_space(Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271, ONLY_ONE) AS 06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]

Filter isnotnull(str_remove_space(Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271, ONLY_ONE))

ColumnarToRow

WholeStageCodegen (3)

FileScan parquet [Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271] Batched: true, DataFilters: [isnotnull(str_remove_space(Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271, ONLY_ONE))], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/excel/cache/06_ENTREE_URGEN_161417_81cea2b90731..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<Transport+utilis%C3%A9+%C3%A0+l%27admission:string>

Details

== Physical Plan ==
AdaptiveSparkPlan (80)
+- == Final Plan ==
   Execute InsertIntoHadoopFsRelationCommand (47)
   +- WriteFiles (46)
      +- * Project (45)
         +- * Project (44)
            +- * Filter (43)
               +- * SortMergeJoin LeftOuter (42)
                  :- * Sort (33)
                  :  +- AQEShuffleRead (32)
                  :     +- ShuffleQueryStage (31), Statistics(sizeInBytes=7.4 MiB, rowCount=4.86E+4)
                  :        +- Exchange (30)
                  :           +- * Project (29)
                  :              +- * SortMergeJoin Inner (28)
                  :                 :- * Sort (19)
                  :                 :  +- AQEShuffleRead (18)
                  :                 :     +- ShuffleQueryStage (17), Statistics(sizeInBytes=6.8 MiB, rowCount=8.75E+4)
                  :                 :        +- Exchange (16)
                  :                 :           +- * Project (15)
                  :                 :              +- CartesianProduct Inner (14)
                  :                 :                 :- * Project (10)
                  :                 :                 :  +- * Filter (9)
                  :                 :                 :     +- Window (8)
                  :                 :                 :        +- * Sort (7)
                  :                 :                 :           +- AQEShuffleRead (6)
                  :                 :                 :              +- ShuffleQueryStage (5), Statistics(sizeInBytes=5.4 MiB, rowCount=8.75E+4)
                  :                 :                 :                 +- Exchange (4)
                  :                 :                 :                    +- * Project (3)
                  :                 :                 :                       +- * Filter (2)
                  :                 :                 :                          +- Scan csv  (1)
                  :                 :                 +- * Project (13)
                  :                 :                    +- * Filter (12)
                  :                 :                       +- Scan csv  (11)
                  :                 +- * Sort (27)
                  :                    +- AQEShuffleRead (26)
                  :                       +- ShuffleQueryStage (25), Statistics(sizeInBytes=5.1 MiB, rowCount=4.86E+4)
                  :                          +- Exchange (24)
                  :                             +- * Project (23)
                  :                                +- * Filter (22)
                  :                                   +- * ColumnarToRow (21)
                  :                                      +- Scan parquet  (20)
                  +- * Sort (41)
                     +- AQEShuffleRead (40)
                        +- ShuffleQueryStage (39), Statistics(sizeInBytes=4.2 KiB, rowCount=88)
                           +- Exchange (38)
                              +- * Project (37)
                                 +- * Filter (36)
                                    +- * ColumnarToRow (35)
                                       +- Scan parquet  (34)
+- == Initial Plan ==
   Execute InsertIntoHadoopFsRelationCommand (79)
   +- WriteFiles (78)
      +- Project (77)
         +- Project (76)
            +- Filter (75)
               +- SortMergeJoin LeftOuter (74)
                  :- Sort (69)
                  :  +- Exchange (68)
                  :     +- Project (67)
                  :        +- SortMergeJoin Inner (66)
                  :           :- Sort (61)
                  :           :  +- Exchange (60)
                  :           :     +- Project (59)
                  :           :        +- CartesianProduct Inner (58)
                  :           :           :- Project (54)
                  :           :           :  +- Filter (53)
                  :           :           :     +- Window (52)
                  :           :           :        +- Sort (51)
                  :           :           :           +- Exchange (50)
                  :           :           :              +- Project (49)
                  :           :           :                 +- Filter (48)
                  :           :           :                    +- Scan csv  (1)
                  :           :           +- Project (57)
                  :           :              +- Filter (56)
                  :           :                 +- Scan csv  (55)
                  :           +- Sort (65)
                  :              +- Exchange (64)
                  :                 +- Project (63)
                  :                    +- Filter (62)
                  :                       +- Scan parquet  (20)
                  +- Sort (73)
                     +- Exchange (72)
                        +- Project (71)
                           +- Filter (70)
                              +- Scan parquet  (34)


(1) Scan csv 
Output [2]: [Numéro Séjour#2462504, Transport admission#2462508]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/02_PASSAGE_PATI_161404/passage_patient_VERSAILLES_2025.csv]
PushedFilters: [IsNotNull(Numéro Séjour)]
ReadSchema: struct<Numéro Séjour:string,Transport admission:string>

(2) Filter [codegen id : 1]
Input [2]: [Numéro Séjour#2462504, Transport admission#2462508]
Condition : (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#2462504, #)) THEN false ELSE StartsWith(Numéro Séjour#2462504, #) END AND isnotnull(Numéro Séjour#2462504))

(3) Project [codegen id : 1]
Output [2]: [Numéro Séjour#2462504 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, str_remove_space(Transport admission#2462508, ONLY_ONE) AS COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648]
Input [2]: [Numéro Séjour#2462504, Transport admission#2462508]

(4) Exchange
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648]
Arguments: hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, 10), ENSURE_REQUIREMENTS, [plan_id=1220882]

(5) ShuffleQueryStage
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648]
Arguments: 0

(6) AQEShuffleRead
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648]
Arguments: coalesced

(7) Sort [codegen id : 4]
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648]
Arguments: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(8) Window
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648]
Arguments: [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#2462662], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646], [1 DESC NULLS LAST]

(9) Filter [codegen id : 5]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#2462662]
Condition : (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#2462662 <=> 1)

(10) Project [codegen id : 5]
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646 AS COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648 AS COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#2462662]

(11) Scan csv 
Output [2]: [REGLES#2464012, APPLICABLE#2464013]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/REGLES_APPLICAB_161411/REGLES-A-TTT.csv]
PushedFilters: [IsNotNull(REGLES), EqualTo(REGLES,RC-SUM), EqualNullSafe(APPLICABLE,O)]
ReadSchema: struct<REGLES:string,APPLICABLE:string>

(12) Filter [codegen id : 6]
Input [2]: [REGLES#2464012, APPLICABLE#2464013]
Condition : ((isnotnull(REGLES#2464012) AND (RC-SUM = REGLES#2464012)) AND (APPLICABLE#2464013 <=> O))

(13) Project [codegen id : 6]
Output [1]: [APPLICABLE#2464013 AS REGLES_A_APPLIQ_161538_APPLICABLE_161540#2464328]
Input [2]: [REGLES#2464012, APPLICABLE#2464013]

(14) CartesianProduct
Join type: Inner
Join condition: None

(15) Project [codegen id : 7]
Output [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, REGLES_A_APPLIQ_161538_APPLICABLE_161540#2464328 AS COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, REGLES_A_APPLIQ_161538_APPLICABLE_161540#2464328]

(16) Exchange
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Arguments: hashpartitioning(COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, 10), ENSURE_REQUIREMENTS, [plan_id=1221538]

(17) ShuffleQueryStage
Output [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Arguments: 3

(18) AQEShuffleRead
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Arguments: coalesced

(19) Sort [codegen id : 8]
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Arguments: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318 ASC NULLS FIRST], false, 0

(20) Scan parquet 
Output [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464103, COL_60F7C888_9836_4535_A22F_D43D2994E019#2464110]
Batched: true
Location: InMemoryFileIndex [file:/data/output/cache/parquet/datablock/03_PIVOT_INFORM_161568]
PushedFilters: [IsNotNull(COL_F1E7803C_F059_4667_8E32_963E2B3DA65F), IsNotNull(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8)]
ReadSchema: struct<COL_F1E7803C_F059_4667_8E32_963E2B3DA65F:string,COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8:string,COL_5F8E1D72_6344_42AB_A08C_3B4735439F46:string,COL_60F7C888_9836_4535_A22F_D43D2994E019:string>

(21) ColumnarToRow [codegen id : 2]
Input [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464103, COL_60F7C888_9836_4535_A22F_D43D2994E019#2464110]

(22) Filter [codegen id : 2]
Input [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464103, COL_60F7C888_9836_4535_A22F_D43D2994E019#2464110]
Condition : ((isnotnull(COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098) AND NOT CASE WHEN isnull(StartsWith(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102, #)) THEN false ELSE StartsWith(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102, #) END) AND isnotnull(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102))

(23) Project [codegen id : 2]
Output [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098 AS 03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102 AS 03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464103 AS 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428, COL_60F7C888_9836_4535_A22F_D43D2994E019#2464110 AS 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435]
Input [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464103, COL_60F7C888_9836_4535_A22F_D43D2994E019#2464110]

(24) Exchange
Input [4]: [03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423, 03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428, 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435]
Arguments: hashpartitioning(03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, 10), ENSURE_REQUIREMENTS, [plan_id=1220909]

(25) ShuffleQueryStage
Output [4]: [03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423, 03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428, 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435]
Arguments: 1

(26) AQEShuffleRead
Input [4]: [03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423, 03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428, 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435]
Arguments: coalesced

(27) Sort [codegen id : 9]
Input [4]: [03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423, 03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428, 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435]
Arguments: [03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427 ASC NULLS FIRST], false, 0

(28) SortMergeJoin [codegen id : 10]
Left keys [1]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318]
Right keys [1]: [03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427]
Join type: Inner
Join condition: None

(29) Project [codegen id : 10]
Output [6]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435 AS COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, 03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423 AS COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428 AS COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Input [7]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, 03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423, 03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428, 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435]

(30) Exchange
Input [6]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Arguments: hashpartitioning(COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, 10), ENSURE_REQUIREMENTS, [plan_id=1221673]

(31) ShuffleQueryStage
Output [6]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Arguments: 4

(32) AQEShuffleRead
Input [6]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Arguments: coalesced

(33) Sort [codegen id : 11]
Input [6]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Arguments: [COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320 ASC NULLS FIRST], false, 0

(34) Scan parquet 
Output [1]: [Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271]
Batched: true
Location: InMemoryFileIndex [file:/data/input/depot/excel/cache/06_ENTREE_URGEN_161417_81cea2b907313154b829dcf57ce1a5bb/Info_Etab_init_v1.1 VERSAILLES 230126.xlsx_ab65742ade778804421c0a23f118ef1a]
ReadSchema: struct<Transport+utilis%C3%A9+%C3%A0+l%27admission:string>

(35) ColumnarToRow [codegen id : 3]
Input [1]: [Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271]

(36) Filter [codegen id : 3]
Input [1]: [Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271]
Condition : isnotnull(str_remove_space(Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271, ONLY_ONE))

(37) Project [codegen id : 3]
Output [1]: [str_remove_space(Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271, ONLY_ONE) AS 06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]
Input [1]: [Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271]

(38) Exchange
Input [1]: [06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]
Arguments: hashpartitioning(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622, 10), ENSURE_REQUIREMENTS, [plan_id=1220941]

(39) ShuffleQueryStage
Output [1]: [06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]
Arguments: 2

(40) AQEShuffleRead
Input [1]: [06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]
Arguments: coalesced

(41) Sort [codegen id : 12]
Input [1]: [06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]
Arguments: [06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622 ASC NULLS FIRST], false, 0

(42) SortMergeJoin [codegen id : 13]
Left keys [1]: [COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320]
Right keys [1]: [06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]
Join type: LeftOuter
Join condition: None

(43) Filter [codegen id : 13]
Input [7]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, 06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]
Condition : (isnotnull(str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnotnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), null))) AND NOT (str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnotnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), null)) <=> ))

(44) Project [codegen id : 13]
Output [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, 06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622 AS COL_FD823B89_B169_4B25_9EAB_581D44D543B2#2464705, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnotnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), null)) AS COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, str_create(RC-SUM) AS COL_5047AF2B_F05A_487E_9152_F4FE82797C45#2464739]
Input [7]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, 06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]

(45) Project [codegen id : 13]
Output [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#2464739, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, str_if_with_rule((isnotnull(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727) AND NOT (COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727 <=> )), str_join(array(str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, +)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, +) END, str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, -)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, -) END, Switch de forfait (SUM*), Ajout de forfait), str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, -)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, -) END, Suppression de Forfait, )), COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), @), ) AS COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569#2464841, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, str_if_with_rule(isnotnull(COL_FD823B89_B169_4B25_9EAB_581D44D543B2#2464705), str_join(array(Transport Eligible SUM, COL_FD823B89_B169_4B25_9EAB_581D44D543B2#2464705),  : ), str_join(array(Transport Non Eligible SUM , COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320),  : )) AS COL_786AACC4_3E04_4312_A7F0_A2F045C018D7#2464844]
Input [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_FD823B89_B169_4B25_9EAB_581D44D543B2#2464705, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#2464739]

(46) WriteFiles
Input [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#2464739, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569#2464841, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, COL_786AACC4_3E04_4312_A7F0_A2F045C018D7#2464844]

(47) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/cache/parquet/datablock/05_GR4_SUM_161915, false, Parquet, [path=file:///data/output/cache/parquet/datablock/05_GR4_SUM_161915], Overwrite, [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557, COL_5047AF2B_F05A_487E_9152_F4FE82797C45, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0, COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135, COL_786AACC4_3E04_4312_A7F0_A2F045C018D7]

(48) Filter
Input [2]: [Numéro Séjour#2462504, Transport admission#2462508]
Condition : (NOT CASE WHEN isnull(StartsWith(Numéro Séjour#2462504, #)) THEN false ELSE StartsWith(Numéro Séjour#2462504, #) END AND isnotnull(Numéro Séjour#2462504))

(49) Project
Output [2]: [Numéro Séjour#2462504 AS COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, str_remove_space(Transport admission#2462508, ONLY_ONE) AS COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648]
Input [2]: [Numéro Séjour#2462504, Transport admission#2462508]

(50) Exchange
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648]
Arguments: hashpartitioning(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, 10), ENSURE_REQUIREMENTS, [plan_id=1220805]

(51) Sort
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648]
Arguments: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646 ASC NULLS FIRST, 1 DESC NULLS LAST], false, 0

(52) Window
Input [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648]
Arguments: [row_number() windowspecdefinition(COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, 1 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#2462662], [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646], [1 DESC NULLS LAST]

(53) Filter
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#2462662]
Condition : (COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#2462662 <=> 1)

(54) Project
Output [2]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646 AS COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648 AS COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320]
Input [3]: [COL_2AF4FE05_74B1_4A24_9BC1_7612D6ED731D#2462646, COL_E1010A22_775B_43B4_B8CA_4603C0801D28#2462648, COL_6B340AEB_6908_4A50_8AD6_FE561D33FBE0#2462662]

(55) Scan csv 
Output [2]: [REGLES#2464012, APPLICABLE#2464013]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/REGLES_APPLICAB_161411/REGLES-A-TTT.csv]
PushedFilters: [IsNotNull(REGLES), EqualTo(REGLES,RC-SUM), EqualNullSafe(APPLICABLE,O)]
ReadSchema: struct<REGLES:string,APPLICABLE:string>

(56) Filter
Input [2]: [REGLES#2464012, APPLICABLE#2464013]
Condition : ((isnotnull(REGLES#2464012) AND (RC-SUM = REGLES#2464012)) AND (APPLICABLE#2464013 <=> O))

(57) Project
Output [1]: [APPLICABLE#2464013 AS REGLES_A_APPLIQ_161538_APPLICABLE_161540#2464328]
Input [2]: [REGLES#2464012, APPLICABLE#2464013]

(58) CartesianProduct
Join type: Inner
Join condition: None

(59) Project
Output [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, REGLES_A_APPLIQ_161538_APPLICABLE_161540#2464328 AS COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, REGLES_A_APPLIQ_161538_APPLICABLE_161540#2464328]

(60) Exchange
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Arguments: hashpartitioning(COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, 10), ENSURE_REQUIREMENTS, [plan_id=1220816]

(61) Sort
Input [3]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Arguments: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318 ASC NULLS FIRST], false, 0

(62) Filter
Input [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464103, COL_60F7C888_9836_4535_A22F_D43D2994E019#2464110]
Condition : ((isnotnull(COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098) AND NOT CASE WHEN isnull(StartsWith(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102, #)) THEN false ELSE StartsWith(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102, #) END) AND isnotnull(COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102))

(63) Project
Output [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098 AS 03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102 AS 03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464103 AS 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428, COL_60F7C888_9836_4535_A22F_D43D2994E019#2464110 AS 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435]
Input [4]: [COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464098, COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464102, COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464103, COL_60F7C888_9836_4535_A22F_D43D2994E019#2464110]

(64) Exchange
Input [4]: [03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423, 03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428, 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435]
Arguments: hashpartitioning(03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, 10), ENSURE_REQUIREMENTS, [plan_id=1220817]

(65) Sort
Input [4]: [03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423, 03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428, 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435]
Arguments: [03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427 ASC NULLS FIRST], false, 0

(66) SortMergeJoin
Left keys [1]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318]
Right keys [1]: [03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427]
Join type: Inner
Join condition: None

(67) Project
Output [6]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435 AS COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, 03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423 AS COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428 AS COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Input [7]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, 03_PIVOT_INFORM_161568_COL_F1E7803C_F059_4667_8E32_963E2B3DA65F#2464423, 03_PIVOT_INFORM_161568_COL_582B8737_1AAE_44AC_AF57_EB71A05E19B8#2464427, 03_PIVOT_INFORM_161568_COL_5F8E1D72_6344_42AB_A08C_3B4735439F46#2464428, 03_PIVOT_INFORM_161568_COL_60F7C888_9836_4535_A22F_D43D2994E019#2464435]

(68) Exchange
Input [6]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Arguments: hashpartitioning(COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, 10), ENSURE_REQUIREMENTS, [plan_id=1220826]

(69) Sort
Input [6]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378]
Arguments: [COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320 ASC NULLS FIRST], false, 0

(70) Filter
Input [1]: [Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271]
Condition : isnotnull(str_remove_space(Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271, ONLY_ONE))

(71) Project
Output [1]: [str_remove_space(Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271, ONLY_ONE) AS 06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]
Input [1]: [Transport+utilis%C3%A9+%C3%A0+l%27admission#2464271]

(72) Exchange
Input [1]: [06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]
Arguments: hashpartitioning(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622, 10), ENSURE_REQUIREMENTS, [plan_id=1220827]

(73) Sort
Input [1]: [06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]
Arguments: [06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622 ASC NULLS FIRST], false, 0

(74) SortMergeJoin
Left keys [1]: [COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320]
Right keys [1]: [06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]
Join type: LeftOuter
Join condition: None

(75) Filter
Input [7]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, 06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]
Condition : (isnotnull(str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnotnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), null))) AND NOT (str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnotnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), null)) <=> ))

(76) Project
Output [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, 06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622 AS COL_FD823B89_B169_4B25_9EAB_581D44D543B2#2464705, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, str_if_with_rule((CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM-, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), str_if_with_rule((NOT CASE WHEN isnull(Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM)) THEN false ELSE Contains(COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, SUM) END AND isnotnull(06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622)), str_join(array(SUM+, !, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), ), null)) AS COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, str_create(RC-SUM) AS COL_5047AF2B_F05A_487E_9152_F4FE82797C45#2464739]
Input [7]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_B82C3EFD_07A4_496B_9BD7_0D2B4E3458A8#2464607, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, 06_ENTREE_URGEN_161516_TRANSPORT_UTILI_161517#2464622]

(77) Project
Output [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#2464739, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, str_if_with_rule((isnotnull(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727) AND NOT (COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727 <=> )), str_join(array(str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, +)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, +) END, str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, -)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, -) END, Switch de forfait (SUM*), Ajout de forfait), str_if_with_rule(CASE WHEN isnull(Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, -)) THEN false ELSE Contains(COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, -) END, Suppression de Forfait, )), COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610), @), ) AS COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569#2464841, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, str_if_with_rule(isnotnull(COL_FD823B89_B169_4B25_9EAB_581D44D543B2#2464705), str_join(array(Transport Eligible SUM, COL_FD823B89_B169_4B25_9EAB_581D44D543B2#2464705),  : ), str_join(array(Transport Non Eligible SUM , COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320),  : )) AS COL_786AACC4_3E04_4312_A7F0_A2F045C018D7#2464844]
Input [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_D98BB81A_010E_4A93_9951_E277D8CF157A#2464320, COL_FD823B89_B169_4B25_9EAB_581D44D543B2#2464705, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#2464739]

(78) WriteFiles
Input [8]: [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5#2464318, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557#2464609, COL_5047AF2B_F05A_487E_9152_F4FE82797C45#2464739, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0#2464727, COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569#2464841, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153#2464610, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135#2464378, COL_786AACC4_3E04_4312_A7F0_A2F045C018D7#2464844]

(79) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/cache/parquet/datablock/05_GR4_SUM_161915, false, Parquet, [path=file:///data/output/cache/parquet/datablock/05_GR4_SUM_161915], Overwrite, [COL_A2523D82_F590_40F1_85E5_30011BEEEDF5, COL_02D44CEA_1031_4290_8F23_AB2C6AE7B557, COL_5047AF2B_F05A_487E_9152_F4FE82797C45, COL_070B5B98_14EA_42D5_A6A0_7EDB0FD6E2B0, COL_FEC7AB55_AB69_43FE_9E2B_2AC5EA7FE569, COL_E5B890C4_5DF6_4B3D_B992_5BFD4F692153, COL_D744E1A7_E834_46FC_A00F_DFB5E9D2E135, COL_786AACC4_3E04_4312_A7F0_A2F045C018D7]

(80) AdaptiveSparkPlan
Output: []
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet