SP1 - Details for Query 4604

Submitted Time: 2026/05/20 14:35:31
Duration: 0.8 s
Succeeded Jobs: 7194 7195 7196

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" AdaptiveSparkPlan "]; 1 [labelType="html" label="Execute InsertIntoHadoopFsRelationCommand task commit time: 0 ms number of written files: 1 job commit time: 10 ms number of output rows: 1 number of dynamic part: 0 written output: 3.6 KiB"]; 2 [labelType="html" label=" WriteFiles "]; subgraph cluster3 { isCluster="true"; label="WholeStageCodegen (9)\n \nduration: 216 ms"; 4 [labelType="html" label=" Project "]; 5 [labelType="html" label=" Project "]; 6 [labelType="html" label=" Project "]; 7 [labelType="html" label=" Project "]; 8 [labelType="html" label=" Project "]; 9 [labelType="html" label="Generate number of output rows: 1"]; 10 [labelType="html" label=" Project "]; 11 [labelType="html" label=" Project "]; 12 [labelType="html" label=" Project "]; 13 [labelType="html" label="Filter number of output rows: 1"]; } 14 [labelType="html" label="Window spill size: 0.0 B"]; subgraph cluster15 { isCluster="true"; label="WholeStageCodegen (8)\n \nduration: 417 ms"; 16 [labelType="html" label="Sort sort time: 6 ms peak memory: 17.0 MiB spill size: 0.0 B"]; 17 [labelType="html" label=" Project "]; 18 [labelType="html" label="SortMergeJoin number of output rows: 33,640 spill size: 0.0 B"]; } subgraph cluster19 { isCluster="true"; label="WholeStageCodegen (6)\n \nduration: 153 ms"; 20 [labelType="html" label=" Project "]; 21 [labelType="html" label="Filter number of output rows: 10,616"]; } 22 [labelType="html" label="Window spill size: 0.0 B"]; subgraph cluster23 { isCluster="true"; label="WholeStageCodegen (5)\n \nduration: 220 ms"; 24 [labelType="html" label="Sort sort time: 24 ms peak memory: 17.0 MiB spill size: 0.0 B"]; } 25 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 584.6 KiB number of coalesced partitions: 1"]; 26 [labelType="html" label="Exchange shuffle records written: 24,063 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 3 ms (1 ms, 1 ms, 1 ms (stage 14772.0: task 20541)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 24,063 local bytes read: 554.0 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 2 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 2.7 MiB (1354.6 KiB, 1382.1 KiB, 1382.1 KiB (stage 14772.0: task 20540)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 554.0 KiB (274.2 KiB, 279.8 KiB, 279.8 KiB (stage 14772.0: task 20540))"]; subgraph cluster27 { isCluster="true"; label="WholeStageCodegen (3)\n \nduration: total (min, med, max (stageId: taskId))\n130 ms (55 ms, 75 ms, 75 ms (stage 14772.0: task 20540))"; 28 [labelType="html" label=" Project "]; } 29 [labelType="html" label="CartesianProduct number of output rows: 24,063"]; subgraph cluster30 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: total (min, med, max (stageId: taskId))\n131 ms (56 ms, 75 ms, 75 ms (stage 14772.0: task 20540))"; 31 [labelType="html" label=" Project "]; 32 [labelType="html" label="ColumnarToRow number of output rows: 24,063 number of input batches: 6"]; } 33 [labelType="html" label="Scan parquet number of files read: 2 scan time total (min, med, max (stageId: taskId)) 16 ms (5 ms, 11 ms, 11 ms (stage 14772.0: task 20540)) metadata time: 0 ms size of files read: 1518.7 KiB number of output rows: 24,063"]; subgraph cluster34 { isCluster="true"; label="WholeStageCodegen (2)\n \nduration: total (min, med, max (stageId: taskId))\n14 ms (7 ms, 7 ms, 7 ms (stage 14772.0: task 20541))"; 35 [labelType="html" label=" Project "]; 36 [labelType="html" label="Filter number of output rows: 2"]; } 37 [labelType="html" label="Scan csv number of output rows: 2 number of files read: 1 metadata time: 0 ms size of files read: 175.0 B"]; subgraph cluster38 { isCluster="true"; label="WholeStageCodegen (7)\n \nduration: 0 ms"; 39 [labelType="html" label="Sort sort time: 8 ms peak memory: 18.0 MiB spill size: 0.0 B"]; } 40 [labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 341.7 KiB number of coalesced partitions: 1"]; 41 [labelType="html" label="Exchange shuffle records written: 45,283 local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 22 ms (1 ms, 1 ms, 3 ms (stage 14773.0: task 20549)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 45,283 local bytes read: 323.7 KiB fetch wait time: 0 ms remote bytes read: 0.0 B merged fetch fallback count: 0 local blocks read: 10 remote merged chunks fetched: 0 remote blocks read: 0 data size total (min, med, max (stageId: taskId)) 4.6 MiB (457.0 KiB, 476.9 KiB, 480.8 KiB (stage 14773.0: task 20543)) local merged bytes read: 0.0 B number of partitions: 10 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 323.7 KiB (31.5 KiB, 32.4 KiB, 33.0 KiB (stage 14773.0: task 20543))"]; subgraph cluster42 { isCluster="true"; label="WholeStageCodegen (4)\n \nduration: total (min, med, max (stageId: taskId))\n590 ms (26 ms, 65 ms, 70 ms (stage 14773.0: task 20546))"; 43 [labelType="html" label=" Project "]; 44 [labelType="html" label="Filter number of output rows: 45,283"]; 45 [labelType="html" label="ColumnarToRow number of output rows: 45,283 number of input batches: 20"]; } 46 [labelType="html" label="Scan parquet number of files read: 10 scan time total (min, med, max (stageId: taskId)) 93 ms (4 ms, 9 ms, 14 ms (stage 14773.0: task 20544)) metadata time: 0 ms size of files read: 3.4 MiB number of output rows: 45,283"]; 1->0; 2->1; 4->2; 5->4; 6->5; 7->6; 8->7; 9->8; 10->9; 11->10; 12->11; 13->12; 14->13; 16->14; 17->16; 18->17; 20->18; 21->20; 22->21; 24->22; 25->24; 26->25; 28->26; 29->28; 31->29; 32->31; 33->32; 35->29; 36->35; 37->36; 39->18; 40->39; 41->40; 43->41; 44->43; 45->44; 46->45; }

AdaptiveSparkPlan isFinalPlan=true

Execute InsertIntoHadoopFsRelationCommand file:/data/output/cache/parquet/datablock/05_GR6_SIC_SIM_172842, false, Parquet, [path=file:///data/output/cache/parquet/datablock/05_GR6_SIC_SIM_172842], Overwrite, [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586, COL_D055870D_7682_4410_A82D_BC4C41964169, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77, COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2, COL_4C6AEE3F_9B75_4BCF_8273_85E282B6FC30, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8]

WriteFiles

Project [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705, str_if_with_rule(CASE WHEN isnull(Contains(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, +)) THEN false ELSE Contains(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, +) END, str_concat(array(Ajout de forfait@, COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678, @, str_extract(COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705, RIGHT, 2))), str_concat(array(Suppression de Forfait@, str_concat(array(str_extract_by_str(COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, !, RIGHT), @)), str_extract(COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705, RIGHT, 2)))) AS COL_4C6AEE3F_9B75_4BCF_8273_85E282B6FC30#1154834, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253]

Project [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, str_if_with_rule(CASE WHEN isnull(Contains(COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652, ,)) THEN false ELSE Contains(COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652, ,) END, str_list_get(str_split(str_remove_extend(COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652, [[,], ]), ,), 0), COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652) AS COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678]

Project [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, str_if_with_rule(CASE WHEN isnull(Contains(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, +)) THEN false ELSE Contains(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, +) END, str_extract_key_value(COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, ;, !, str_concat(array(str_extract(COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, LEFT, 3), str_extract(COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, RIGHT, 3))), VALUE), str_extract_by_str(COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, !, RIGHT)) AS COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652]

Project [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, str_create(RC-SIC/SIM) AS COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, str_remove_space(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, ALL) AS COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603]

Generate explode(COL_C9106B81_8F34_4602_BD0C_4F0EED98B8C8#1154429), [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253], false, [COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452]

Project [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, str_join(array(str_join(array(SIC/SIM Déduit Infos Patient absent RSF, str_list_as_str(COL_2866C1E2_03BF_4FA0_9FA8_D6F663CFD2E7#1153892)), : ), str_join(array(SIC/SIM dans RSF et absent des Infos Patient, str_list_as_str(COL_B0D6496E_B0F2_4B34_A287_E3A96F7A3CEF#1153943)), : ), str_join(array(Acte - Spé - Date , str_list_as_str(COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571)), : )), - ) AS COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, str_list_union(str_split(str_replace_extend(str_replace_extend(str_list_as_str(COL_2866C1E2_03BF_4FA0_9FA8_D6F663CFD2E7#1153892), [SIM,SIC], [SIM+,SIC+]), [[,",]], [,,]), ,), str_split(str_replace_extend(str_replace_extend(str_list_as_str(COL_B0D6496E_B0F2_4B34_A287_E3A96F7A3CEF#1153943), [SIM,SIC], [SIM-,SIC-]), [[,",]], [,,]), ,)) AS COL_C9106B81_8F34_4602_BD0C_4F0EED98B8C8#1154429]

Project [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, array_except(array(COL_EF390B5B_D21B_462C_B13D_B1595E80ADEF#1153806), COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533) AS COL_2866C1E2_03BF_4FA0_9FA8_D6F663CFD2E7#1153892, array_except(COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, array(COL_EF390B5B_D21B_462C_B13D_B1595E80ADEF#1153806)) AS COL_B0D6496E_B0F2_4B34_A287_E3A96F7A3CEF#1153943]

Project [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753) AS COL_EF390B5B_D21B_462C_B13D_B1595E80ADEF#1153806]

Filter ((COL_EB09F0CA_8A1F_4C0B_9948_FDB31E88D9C7#1153628 <=> 1) AND ((size(str_list_union(str_split(str_replace_extend(str_replace_extend(str_list_as_str(array_except(array(str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753)), COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533)), [SIM,SIC], [SIM+,SIC+]), [[,",]], [,,]), ,), str_split(str_replace_extend(str_replace_extend(str_list_as_str(array_except(COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, array(str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753)))), [SIM,SIC], [SIM-,SIC-]), [[,",]], [,,]), ,)), true) > 0) AND isnotnull(str_list_union(str_split(str_replace_extend(str_replace_extend(str_list_as_str(array_except(array(str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753)), COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533)), [SIM,SIC], [SIM+,SIC+]), [[,",]], [,,]), ,), str_split(str_replace_extend(str_replace_extend(str_list_as_str(array_except(COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, array(str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753)))), [SIM,SIC], [SIM-,SIC-]), [[,",]], [,,]), ,)))))

WholeStageCodegen (9)

Window [collect_set(COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, 0, 0) windowspecdefinition(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, row_number() windowspecdefinition(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_EB09F0CA_8A1F_4C0B_9948_FDB31E88D9C7#1153628], [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751], [COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534 DESC NULLS LAST]

Sort [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751 ASC NULLS FIRST, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534 DESC NULLS LAST], false, 0

Project [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, 02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295 AS COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333 AS COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334 AS COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534]

SortMergeJoin [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751], [02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299], LeftOuter

WholeStageCodegen (8)

Filter (COL_8081145F_99B8_4EEC_AAB4_325C38549922#1153102 <=> 1)

WholeStageCodegen (6)

Window [concatwithseparatorudaf(_w0#1153042, com.adb.hdh.spark.job.scala.utils.ConcatWithSeparatorUDAF@30b32789, class[value[0]: string], class[value[0]: string], true, true, 0, 0, None) windowspecdefinition(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753 ASC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, row_number() windowspecdefinition(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753 ASC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_8081145F_99B8_4EEC_AAB4_325C38549922#1153102], [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751], [COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753 ASC NULLS LAST]

Sort [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751 ASC NULLS FIRST, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753 ASC NULLS LAST], false, 0

WholeStageCodegen (5)

AQEShuffleRead coalesced

Exchange hashpartitioning(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, 10), ENSURE_REQUIREMENTS, [plan_id=652644]

Project [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, ARRAY_TO_STR_BEFORE_CONCAT(COL_658DDA2B_EB4A_460F_BDE0_BEB40D7FFD26#1152754) AS _w0#1153042]

WholeStageCodegen (3)

CartesianProduct

Project [COL_64ED17E5_A991_405B_AEED_8A2977283F76#1152469 AS COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_81B86243_0BBB_463E_BE7E_73AEE16D2DD0#1152510 AS COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_F45E0732_AB66_4936_AECE_1F9475288E1E#1152502 AS COL_658DDA2B_EB4A_460F_BDE0_BEB40D7FFD26#1152754, COL_F23CCCC8_5C4A_4FB8_A318_67291E42693A#1152517 AS COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755]

ColumnarToRow

WholeStageCodegen (1)

FileScan parquet [COL_64ED17E5_A991_405B_AEED_8A2977283F76#1152469,COL_F45E0732_AB66_4936_AECE_1F9475288E1E#1152502,COL_81B86243_0BBB_463E_BE7E_73AEE16D2DD0#1152510,COL_F23CCCC8_5C4A_4FB8_A318_67291E42693A#1152517] Batched: true, DataFilters: [], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/output/cache/parquet/datablock/00_B_ACTES_PATI_172578], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<COL_64ED17E5_A991_405B_AEED_8A2977283F76:string,COL_F45E0732_AB66_4936_AECE_1F9475288E1E:s...

Project

Filter ((isnotnull(REGLES#1152341) AND (RC-SIC/SIM = REGLES#1152341)) AND (APPLICABLE#1152342 <=> O))

WholeStageCodegen (2)

FileScan csv [REGLES#1152341,APPLICABLE#1152342] Batched: false, DataFilters: [isnotnull(REGLES#1152341), (RC-SIC/SIM = REGLES#1152341), (APPLICABLE#1152342 <=> O)], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/csv/tmp/REGLES_APPLICAB_172102/REGLES-A-TTT new..., PartitionFilters: [], PushedFilters: [IsNotNull(REGLES), EqualTo(REGLES,RC-SIC/SIM), EqualNullSafe(APPLICABLE,O)], ReadSchema: struct<REGLES:string,APPLICABLE:string>

Sort [02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299 ASC NULLS FIRST], false, 0

WholeStageCodegen (7)

AQEShuffleRead coalesced

Exchange hashpartitioning(02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, 10), ENSURE_REQUIREMENTS, [plan_id=652683]

Project [COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1140832 AS 02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295, COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836 AS 02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1140870 AS 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333, COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1140871 AS 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334]

Filter isnotnull(COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836)

ColumnarToRow

WholeStageCodegen (4)

FileScan parquet [COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1140832,COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836,COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1140870,COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1140871] Batched: true, DataFilters: [isnotnull(COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836)], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/output/cache/parquet/datablock/02_A_ELIGIBLE_172496], PartitionFilters: [], PushedFilters: [IsNotNull(COL_F76265AB_8748_4114_92B4_00E37DE25D34)], ReadSchema: struct<COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB:string,COL_F76265AB_8748_4114_92B4_00E37DE25D34:s...

Details

== Physical Plan ==
AdaptiveSparkPlan (70)
+- == Final Plan ==
   Execute InsertIntoHadoopFsRelationCommand (39)
   +- WriteFiles (38)
      +- * Project (37)
         +- * Project (36)
            +- * Project (35)
               +- * Project (34)
                  +- * Project (33)
                     +- * Generate (32)
                        +- * Project (31)
                           +- * Project (30)
                              +- * Project (29)
                                 +- * Filter (28)
                                    +- Window (27)
                                       +- * Sort (26)
                                          +- * Project (25)
                                             +- * SortMergeJoin LeftOuter (24)
                                                :- * Project (15)
                                                :  +- * Filter (14)
                                                :     +- Window (13)
                                                :        +- * Sort (12)
                                                :           +- AQEShuffleRead (11)
                                                :              +- ShuffleQueryStage (10), Statistics(sizeInBytes=2.7 MiB, rowCount=2.41E+4)
                                                :                 +- Exchange (9)
                                                :                    +- * Project (8)
                                                :                       +- CartesianProduct Inner (7)
                                                :                          :- * Project (3)
                                                :                          :  +- * ColumnarToRow (2)
                                                :                          :     +- Scan parquet  (1)
                                                :                          +- * Project (6)
                                                :                             +- * Filter (5)
                                                :                                +- Scan csv  (4)
                                                +- * Sort (23)
                                                   +- AQEShuffleRead (22)
                                                      +- ShuffleQueryStage (21), Statistics(sizeInBytes=4.6 MiB, rowCount=4.53E+4)
                                                         +- Exchange (20)
                                                            +- * Project (19)
                                                               +- * Filter (18)
                                                                  +- * ColumnarToRow (17)
                                                                     +- Scan parquet  (16)
+- == Initial Plan ==
   Execute InsertIntoHadoopFsRelationCommand (69)
   +- WriteFiles (68)
      +- Project (67)
         +- Project (66)
            +- Project (65)
               +- Project (64)
                  +- Project (63)
                     +- Generate (62)
                        +- Project (61)
                           +- Project (60)
                              +- Project (59)
                                 +- Filter (58)
                                    +- Window (57)
                                       +- Sort (56)
                                          +- Project (55)
                                             +- SortMergeJoin LeftOuter (54)
                                                :- Project (49)
                                                :  +- Filter (48)
                                                :     +- Window (47)
                                                :        +- Sort (46)
                                                :           +- Exchange (45)
                                                :              +- Project (44)
                                                :                 +- CartesianProduct Inner (43)
                                                :                    :- Project (40)
                                                :                    :  +- Scan parquet  (1)
                                                :                    +- Project (42)
                                                :                       +- Filter (41)
                                                :                          +- Scan csv  (4)
                                                +- Sort (53)
                                                   +- Exchange (52)
                                                      +- Project (51)
                                                         +- Filter (50)
                                                            +- Scan parquet  (16)


(1) Scan parquet 
Output [4]: [COL_64ED17E5_A991_405B_AEED_8A2977283F76#1152469, COL_F45E0732_AB66_4936_AECE_1F9475288E1E#1152502, COL_81B86243_0BBB_463E_BE7E_73AEE16D2DD0#1152510, COL_F23CCCC8_5C4A_4FB8_A318_67291E42693A#1152517]
Batched: true
Location: InMemoryFileIndex [file:/data/output/cache/parquet/datablock/00_B_ACTES_PATI_172578]
ReadSchema: struct<COL_64ED17E5_A991_405B_AEED_8A2977283F76:string,COL_F45E0732_AB66_4936_AECE_1F9475288E1E:string,COL_81B86243_0BBB_463E_BE7E_73AEE16D2DD0:string,COL_F23CCCC8_5C4A_4FB8_A318_67291E42693A:string>

(2) ColumnarToRow [codegen id : 1]
Input [4]: [COL_64ED17E5_A991_405B_AEED_8A2977283F76#1152469, COL_F45E0732_AB66_4936_AECE_1F9475288E1E#1152502, COL_81B86243_0BBB_463E_BE7E_73AEE16D2DD0#1152510, COL_F23CCCC8_5C4A_4FB8_A318_67291E42693A#1152517]

(3) Project [codegen id : 1]
Output [4]: [COL_64ED17E5_A991_405B_AEED_8A2977283F76#1152469 AS COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_81B86243_0BBB_463E_BE7E_73AEE16D2DD0#1152510 AS COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_F45E0732_AB66_4936_AECE_1F9475288E1E#1152502 AS COL_658DDA2B_EB4A_460F_BDE0_BEB40D7FFD26#1152754, COL_F23CCCC8_5C4A_4FB8_A318_67291E42693A#1152517 AS COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755]
Input [4]: [COL_64ED17E5_A991_405B_AEED_8A2977283F76#1152469, COL_F45E0732_AB66_4936_AECE_1F9475288E1E#1152502, COL_81B86243_0BBB_463E_BE7E_73AEE16D2DD0#1152510, COL_F23CCCC8_5C4A_4FB8_A318_67291E42693A#1152517]

(4) Scan csv 
Output [2]: [REGLES#1152341, APPLICABLE#1152342]
Batched: false
Location: InMemoryFileIndex [file:/data/input/depot/csv/tmp/REGLES_APPLICAB_172102/REGLES-A-TTT new Aigle.csv]
PushedFilters: [IsNotNull(REGLES), EqualTo(REGLES,RC-SIC/SIM), EqualNullSafe(APPLICABLE,O)]
ReadSchema: struct<REGLES:string,APPLICABLE:string>

(5) Filter [codegen id : 2]
Input [2]: [REGLES#1152341, APPLICABLE#1152342]
Condition : ((isnotnull(REGLES#1152341) AND (RC-SIC/SIM = REGLES#1152341)) AND (APPLICABLE#1152342 <=> O))

(6) Project [codegen id : 2]
Output: []
Input [2]: [REGLES#1152341, APPLICABLE#1152342]

(7) CartesianProduct
Join type: Inner
Join condition: None

(8) Project [codegen id : 3]
Output [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, ARRAY_TO_STR_BEFORE_CONCAT(COL_658DDA2B_EB4A_460F_BDE0_BEB40D7FFD26#1152754) AS _w0#1153042]
Input [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_658DDA2B_EB4A_460F_BDE0_BEB40D7FFD26#1152754, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755]

(9) Exchange
Input [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, _w0#1153042]
Arguments: hashpartitioning(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, 10), ENSURE_REQUIREMENTS, [plan_id=652644]

(10) ShuffleQueryStage
Output [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, _w0#1153042]
Arguments: 0

(11) AQEShuffleRead
Input [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, _w0#1153042]
Arguments: coalesced

(12) Sort [codegen id : 5]
Input [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, _w0#1153042]
Arguments: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751 ASC NULLS FIRST, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753 ASC NULLS LAST], false, 0

(13) Window
Input [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, _w0#1153042]
Arguments: [concatwithseparatorudaf(_w0#1153042, com.adb.hdh.spark.job.scala.utils.ConcatWithSeparatorUDAF@30b32789, class[value[0]: string], class[value[0]: string], true, true, 0, 0, None) windowspecdefinition(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753 ASC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, row_number() windowspecdefinition(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753 ASC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_8081145F_99B8_4EEC_AAB4_325C38549922#1153102], [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751], [COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753 ASC NULLS LAST]

(14) Filter [codegen id : 6]
Input [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, _w0#1153042, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_8081145F_99B8_4EEC_AAB4_325C38549922#1153102]
Condition : (COL_8081145F_99B8_4EEC_AAB4_325C38549922#1153102 <=> 1)

(15) Project [codegen id : 6]
Output [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755]
Input [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, _w0#1153042, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_8081145F_99B8_4EEC_AAB4_325C38549922#1153102]

(16) Scan parquet 
Output [4]: [COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1140832, COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836, COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1140870, COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1140871]
Batched: true
Location: InMemoryFileIndex [file:/data/output/cache/parquet/datablock/02_A_ELIGIBLE_172496]
PushedFilters: [IsNotNull(COL_F76265AB_8748_4114_92B4_00E37DE25D34)]
ReadSchema: struct<COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB:string,COL_F76265AB_8748_4114_92B4_00E37DE25D34:string,COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF:array<string>,COL_AA499A88_B893_47E4_99C5_0EB9F6D69842:string>

(17) ColumnarToRow [codegen id : 4]
Input [4]: [COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1140832, COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836, COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1140870, COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1140871]

(18) Filter [codegen id : 4]
Input [4]: [COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1140832, COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836, COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1140870, COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1140871]
Condition : isnotnull(COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836)

(19) Project [codegen id : 4]
Output [4]: [COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1140832 AS 02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295, COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836 AS 02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1140870 AS 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333, COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1140871 AS 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334]
Input [4]: [COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1140832, COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836, COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1140870, COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1140871]

(20) Exchange
Input [4]: [02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295, 02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333, 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334]
Arguments: hashpartitioning(02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, 10), ENSURE_REQUIREMENTS, [plan_id=652683]

(21) ShuffleQueryStage
Output [4]: [02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295, 02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333, 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334]
Arguments: 1

(22) AQEShuffleRead
Input [4]: [02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295, 02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333, 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334]
Arguments: coalesced

(23) Sort [codegen id : 7]
Input [4]: [02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295, 02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333, 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334]
Arguments: [02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299 ASC NULLS FIRST], false, 0

(24) SortMergeJoin [codegen id : 8]
Left keys [1]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751]
Right keys [1]: [02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299]
Join type: LeftOuter
Join condition: None

(25) Project [codegen id : 8]
Output [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, 02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295 AS COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333 AS COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334 AS COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534]
Input [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, 02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295, 02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333, 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334]

(26) Sort [codegen id : 8]
Input [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534]
Arguments: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751 ASC NULLS FIRST, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534 DESC NULLS LAST], false, 0

(27) Window
Input [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534]
Arguments: [collect_set(COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, 0, 0) windowspecdefinition(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, row_number() windowspecdefinition(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_EB09F0CA_8A1F_4C0B_9948_FDB31E88D9C7#1153628], [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751], [COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534 DESC NULLS LAST]

(28) Filter [codegen id : 9]
Input [9]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, COL_EB09F0CA_8A1F_4C0B_9948_FDB31E88D9C7#1153628]
Condition : ((COL_EB09F0CA_8A1F_4C0B_9948_FDB31E88D9C7#1153628 <=> 1) AND ((size(str_list_union(str_split(str_replace_extend(str_replace_extend(str_list_as_str(array_except(array(str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753)), COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533)), [SIM,SIC], [SIM+,SIC+]), [[,",]], [,,]), ,), str_split(str_replace_extend(str_replace_extend(str_list_as_str(array_except(COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, array(str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753)))), [SIM,SIC], [SIM-,SIC-]), [[,",]], [,,]), ,)), true) > 0) AND isnotnull(str_list_union(str_split(str_replace_extend(str_replace_extend(str_list_as_str(array_except(array(str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753)), COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533)), [SIM,SIC], [SIM+,SIC+]), [[,",]], [,,]), ,), str_split(str_replace_extend(str_replace_extend(str_list_as_str(array_except(COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, array(str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753)))), [SIM,SIC], [SIM-,SIC-]), [[,",]], [,,]), ,)))))

(29) Project [codegen id : 9]
Output [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753) AS COL_EF390B5B_D21B_462C_B13D_B1595E80ADEF#1153806]
Input [9]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, COL_EB09F0CA_8A1F_4C0B_9948_FDB31E88D9C7#1153628]

(30) Project [codegen id : 9]
Output [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, array_except(array(COL_EF390B5B_D21B_462C_B13D_B1595E80ADEF#1153806), COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533) AS COL_2866C1E2_03BF_4FA0_9FA8_D6F663CFD2E7#1153892, array_except(COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, array(COL_EF390B5B_D21B_462C_B13D_B1595E80ADEF#1153806)) AS COL_B0D6496E_B0F2_4B34_A287_E3A96F7A3CEF#1153943]
Input [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, COL_EF390B5B_D21B_462C_B13D_B1595E80ADEF#1153806]

(31) Project [codegen id : 9]
Output [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, str_join(array(str_join(array(SIC/SIM Déduit Infos Patient absent RSF, str_list_as_str(COL_2866C1E2_03BF_4FA0_9FA8_D6F663CFD2E7#1153892)),  : ), str_join(array(SIC/SIM dans RSF et absent des Infos Patient, str_list_as_str(COL_B0D6496E_B0F2_4B34_A287_E3A96F7A3CEF#1153943)),  : ), str_join(array(Acte - Spé - Date , str_list_as_str(COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571)),  : )),  - ) AS COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, str_list_union(str_split(str_replace_extend(str_replace_extend(str_list_as_str(COL_2866C1E2_03BF_4FA0_9FA8_D6F663CFD2E7#1153892), [SIM,SIC], [SIM+,SIC+]), [[,",]], [,,]), ,), str_split(str_replace_extend(str_replace_extend(str_list_as_str(COL_B0D6496E_B0F2_4B34_A287_E3A96F7A3CEF#1153943), [SIM,SIC], [SIM-,SIC-]), [[,",]], [,,]), ,)) AS COL_C9106B81_8F34_4602_BD0C_4F0EED98B8C8#1154429]
Input [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, COL_2866C1E2_03BF_4FA0_9FA8_D6F663CFD2E7#1153892, COL_B0D6496E_B0F2_4B34_A287_E3A96F7A3CEF#1153943]

(32) Generate [codegen id : 9]
Input [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_C9106B81_8F34_4602_BD0C_4F0EED98B8C8#1154429]
Arguments: explode(COL_C9106B81_8F34_4602_BD0C_4F0EED98B8C8#1154429), [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253], false, [COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452]

(33) Project [codegen id : 9]
Output [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, str_create(RC-SIC/SIM) AS COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, str_remove_space(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, ALL) AS COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603]
Input [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452]

(34) Project [codegen id : 9]
Output [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, str_if_with_rule(CASE WHEN isnull(Contains(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, +)) THEN false ELSE Contains(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, +) END, str_extract_key_value(COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, ;, !, str_concat(array(str_extract(COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, LEFT, 3), str_extract(COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, RIGHT, 3))), VALUE), str_extract_by_str(COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, !, RIGHT)) AS COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652]
Input [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603]

(35) Project [codegen id : 9]
Output [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, str_if_with_rule(CASE WHEN isnull(Contains(COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652, ,)) THEN false ELSE Contains(COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652, ,) END, str_list_get(str_split(str_remove_extend(COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652, [[,], ]), ,), 0), COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652) AS COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678]
Input [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652]

(36) Project [codegen id : 9]
Output [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678, str_concat(array(str_extract(COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, LEFT, 4), !, COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678, _, str_extract(COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, RIGHT, 2))) AS COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705]
Input [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678]

(37) Project [codegen id : 9]
Output [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705, str_if_with_rule(CASE WHEN isnull(Contains(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, +)) THEN false ELSE Contains(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, +) END, str_concat(array(Ajout de forfait@, COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678, @, str_extract(COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705, RIGHT, 2))), str_concat(array(Suppression de Forfait@, str_concat(array(str_extract_by_str(COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, !, RIGHT), @)), str_extract(COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705, RIGHT, 2)))) AS COL_4C6AEE3F_9B75_4BCF_8273_85E282B6FC30#1154834, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253]
Input [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678, COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705]

(38) WriteFiles
Input [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705, COL_4C6AEE3F_9B75_4BCF_8273_85E282B6FC30#1154834, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253]

(39) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/cache/parquet/datablock/05_GR6_SIC_SIM_172842, false, Parquet, [path=file:///data/output/cache/parquet/datablock/05_GR6_SIC_SIM_172842], Overwrite, [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586, COL_D055870D_7682_4410_A82D_BC4C41964169, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77, COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2, COL_4C6AEE3F_9B75_4BCF_8273_85E282B6FC30, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8]

(40) Project
Output [4]: [COL_64ED17E5_A991_405B_AEED_8A2977283F76#1152469 AS COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_81B86243_0BBB_463E_BE7E_73AEE16D2DD0#1152510 AS COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_F45E0732_AB66_4936_AECE_1F9475288E1E#1152502 AS COL_658DDA2B_EB4A_460F_BDE0_BEB40D7FFD26#1152754, COL_F23CCCC8_5C4A_4FB8_A318_67291E42693A#1152517 AS COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755]
Input [4]: [COL_64ED17E5_A991_405B_AEED_8A2977283F76#1152469, COL_F45E0732_AB66_4936_AECE_1F9475288E1E#1152502, COL_81B86243_0BBB_463E_BE7E_73AEE16D2DD0#1152510, COL_F23CCCC8_5C4A_4FB8_A318_67291E42693A#1152517]

(41) Filter
Input [2]: [REGLES#1152341, APPLICABLE#1152342]
Condition : ((isnotnull(REGLES#1152341) AND (RC-SIC/SIM = REGLES#1152341)) AND (APPLICABLE#1152342 <=> O))

(42) Project
Output: []
Input [2]: [REGLES#1152341, APPLICABLE#1152342]

(43) CartesianProduct
Join type: Inner
Join condition: None

(44) Project
Output [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, ARRAY_TO_STR_BEFORE_CONCAT(COL_658DDA2B_EB4A_460F_BDE0_BEB40D7FFD26#1152754) AS _w0#1153042]
Input [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_658DDA2B_EB4A_460F_BDE0_BEB40D7FFD26#1152754, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755]

(45) Exchange
Input [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, _w0#1153042]
Arguments: hashpartitioning(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, 10), ENSURE_REQUIREMENTS, [plan_id=652589]

(46) Sort
Input [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, _w0#1153042]
Arguments: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751 ASC NULLS FIRST, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753 ASC NULLS LAST], false, 0

(47) Window
Input [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, _w0#1153042]
Arguments: [concatwithseparatorudaf(_w0#1153042, com.adb.hdh.spark.job.scala.utils.ConcatWithSeparatorUDAF@30b32789, class[value[0]: string], class[value[0]: string], true, true, 0, 0, None) windowspecdefinition(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753 ASC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, row_number() windowspecdefinition(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753 ASC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_8081145F_99B8_4EEC_AAB4_325C38549922#1153102], [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751], [COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753 ASC NULLS LAST]

(48) Filter
Input [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, _w0#1153042, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_8081145F_99B8_4EEC_AAB4_325C38549922#1153102]
Condition : (COL_8081145F_99B8_4EEC_AAB4_325C38549922#1153102 <=> 1)

(49) Project
Output [4]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755]
Input [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, _w0#1153042, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_8081145F_99B8_4EEC_AAB4_325C38549922#1153102]

(50) Filter
Input [4]: [COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1140832, COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836, COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1140870, COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1140871]
Condition : isnotnull(COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836)

(51) Project
Output [4]: [COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1140832 AS 02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295, COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836 AS 02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1140870 AS 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333, COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1140871 AS 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334]
Input [4]: [COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1140832, COL_F76265AB_8748_4114_92B4_00E37DE25D34#1140836, COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1140870, COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1140871]

(52) Exchange
Input [4]: [02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295, 02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333, 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334]
Arguments: hashpartitioning(02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, 10), ENSURE_REQUIREMENTS, [plan_id=652596]

(53) Sort
Input [4]: [02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295, 02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333, 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334]
Arguments: [02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299 ASC NULLS FIRST], false, 0

(54) SortMergeJoin
Left keys [1]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751]
Right keys [1]: [02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299]
Join type: LeftOuter
Join condition: None

(55) Project
Output [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, 02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295 AS COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333 AS COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334 AS COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534]
Input [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, 02_A_ELIGIBLE_172496_COL_F44B0D19_6A77_4497_88B3_B9698DF17BCB#1153295, 02_A_ELIGIBLE_172496_COL_F76265AB_8748_4114_92B4_00E37DE25D34#1153299, 02_A_ELIGIBLE_172496_COL_B8D0B7A4_71CB_4406_88C1_4791F02E29EF#1153333, 02_A_ELIGIBLE_172496_COL_AA499A88_B893_47E4_99C5_0EB9F6D69842#1153334]

(56) Sort
Input [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534]
Arguments: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751 ASC NULLS FIRST, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534 DESC NULLS LAST], false, 0

(57) Window
Input [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534]
Arguments: [collect_set(COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, 0, 0) windowspecdefinition(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534 DESC NULLS LAST, specifiedwindowframe(RangeFrame, unboundedpreceding$(), currentrow$())) AS COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, row_number() windowspecdefinition(COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534 DESC NULLS LAST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS COL_EB09F0CA_8A1F_4C0B_9948_FDB31E88D9C7#1153628], [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751], [COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534 DESC NULLS LAST]

(58) Filter
Input [9]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, COL_EB09F0CA_8A1F_4C0B_9948_FDB31E88D9C7#1153628]
Condition : ((COL_EB09F0CA_8A1F_4C0B_9948_FDB31E88D9C7#1153628 <=> 1) AND ((size(str_list_union(str_split(str_replace_extend(str_replace_extend(str_list_as_str(array_except(array(str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753)), COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533)), [SIM,SIC], [SIM+,SIC+]), [[,",]], [,,]), ,), str_split(str_replace_extend(str_replace_extend(str_list_as_str(array_except(COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, array(str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753)))), [SIM,SIC], [SIM-,SIC-]), [[,",]], [,,]), ,)), true) > 0) AND isnotnull(str_list_union(str_split(str_replace_extend(str_replace_extend(str_list_as_str(array_except(array(str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753)), COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533)), [SIM,SIC], [SIM+,SIC+]), [[,",]], [,,]), ,), str_split(str_replace_extend(str_replace_extend(str_list_as_str(array_except(COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, array(str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753)))), [SIM,SIC], [SIM-,SIC-]), [[,",]], [,,]), ,)))))

(59) Project
Output [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, str_if_with_rule(isnull(COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753), , COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753) AS COL_EF390B5B_D21B_462C_B13D_B1595E80ADEF#1153806]
Input [9]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_1C67BACF_1B65_4A59_B0AD_E458D86429D5#1152753, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_032696D7_7058_44F0_ABC3_DB207100F75A#1152755, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, COL_EB09F0CA_8A1F_4C0B_9948_FDB31E88D9C7#1153628]

(60) Project
Output [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, array_except(array(COL_EF390B5B_D21B_462C_B13D_B1595E80ADEF#1153806), COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533) AS COL_2866C1E2_03BF_4FA0_9FA8_D6F663CFD2E7#1153892, array_except(COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, array(COL_EF390B5B_D21B_462C_B13D_B1595E80ADEF#1153806)) AS COL_B0D6496E_B0F2_4B34_A287_E3A96F7A3CEF#1153943]
Input [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_8A0D1AEA_708F_4608_A4E4_33445D2C0854#1153533, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, COL_EF390B5B_D21B_462C_B13D_B1595E80ADEF#1153806]

(61) Project
Output [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, str_join(array(str_join(array(SIC/SIM Déduit Infos Patient absent RSF, str_list_as_str(COL_2866C1E2_03BF_4FA0_9FA8_D6F663CFD2E7#1153892)),  : ), str_join(array(SIC/SIM dans RSF et absent des Infos Patient, str_list_as_str(COL_B0D6496E_B0F2_4B34_A287_E3A96F7A3CEF#1153943)),  : ), str_join(array(Acte - Spé - Date , str_list_as_str(COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571)),  : )),  - ) AS COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, str_list_union(str_split(str_replace_extend(str_replace_extend(str_list_as_str(COL_2866C1E2_03BF_4FA0_9FA8_D6F663CFD2E7#1153892), [SIM,SIC], [SIM+,SIC+]), [[,",]], [,,]), ,), str_split(str_replace_extend(str_replace_extend(str_list_as_str(COL_B0D6496E_B0F2_4B34_A287_E3A96F7A3CEF#1153943), [SIM,SIC], [SIM-,SIC-]), [[,",]], [,,]), ,)) AS COL_C9106B81_8F34_4602_BD0C_4F0EED98B8C8#1154429]
Input [7]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_AB2F274E_7EA4_4613_A9D9_D07AEEC5892D#1153571, COL_2866C1E2_03BF_4FA0_9FA8_D6F663CFD2E7#1153892, COL_B0D6496E_B0F2_4B34_A287_E3A96F7A3CEF#1153943]

(62) Generate
Input [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_C9106B81_8F34_4602_BD0C_4F0EED98B8C8#1154429]
Arguments: explode(COL_C9106B81_8F34_4602_BD0C_4F0EED98B8C8#1154429), [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253], false, [COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452]

(63) Project
Output [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, str_create(RC-SIC/SIM) AS COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, str_remove_space(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, ALL) AS COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603]
Input [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452]

(64) Project
Output [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, str_if_with_rule(CASE WHEN isnull(Contains(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, +)) THEN false ELSE Contains(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, +) END, str_extract_key_value(COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, ;, !, str_concat(array(str_extract(COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, LEFT, 3), str_extract(COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, RIGHT, 3))), VALUE), str_extract_by_str(COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, !, RIGHT)) AS COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652]
Input [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EC9C5E15_381A_4B20_8C15_EBE5E36720D6#1153041, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603]

(65) Project
Output [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, str_if_with_rule(CASE WHEN isnull(Contains(COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652, ,)) THEN false ELSE Contains(COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652, ,) END, str_list_get(str_split(str_remove_extend(COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652, [[,], ]), ,), 0), COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652) AS COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678]
Input [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, COL_1DE9F16A_CDC3_40A3_B39F_2E5935A39949#1154652]

(66) Project
Output [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678, str_concat(array(str_extract(COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, LEFT, 4), !, COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678, _, str_extract(COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, RIGHT, 2))) AS COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705]
Input [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_52951A0A_93BF_4E9A_B761_E8E6DCE4DE60#1154603, COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678]

(67) Project
Output [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705, str_if_with_rule(CASE WHEN isnull(Contains(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, +)) THEN false ELSE Contains(COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, +) END, str_concat(array(Ajout de forfait@, COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678, @, str_extract(COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705, RIGHT, 2))), str_concat(array(Suppression de Forfait@, str_concat(array(str_extract_by_str(COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, !, RIGHT), @)), str_extract(COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705, RIGHT, 2)))) AS COL_4C6AEE3F_9B75_4BCF_8273_85E282B6FC30#1154834, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253]
Input [8]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_3CCB47AD_5834_4DF7_9C15_97F35E752EA6#1154452, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_DADBEFF1_C4E6_4B38_8C84_412222189B8C#1153534, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_09828A80_5710_4A69_8FAA_FFA497D3BDBA#1154678, COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705]

(68) WriteFiles
Input [6]: [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586#1152751, COL_D055870D_7682_4410_A82D_BC4C41964169#1153532, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77#1154580, COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2#1154705, COL_4C6AEE3F_9B75_4BCF_8273_85E282B6FC30#1154834, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8#1154253]

(69) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/cache/parquet/datablock/05_GR6_SIC_SIM_172842, false, Parquet, [path=file:///data/output/cache/parquet/datablock/05_GR6_SIC_SIM_172842], Overwrite, [COL_32F739B2_1E09_4FE7_8AEE_4EAB7D20E586, COL_D055870D_7682_4410_A82D_BC4C41964169, COL_EDD3F0DE_BCA6_41F2_AA00_4FA398668A77, COL_800B4DCB_AD36_4EB0_9102_1CFF32E954E2, COL_4C6AEE3F_9B75_4BCF_8273_85E282B6FC30, COL_C7286809_1984_4EC7_AE1D_DBDAAD16E6E8]

(70) AdaptiveSparkPlan
Output: []
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet