[Opt](delete) Skip newly inserted rows check in non-strict mode partial update if the row's delete sign is marked #40322

[bobhan1]

picks #40322

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[bobhan1]

run buildall

[github-actions]

clang-tidy review says "All clean, LGTM! 👍"

[doris-robot]

TPC-H: Total hot run time: 49473 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 784674ff3d9fc0972862338d505af3a63a340838, data reload: false

------ Round 1 ----------------------------------
q1	17740	4340	4351	4340
q2	2058	156	143	143
q3	10441	1893	1949	1893
q4	10340	1237	1315	1237
q5	8452	3842	3950	3842
q6	229	123	123	123
q7	2016	1658	1607	1607
q8	9279	2732	2709	2709
q9	10009	9939	9657	9657
q10	8769	3567	3565	3565
q11	406	252	252	252
q12	465	301	295	295
q13	18329	3961	4105	3961
q14	351	325	330	325
q15	510	463	467	463
q16	536	464	475	464
q17	1136	980	966	966
q18	7779	7283	7324	7283
q19	2908	1470	1470	1470
q20	1621	322	337	322
q21	4649	4222	4152	4152
q22	502	404	412	404
Total cold run time: 118525 ms
Total hot run time: 49473 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4367	4303	4283	4283
q2	315	231	223	223
q3	4159	4165	4109	4109
q4	2759	2753	2740	2740
q5	7089	7096	7099	7096
q6	235	115	119	115
q7	3234	2803	2819	2803
q8	4364	4497	4472	4472
q9	13719	13529	13519	13519
q10	4220	4222	4243	4222
q11	763	665	693	665
q12	1016	844	845	844
q13	6793	3747	3730	3730
q14	466	433	412	412
q15	510	463	459	459
q16	643	599	587	587
q17	3823	3900	3821	3821
q18	8683	8783	8702	8702
q19	1718	1647	1672	1647
q20	2356	2143	2138	2138
q21	8603	8445	8420	8420
q22	1022	956	947	947
Total cold run time: 80857 ms
Total hot run time: 75954 ms

[doris-robot]

TeamCity be ut coverage result:
Function Coverage: 37.86% (8140/21499)
Line Coverage: 29.60% (66992/226345)
Region Coverage: 29.09% (34566/118843)
Branch Coverage: 24.98% (17806/71270)
Coverage Report: http://coverage.selectdb-in.cc/coverage/784674ff3d9fc0972862338d505af3a63a340838_784674ff3d9fc0972862338d505af3a63a340838/report/index.html

[doris-robot]

TPC-DS: Total hot run time: 212381 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 784674ff3d9fc0972862338d505af3a63a340838, data reload: false

query1	922	397	408	397
query2	6548	2275	2158	2158
query3	6921	206	205	205
query4	23582	21647	21546	21546
query5	19725	6500	6530	6500
query6	282	224	228	224
query7	4237	301	324	301
query8	255	253	228	228
query9	3036	2624	2577	2577
query10	424	314	288	288
query11	15469	15276	15382	15276
query12	121	81	77	77
query13	1034	452	443	443
query14	16881	13160	13669	13160
query15	356	226	230	226
query16	6466	292	260	260
query17	1737	912	934	912
query18	893	307	316	307
query19	222	152	148	148
query20	82	76	76	76
query21	188	95	94	94
query22	5184	5072	4902	4902
query23	34063	33315	33387	33315
query24	7671	6326	6353	6326
query25	527	429	433	429
query26	1264	167	163	163
query27	2366	297	300	297
query28	6103	2243	2219	2219
query29	2891	2850	2823	2823
query30	245	171	168	168
query31	949	747	726	726
query32	68	69	62	62
query33	447	266	246	246
query34	851	471	465	465
query35	1120	918	886	886
query36	1258	1417	1147	1147
query37	90	59	59	59
query38	3027	2894	2911	2894
query39	1376	1305	1330	1305
query40	307	97	100	97
query41	40	38	36	36
query42	82	85	88	85
query43	779	790	589	589
query44	1167	719	721	719
query45	243	231	234	231
query46	1241	950	960	950
query47	1879	1742	1629	1629
query48	508	412	391	391
query49	647	379	375	375
query50	854	611	622	611
query51	4779	4708	4629	4629
query52	92	83	85	83
query53	234	185	181	181
query54	2652	2462	2490	2462
query55	90	77	81	77
query56	258	214	207	207
query57	1195	1034	1174	1034
query58	226	204	207	204
query59	3430	3365	3455	3365
query60	228	205	204	204
query61	98	96	98	96
query62	907	523	466	466
query63	217	175	191	175
query64	3528	1626	1395	1395
query65	3592	3518	3502	3502
query66	795	409	426	409
query67	16496	15345	16248	15345
query68	9281	663	631	631
query69	482	279	267	267
query70	1522	1437	1519	1437
query71	399	311	304	304
query72	6774	4857	4832	4832
query73	746	331	318	318
query74	6290	5846	5893	5846
query75	5204	3640	3663	3640
query76	5183	1168	1193	1168
query77	902	287	249	249
query78	12371	11685	11905	11685
query79	6148	640	636	636
query80	1418	377	389	377
query81	488	241	236	236
query82	1625	99	97	97
query83	176	136	142	136
query84	259	71	70	70
query85	890	329	318	318
query86	342	342	291	291
query87	3232	3016	3032	3016
query88	4822	2307	2309	2307
query89	398	312	310	310
query90	1962	213	216	213
query91	168	128	128	128
query92	60	59	55	55
query93	5214	571	550	550
query94	716	212	214	212
query95	2023	1871	2005	1871
query96	635	326	328	326
query97	6426	6392	6336	6336
query98	237	228	219	219
query99	2875	918	972	918
Total cold run time: 314713 ms
Total hot run time: 212381 ms

[doris-robot]

ClickBench: Total hot run time: 30.57 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 784674ff3d9fc0972862338d505af3a63a340838, data reload: false

query1	0.02	0.02	0.02
query2	0.08	0.02	0.02
query3	0.25	0.04	0.04
query4	1.80	0.06	0.06
query5	0.55	0.52	0.52
query6	1.29	0.61	0.61
query7	0.01	0.01	0.01
query8	0.04	0.03	0.02
query9	0.50	0.49	0.47
query10	0.54	0.55	0.53
query11	0.12	0.08	0.08
query12	0.11	0.08	0.09
query13	0.62	0.61	0.62
query14	0.78	0.78	0.79
query15	0.80	0.76	0.77
query16	0.36	0.37	0.37
query17	1.00	1.03	1.00
query18	0.20	0.26	0.24
query19	1.88	1.84	1.79
query20	0.01	0.01	0.02
query21	15.49	0.56	0.56
query22	2.04	2.29	1.61
query23	17.02	1.15	0.99
query24	6.75	0.80	1.54
query25	0.33	0.13	0.05
query26	0.71	0.16	0.16
query27	0.04	0.03	0.04
query28	6.35	0.73	0.74
query29	12.63	2.40	2.33
query30	0.58	0.52	0.53
query31	2.81	0.38	0.37
query32	3.40	0.50	0.49
query33	3.07	3.06	3.06
query34	15.26	4.78	4.76
query35	4.84	4.84	4.84
query36	1.06	1.01	1.01
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.17	0.14	0.15
query41	0.07	0.01	0.02
query42	0.02	0.01	0.02
query43	0.03	0.02	0.01
Total cold run time: 103.75 s
Total hot run time: 30.57 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 784674ff3d9fc0972862338d505af3a63a340838 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.7 seconds inserted 10000000 Rows, about 460K ops/s

[bobhan1]

run p0