[fix](restore) restore failed between force_replication_allocation clusters

[cambyzju]

pick #34608 to branch-2.0

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[cambyzju]

run buildall

[lide-reed]

LGTM

[github-actions]

PR approved by at least one committer and no changes requested.

[github-actions]

PR approved by anyone and no changes requested.

[doris-robot]

TPC-H: Total hot run time: 49611 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b8a02b6c818c0d8410d7354e1b4802cf9bf8b2e6, data reload: false

------ Round 1 ----------------------------------
q1	17843	4366	4332	4332
q2	2029	153	145	145
q3	10441	1888	1948	1888
q4	10322	1233	1304	1233
q5	8503	3854	3929	3854
q6	234	124	122	122
q7	2015	1597	1587	1587
q8	9287	2692	2697	2692
q9	10546	10272	10325	10272
q10	8661	3482	3516	3482
q11	439	231	254	231
q12	468	304	305	304
q13	18349	3953	4015	3953
q14	353	330	324	324
q15	487	470	455	455
q16	670	565	565	565
q17	1148	962	1005	962
q18	7235	6999	6896	6896
q19	1707	1562	1531	1531
q20	543	304	304	304
q21	4467	4099	4083	4083
q22	495	396	399	396
Total cold run time: 116242 ms
Total hot run time: 49611 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4329	4318	4299	4299
q2	323	223	224	223
q3	4172	4143	4209	4143
q4	2733	2746	2759	2746
q5	7173	7131	7123	7123
q6	237	119	119	119
q7	3167	2853	2798	2798
q8	4349	4489	4481	4481
q9	16876	16673	16744	16673
q10	4257	4260	4301	4260
q11	760	681	670	670
q12	1020	857	867	857
q13	7020	3767	3741	3741
q14	449	433	419	419
q15	527	475	450	450
q16	738	673	678	673
q17	3896	3887	3901	3887
q18	8716	8672	8881	8672
q19	1721	1724	1657	1657
q20	2396	2069	2089	2069
q21	8460	8489	8503	8489
q22	1028	926	967	926
Total cold run time: 84347 ms
Total hot run time: 79375 ms

[doris-robot]

TPC-DS: Total hot run time: 203652 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b8a02b6c818c0d8410d7354e1b4802cf9bf8b2e6, data reload: false

query1	931	391	372	372
query2	6541	2801	2912	2801
query3	6925	211	209	209
query4	20521	17988	18013	17988
query5	19718	6490	6478	6478
query6	285	218	226	218
query7	4163	309	312	309
query8	280	241	225	225
query9	3158	2719	2651	2651
query10	407	293	312	293
query11	11329	10677	10720	10677
query12	117	77	73	73
query13	5582	688	677	677
query14	17485	13188	13244	13188
query15	387	219	225	219
query16	6488	269	254	254
query17	1739	1444	865	865
query18	2339	404	420	404
query19	209	149	146	146
query20	81	80	83	80
query21	197	90	93	90
query22	5285	5092	5050	5050
query23	32623	31774	31928	31774
query24	6933	6499	6634	6499
query25	525	448	408	408
query26	526	173	160	160
query27	1911	301	293	293
query28	6137	2379	2329	2329
query29	2994	2856	2803	2803
query30	242	166	164	164
query31	917	726	733	726
query32	68	61	63	61
query33	393	256	250	250
query34	832	476	464	464
query35	1110	910	949	910
query36	1322	1246	1506	1246
query37	90	59	61	59
query38	3060	2941	2907	2907
query39	1356	1354	1338	1338
query40	211	99	90	90
query41	39	36	35	35
query42	86	83	86	83
query43	740	733	640	640
query44	1154	706	723	706
query45	242	226	229	226
query46	1230	959	952	952
query47	1816	1772	1660	1660
query48	1006	728	717	717
query49	630	367	387	367
query50	846	615	626	615
query51	4810	4633	4725	4633
query52	82	81	74	74
query53	434	318	314	314
query54	2657	2446	2457	2446
query55	84	86	74	74
query56	233	199	223	199
query57	1212	1199	1083	1083
query58	217	201	192	192
query59	4113	4061	3828	3828
query60	209	199	198	198
query61	87	84	85	84
query62	808	534	472	472
query63	484	331	339	331
query64	2553	1494	1482	1482
query65	3642	3568	3614	3568
query66	815	401	374	374
query67	15911	15998	15025	15025
query68	8434	660	633	633
query69	578	364	352	352
query70	1629	1322	1268	1268
query71	405	310	322	310
query72	6400	3375	3390	3375
query73	724	318	327	318
query74	6370	5905	5893	5893
query75	4825	3815	3704	3704
query76	5030	1143	1168	1143
query77	741	248	260	248
query78	12615	12855	12604	12604
query79	8660	625	643	625
query80	1017	392	389	389
query81	507	231	237	231
query82	427	95	92	92
query83	170	136	127	127
query84	261	73	69	69
query85	714	297	287	287
query86	335	300	295	295
query87	3217	3020	3017	3017
query88	4531	2332	2333	2332
query89	359	298	269	269
query90	1894	205	208	205
query91	176	135	134	134
query92	56	53	52	52
query93	2645	580	562	562
query94	703	204	202	202
query95	1107	1053	1041	1041
query96	649	335	333	333
query97	6451	6373	6399	6373
query98	193	176	169	169
query99	2775	943	874	874
Total cold run time: 306155 ms
Total hot run time: 203652 ms

[doris-robot]

ClickBench: Total hot run time: 31.7 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b8a02b6c818c0d8410d7354e1b4802cf9bf8b2e6, data reload: false

query1	0.02	0.02	0.01
query2	0.07	0.02	0.02
query3	0.25	0.05	0.04
query4	1.79	0.08	0.06
query5	0.54	0.51	0.52
query6	1.25	0.62	0.61
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.53	0.49	0.49
query10	0.53	0.54	0.55
query11	0.12	0.09	0.08
query12	0.12	0.09	0.09
query13	0.63	0.61	0.62
query14	0.78	0.78	0.79
query15	0.77	0.76	0.77
query16	0.35	0.36	0.38
query17	1.03	1.04	0.98
query18	0.24	0.26	0.26
query19	1.86	1.90	1.85
query20	0.02	0.01	0.01
query21	15.83	0.56	0.60
query22	2.40	2.21	1.68
query23	16.32	1.13	0.85
query24	4.76	2.05	3.52
query25	0.40	0.08	0.06
query26	0.89	0.16	0.16
query27	0.04	0.04	0.03
query28	4.94	0.78	0.72
query29	12.60	2.22	2.31
query30	0.60	0.52	0.52
query31	2.82	0.38	0.37
query32	3.40	0.49	0.49
query33	3.08	3.05	3.07
query34	15.21	4.79	4.76
query35	4.87	4.83	4.83
query36	1.05	1.02	1.02
query37	0.06	0.04	0.05
query38	0.03	0.03	0.03
query39	0.02	0.02	0.01
query40	0.16	0.13	0.14
query41	0.07	0.02	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.01
Total cold run time: 100.53 s
Total hot run time: 31.7 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit b8a02b6c818c0d8410d7354e1b4802cf9bf8b2e6 with default session variables
Stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

[nextdreamblue]

LGTM