branch-3.0: [fix][cloud] Prevent fe CloudReplica.getBackendIdImpl consuming too much CPU when high-frequency stream loads #48564

[deardeng]

cherry pick from #48564

[deardeng]

run buildall

[Thearas]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?

[doris-robot]

TPC-H: Total hot run time: 40246 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 06a2f015d00cd03992a39e82c7620b86f535807f, data reload: false

------ Round 1 ----------------------------------
q1	17607	6756	6652	6652
q2	2085	171	175	171
q3	10565	1111	1223	1111
q4	10560	736	768	736
q5	7762	2962	2842	2842
q6	224	136	131	131
q7	983	630	608	608
q8	9358	2003	2072	2003
q9	6711	6407	6422	6407
q10	7015	2304	2296	2296
q11	473	266	265	265
q12	405	205	210	205
q13	17794	2953	2961	2953
q14	253	214	216	214
q15	517	476	448	448
q16	654	592	580	580
q17	988	603	572	572
q18	7379	6634	6708	6634
q19	1408	1081	1044	1044
q20	473	203	197	197
q21	4034	3218	3226	3218
q22	1104	1000	959	959
Total cold run time: 108352 ms
Total hot run time: 40246 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6646	7274	6600	6600
q2	336	233	229	229
q3	2893	2784	2917	2784
q4	2044	1835	1777	1777
q5	5847	5758	5737	5737
q6	213	128	130	128
q7	2207	1805	1861	1805
q8	3424	3615	3550	3550
q9	8849	8989	8873	8873
q10	3584	3563	3528	3528
q11	590	503	489	489
q12	809	636	616	616
q13	8961	3242	3173	3173
q14	306	268	279	268
q15	523	476	463	463
q16	690	670	661	661
q17	1852	1624	1599	1599
q18	8298	7834	7781	7781
q19	1665	1679	1637	1637
q20	2153	1870	1902	1870
q21	5588	5532	5301	5301
q22	1117	1006	1023	1006
Total cold run time: 68595 ms
Total hot run time: 59875 ms

[doris-robot]

TPC-DS: Total hot run time: 197365 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 06a2f015d00cd03992a39e82c7620b86f535807f, data reload: false

query1	1287	912	928	912
query2	6208	2030	1993	1993
query3	10838	4269	4209	4209
query4	65462	29180	23882	23882
query5	5028	486	464	464
query6	416	190	176	176
query7	5660	322	307	307
query8	301	225	220	220
query9	9147	2611	2600	2600
query10	458	279	256	256
query11	17636	15233	15824	15233
query12	151	108	109	108
query13	1556	463	446	446
query14	10561	7275	6825	6825
query15	213	192	181	181
query16	7230	491	506	491
query17	1069	596	612	596
query18	1898	325	324	324
query19	254	160	173	160
query20	120	115	110	110
query21	210	102	105	102
query22	4726	4641	4481	4481
query23	34527	33829	34098	33829
query24	6295	2991	2989	2989
query25	542	404	402	402
query26	672	167	162	162
query27	2023	355	354	354
query28	4372	2492	2501	2492
query29	714	449	424	424
query30	249	165	164	164
query31	959	858	825	825
query32	68	57	60	57
query33	472	297	305	297
query34	952	506	503	503
query35	852	719	746	719
query36	1086	955	958	955
query37	118	65	66	65
query38	4135	4030	4056	4030
query39	1494	1452	1476	1452
query40	209	101	101	101
query41	50	75	46	46
query42	113	109	103	103
query43	524	495	492	492
query44	1203	840	831	831
query45	184	171	170	170
query46	1170	721	759	721
query47	2026	1902	1937	1902
query48	511	398	395	395
query49	792	425	414	414
query50	860	457	440	440
query51	7413	7293	7116	7116
query52	102	89	92	89
query53	267	183	182	182
query54	584	462	465	462
query55	80	80	84	80
query56	279	261	262	261
query57	1243	1133	1095	1095
query58	225	219	221	219
query59	3092	3005	3005	3005
query60	293	269	271	269
query61	142	134	160	134
query62	778	694	668	668
query63	221	190	187	187
query64	1475	753	620	620
query65	3264	3200	3188	3188
query66	701	296	312	296
query67	15872	15833	15507	15507
query68	4097	597	575	575
query69	434	268	273	268
query70	1165	1134	1052	1052
query71	348	274	257	257
query72	6437	4139	4070	4070
query73	789	347	347	347
query74	10269	9136	9209	9136
query75	3361	2722	2662	2662
query76	1945	1060	971	971
query77	534	280	271	271
query78	10559	9526	9561	9526
query79	1481	616	604	604
query80	885	441	429	429
query81	515	240	236	236
query82	1273	92	90	90
query83	247	145	144	144
query84	285	81	81	81
query85	908	329	302	302
query86	346	298	313	298
query87	4433	4308	4227	4227
query88	3788	2385	2354	2354
query89	420	295	287	287
query90	1993	188	186	186
query91	185	150	170	150
query92	68	50	53	50
query93	1917	557	550	550
query94	780	297	301	297
query95	356	262	255	255
query96	611	284	276	276
query97	3311	3135	3169	3135
query98	216	195	195	195
query99	1567	1301	1296	1296
Total cold run time: 319155 ms
Total hot run time: 197365 ms

[doris-robot]

ClickBench: Total hot run time: 32.37 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 06a2f015d00cd03992a39e82c7620b86f535807f, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.06
query4	1.63	0.11	0.10
query5	0.54	0.51	0.52
query6	1.15	0.73	0.74
query7	0.02	0.02	0.01
query8	0.04	0.04	0.05
query9	0.56	0.52	0.50
query10	0.54	0.55	0.56
query11	0.15	0.10	0.11
query12	0.14	0.11	0.12
query13	0.60	0.59	0.59
query14	2.73	2.70	2.74
query15	0.91	0.83	0.84
query16	0.40	0.40	0.37
query17	1.07	1.07	1.03
query18	0.24	0.21	0.22
query19	1.91	1.88	2.02
query20	0.01	0.00	0.01
query21	15.42	0.62	0.57
query22	2.73	2.60	2.78
query23	16.98	0.97	0.84
query24	3.29	1.64	0.39
query25	0.24	0.25	0.04
query26	0.41	0.13	0.14
query27	0.04	0.04	0.03
query28	10.43	0.49	0.47
query29	12.59	3.24	3.24
query30	0.24	0.06	0.06
query31	2.84	0.39	0.39
query32	3.26	0.45	0.45
query33	2.97	3.05	3.00
query34	17.19	4.49	4.46
query35	4.57	4.60	4.53
query36	0.67	0.50	0.49
query37	0.10	0.06	0.06
query38	0.05	0.03	0.04
query39	0.04	0.03	0.02
query40	0.17	0.12	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.37 s
Total hot run time: 32.37 s

[dataroaring]

LGTM

[github-actions]

PR approved by at least one committer and no changes requested.

[github-actions]

PR approved by anyone and no changes requested.