branch-3.1: [opt](cloud) Optimize balance speed by reducing the complexity of the rebalance algorithm #51733

[github-actions]

Cherry-picked from #51733

[Thearas]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?

[Thearas]

run buildall

[morrySnow]

run buildall

[doris-robot]

TPC-H: Total hot run time: 39615 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 08c6f123f6e65b1734ef74853e18d8997e41f687, data reload: false

------ Round 1 ----------------------------------
q1	17818	7019	6557	6557
q2	2060	164	166	164
q3	10691	1143	1134	1134
q4	10497	772	750	750
q5	7708	2913	2761	2761
q6	215	132	131	131
q7	993	610	599	599
q8	9592	1940	2054	1940
q9	8151	6797	6380	6380
q10	7028	2261	2299	2261
q11	458	259	264	259
q12	397	225	216	216
q13	17800	2987	2984	2984
q14	243	209	207	207
q15	516	487	483	483
q16	480	392	372	372
q17	972	546	546	546
q18	7244	6606	6684	6606
q19	1309	1026	962	962
q20	482	199	197	197
q21	3913	3151	3123	3123
q22	1118	1001	983	983
Total cold run time: 109685 ms
Total hot run time: 39615 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6655	6625	6535	6535
q2	327	230	237	230
q3	2983	2920	2913	2913
q4	2102	1825	1827	1825
q5	5664	5709	5752	5709
q6	210	127	130	127
q7	2257	1826	1809	1809
q8	3318	3529	3420	3420
q9	8803	8867	8739	8739
q10	3569	3521	3500	3500
q11	581	504	491	491
q12	807	577	618	577
q13	6865	3109	3169	3109
q14	300	273	281	273
q15	514	473	469	469
q16	493	433	440	433
q17	1825	1624	1655	1624
q18	8099	7644	7809	7644
q19	1656	1604	1446	1446
q20	2072	1876	1888	1876
q21	5163	5116	4991	4991
q22	1137	1096	1037	1037
Total cold run time: 65400 ms
Total hot run time: 58777 ms

[doris-robot]

TPC-DS: Total hot run time: 196270 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 08c6f123f6e65b1734ef74853e18d8997e41f687, data reload: false

query1	1287	888	891	888
query2	6245	1945	1915	1915
query3	10889	4329	4548	4329
query4	33023	23453	23444	23444
query5	3524	465	443	443
query6	260	174	194	174
query7	3985	308	319	308
query8	291	233	238	233
query9	9638	2558	2557	2557
query10	482	263	255	255
query11	17946	15095	15184	15095
query12	158	103	106	103
query13	1565	451	429	429
query14	9505	6568	6857	6568
query15	249	178	197	178
query16	7989	463	512	463
query17	1582	591	604	591
query18	2188	335	326	326
query19	202	162	176	162
query20	119	114	118	114
query21	207	112	113	112
query22	4721	4499	4516	4499
query23	35620	34163	34419	34163
query24	11954	2892	2849	2849
query25	680	436	431	431
query26	1301	178	177	177
query27	2769	352	352	352
query28	7719	2159	2168	2159
query29	888	489	475	475
query30	273	159	164	159
query31	1038	844	815	815
query32	93	56	54	54
query33	754	297	302	297
query34	1040	511	513	511
query35	853	719	715	715
query36	1104	935	949	935
query37	139	68	68	68
query38	4073	3933	3974	3933
query39	1575	1485	1488	1485
query40	212	96	101	96
query41	51	48	47	47
query42	123	102	101	101
query43	516	464	483	464
query44	1253	797	797	797
query45	186	175	178	175
query46	1182	738	773	738
query47	2013	1909	1956	1909
query48	419	352	352	352
query49	959	396	380	380
query50	854	433	420	420
query51	7361	7433	7206	7206
query52	101	91	88	88
query53	258	185	178	178
query54	1233	465	475	465
query55	81	78	80	78
query56	263	248	243	243
query57	1325	1232	1207	1207
query58	234	213	227	213
query59	3311	3178	2996	2996
query60	272	256	254	254
query61	113	129	113	113
query62	885	704	704	704
query63	227	190	185	185
query64	4004	674	682	674
query65	3355	3293	3326	3293
query66	781	292	297	292
query67	15831	15682	15384	15384
query68	4357	579	576	576
query69	430	260	267	260
query70	1160	1041	1096	1041
query71	356	256	250	250
query72	6325	4084	4028	4028
query73	759	346	351	346
query74	10384	9119	9210	9119
query75	3371	2664	2637	2637
query76	2818	1169	1025	1025
query77	383	267	267	267
query78	10506	9615	9564	9564
query79	1426	605	595	595
query80	1131	430	417	417
query81	538	227	223	223
query82	972	87	89	87
query83	239	145	148	145
query84	231	83	76	76
query85	1300	314	301	301
query86	401	283	312	283
query87	4315	4268	4235	4235
query88	3692	2406	2374	2374
query89	428	291	294	291
query90	1812	183	185	183
query91	142	107	108	107
query92	62	53	52	52
query93	1635	545	537	537
query94	787	291	304	291
query95	354	247	256	247
query96	606	284	288	284
query97	3310	3117	3225	3117
query98	216	198	196	196
query99	1538	1300	1329	1300
Total cold run time: 301315 ms
Total hot run time: 196270 ms

[doris-robot]

ClickBench: Total hot run time: 30.19 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 08c6f123f6e65b1734ef74853e18d8997e41f687, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.04
query3	0.23	0.06	0.06
query4	1.63	0.11	0.11
query5	0.52	0.52	0.53
query6	1.13	0.73	0.73
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.58	0.50	0.49
query10	0.56	0.54	0.55
query11	0.15	0.10	0.11
query12	0.15	0.11	0.11
query13	0.60	0.62	0.59
query14	0.78	0.80	0.80
query15	0.84	0.84	0.82
query16	0.39	0.40	0.38
query17	1.08	1.09	0.98
query18	0.25	0.22	0.22
query19	2.00	1.82	1.83
query20	0.01	0.01	0.01
query21	15.39	0.60	0.58
query22	2.45	1.94	1.50
query23	17.07	0.97	0.82
query24	3.07	1.45	1.31
query25	0.41	0.19	0.11
query26	0.33	0.14	0.13
query27	0.05	0.05	0.04
query28	9.84	0.52	0.44
query29	12.55	3.18	3.15
query30	0.24	0.06	0.06
query31	2.86	0.38	0.38
query32	3.25	0.46	0.46
query33	2.99	2.99	3.01
query34	17.24	4.57	4.50
query35	4.54	4.56	4.60
query36	0.67	0.48	0.49
query37	0.08	0.06	0.06
query38	0.04	0.03	0.04
query39	0.04	0.03	0.02
query40	0.17	0.12	0.12
query41	0.07	0.03	0.03
query42	0.02	0.02	0.03
query43	0.03	0.02	0.03
Total cold run time: 104.46 s
Total hot run time: 30.19 s