[opt](routine-load) optimize allocate task to be algorithm for load balance (#32021)

[sollhui]

pick #32021

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[sollhui]

run buildall

[doris-robot]

TPC-H: Total hot run time: 50340 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dbdf1b76f69fdeaefe67a1cd6d505f403c541e85, data reload: false

------ Round 1 ----------------------------------
q1	17652	4430	4361	4361
q2	2103	156	148	148
q3	10296	1964	1937	1937
q4	10385	1266	1320	1266
q5	8448	3880	3939	3880
q6	239	156	129	129
q7	2071	1643	1647	1643
q8	9351	2750	2737	2737
q9	10752	10406	10311	10311
q10	8669	3569	3551	3551
q11	424	255	243	243
q12	486	306	305	305
q13	18334	4024	4057	4024
q14	363	337	340	337
q15	506	456	468	456
q16	697	585	585	585
q17	1137	989	969	969
q18	7384	6878	6983	6878
q19	1797	1716	1706	1706
q20	556	325	304	304
q21	4517	4227	4128	4128
q22	552	451	442	442
Total cold run time: 116719 ms
Total hot run time: 50340 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4413	4402	4411	4402
q2	336	232	232	232
q3	4206	4271	4286	4271
q4	2837	2845	2857	2845
q5	7483	7374	7497	7374
q6	247	129	127	127
q7	3322	2844	2866	2844
q8	4441	4519	4579	4519
q9	17038	16851	16886	16851
q10	4257	4291	4244	4244
q11	745	673	690	673
q12	1029	875	871	871
q13	7018	3777	3752	3752
q14	473	426	437	426
q15	508	458	466	458
q16	728	681	676	676
q17	3911	3810	3847	3810
q18	8814	8817	8856	8817
q19	1737	1743	1691	1691
q20	2421	2145	2142	2142
q21	8641	8453	8505	8453
q22	1060	1006	972	972
Total cold run time: 85665 ms
Total hot run time: 80450 ms

[doris-robot]

TPC-DS: Total hot run time: 204295 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dbdf1b76f69fdeaefe67a1cd6d505f403c541e85, data reload: false

query1	958	422	382	382
query2	6544	2617	2793	2617
query3	6923	213	197	197
query4	20821	18040	18004	18004
query5	19741	6546	6566	6546
query6	284	218	231	218
query7	4171	304	310	304
query8	446	386	408	386
query9	3141	2709	2591	2591
query10	406	305	308	305
query11	11256	10787	10652	10652
query12	117	80	77	77
query13	5627	700	705	700
query14	17850	13398	13791	13398
query15	371	240	244	240
query16	6479	294	278	278
query17	1673	1468	888	888
query18	2310	409	410	409
query19	211	157	152	152
query20	82	82	82	82
query21	183	98	91	91
query22	5251	5111	5041	5041
query23	32578	32159	32085	32085
query24	7076	6572	6556	6556
query25	534	454	444	444
query26	535	172	166	166
query27	1830	297	294	294
query28	6158	2384	2326	2326
query29	2859	2823	2717	2717
query30	251	168	167	167
query31	931	740	744	740
query32	72	62	63	62
query33	408	267	272	267
query34	850	488	469	469
query35	1129	892	890	890
query36	1269	1284	1489	1284
query37	89	63	62	62
query38	3082	2946	2947	2946
query39	1401	1322	1324	1322
query40	202	98	95	95
query41	47	43	43	43
query42	85	83	80	80
query43	763	678	652	652
query44	1147	720	713	713
query45	246	243	241	241
query46	1224	992	993	992
query47	1868	1939	1632	1632
query48	1006	728	699	699
query49	624	376	371	371
query50	858	606	585	585
query51	4773	4618	4744	4618
query52	88	84	80	80
query53	455	336	319	319
query54	2647	2474	2484	2474
query55	82	92	72	72
query56	249	233	219	219
query57	1251	1099	1125	1099
query58	212	200	203	200
query59	3996	4004	4220	4004
query60	208	207	206	206
query61	99	97	95	95
query62	877	504	468	468
query63	492	341	350	341
query64	2524	1535	1349	1349
query65	3680	3564	3558	3558
query66	764	377	383	377
query67	16358	15693	16789	15693
query68	9406	645	641	641
query69	592	378	337	337
query70	1832	1409	1413	1409
query71	410	316	315	315
query72	6503	3504	3508	3504
query73	728	325	317	317
query74	6428	5908	5857	5857
query75	5396	3661	3698	3661
query76	6070	1161	1196	1161
query77	1010	258	256	256
query78	12829	11823	11488	11488
query79	7842	644	649	644
query80	1136	401	410	401
query81	489	241	233	233
query82	1718	101	100	100
query83	179	139	130	130
query84	258	71	70	70
query85	882	334	337	334
query86	345	289	298	289
query87	3233	3007	3045	3007
query88	4933	2293	2306	2293
query89	388	301	293	293
query90	1950	215	218	215
query91	171	142	138	138
query92	61	54	54	54
query93	5805	577	551	551
query94	712	214	204	204
query95	1111	1054	1058	1054
query96	639	328	324	324
query97	6416	6395	6430	6395
query98	183	177	179	177
query99	2920	871	813	813
Total cold run time: 315297 ms
Total hot run time: 204295 ms

[doris-robot]

ClickBench: Total hot run time: 30.8 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dbdf1b76f69fdeaefe67a1cd6d505f403c541e85, data reload: false

query1	0.02	0.03	0.02
query2	0.07	0.03	0.03
query3	0.25	0.05	0.04
query4	1.84	0.06	0.06
query5	0.53	0.53	0.52
query6	1.26	0.60	0.62
query7	0.01	0.01	0.01
query8	0.03	0.03	0.02
query9	0.52	0.48	0.48
query10	0.53	0.54	0.53
query11	0.12	0.08	0.08
query12	0.11	0.09	0.10
query13	0.61	0.62	0.62
query14	0.79	0.78	0.79
query15	0.76	0.77	0.78
query16	0.39	0.36	0.36
query17	0.97	1.02	1.03
query18	0.21	0.25	0.24
query19	1.88	1.84	1.86
query20	0.01	0.01	0.02
query21	15.47	0.56	0.54
query22	2.12	2.86	1.72
query23	17.39	1.02	0.83
query24	4.47	4.84	0.98
query25	0.39	0.09	0.05
query26	0.96	0.15	0.14
query27	0.05	0.03	0.03
query28	5.09	0.78	0.71
query29	12.78	2.36	2.29
query30	0.56	0.52	0.51
query31	2.80	0.38	0.38
query32	3.38	0.50	0.50
query33	3.08	3.07	3.07
query34	15.26	4.83	4.81
query35	4.84	4.87	4.86
query36	1.06	1.01	1.02
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.15	0.14	0.13
query41	0.07	0.02	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 100.99 s
Total hot run time: 30.8 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit dbdf1b76f69fdeaefe67a1cd6d505f403c541e85 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s