Skip to content

Conversation

@LiBinfeng-01
Copy link
Contributor

Cherry-picked from #49575

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@LiBinfeng-01
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39784 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 236af6a1cd089694e801701f9cbcbf34620819dc, data reload: false

------ Round 1 ----------------------------------
q1	18083	6787	6619	6619
q2	2055	179	177	177
q3	10828	1076	1123	1076
q4	10558	741	738	738
q5	7756	2793	2825	2793
q6	222	132	130	130
q7	958	610	613	610
q8	9349	1925	1941	1925
q9	6500	6358	6411	6358
q10	7050	2274	2286	2274
q11	467	264	262	262
q12	388	206	212	206
q13	17776	2964	2978	2964
q14	237	206	207	206
q15	496	465	472	465
q16	682	596	588	588
q17	971	599	566	566
q18	7170	6507	6605	6507
q19	1382	1046	1090	1046
q20	475	198	196	196
q21	3879	3094	3125	3094
q22	1109	984	990	984
Total cold run time: 108391 ms
Total hot run time: 39784 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6612	6696	6567	6567
q2	325	232	228	228
q3	2913	2790	2877	2790
q4	2000	1832	1806	1806
q5	5756	5718	5681	5681
q6	215	126	128	126
q7	2161	1849	1781	1781
q8	3353	3526	3493	3493
q9	8778	8818	8844	8818
q10	3611	3499	3514	3499
q11	600	489	484	484
q12	824	623	581	581
q13	9566	3204	3236	3204
q14	318	271	265	265
q15	517	471	459	459
q16	689	630	657	630
q17	1834	1636	1589	1589
q18	8146	7760	7756	7756
q19	1659	1442	1440	1440
q20	2060	1889	1860	1860
q21	5540	5416	5352	5352
q22	1114	1018	1036	1018
Total cold run time: 68591 ms
Total hot run time: 59427 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 198109 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 236af6a1cd089694e801701f9cbcbf34620819dc, data reload: false

query1	1289	928	913	913
query2	6275	2080	2106	2080
query3	10847	4533	4410	4410
query4	60894	29538	23417	23417
query5	5173	476	463	463
query6	388	176	182	176
query7	5450	319	325	319
query8	316	233	222	222
query9	8404	2621	2607	2607
query10	444	274	261	261
query11	17863	15283	15935	15283
query12	150	107	102	102
query13	1429	444	442	442
query14	11105	7475	7121	7121
query15	205	180	179	179
query16	6983	488	490	488
query17	1224	610	624	610
query18	1880	321	338	321
query19	224	169	173	169
query20	123	114	113	113
query21	203	108	111	108
query22	4487	4517	4756	4517
query23	34484	34335	33945	33945
query24	6303	3036	3133	3036
query25	563	462	444	444
query26	670	180	182	180
query27	1956	369	388	369
query28	3967	2461	2446	2446
query29	712	493	465	465
query30	244	172	195	172
query31	1000	830	839	830
query32	68	63	59	59
query33	463	316	310	310
query34	1027	530	539	530
query35	883	756	743	743
query36	1106	989	969	969
query37	124	72	76	72
query38	4256	4117	4045	4045
query39	1506	1492	1468	1468
query40	207	102	99	99
query41	51	49	53	49
query42	116	97	109	97
query43	549	507	504	504
query44	1201	838	829	829
query45	195	177	167	167
query46	1174	754	770	754
query47	1995	1910	1920	1910
query48	494	397	380	380
query49	731	425	402	402
query50	864	429	432	429
query51	7502	7243	7302	7243
query52	108	91	93	91
query53	274	188	186	186
query54	570	458	470	458
query55	84	82	82	82
query56	273	266	253	253
query57	1276	1127	1133	1127
query58	230	220	228	220
query59	3507	3003	3210	3003
query60	293	272	267	267
query61	142	105	106	105
query62	779	673	688	673
query63	223	195	190	190
query64	1451	676	689	676
query65	3298	3220	3233	3220
query66	730	299	301	299
query67	15920	15433	15595	15433
query68	4112	583	583	583
query69	434	303	277	277
query70	1181	1104	1136	1104
query71	348	258	258	258
query72	6352	4079	4036	4036
query73	782	356	355	355
query74	10173	8993	9263	8993
query75	3376	2693	2664	2664
query76	2057	1091	1129	1091
query77	500	292	283	283
query78	10590	9567	9499	9499
query79	1604	614	606	606
query80	874	455	430	430
query81	518	243	233	233
query82	1266	94	90	90
query83	249	146	139	139
query84	286	79	87	79
query85	878	312	292	292
query86	318	290	291	290
query87	4546	4203	4224	4203
query88	3803	2418	2363	2363
query89	414	298	290	290
query90	1995	187	190	187
query91	188	159	150	150
query92	61	50	52	50
query93	1994	549	550	549
query94	743	301	287	287
query95	361	256	260	256
query96	643	283	277	277
query97	3391	3142	3168	3142
query98	213	204	201	201
query99	1593	1316	1302	1302
Total cold run time: 314768 ms
Total hot run time: 198109 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.93 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 236af6a1cd089694e801701f9cbcbf34620819dc, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.03
query3	0.23	0.07	0.06
query4	1.63	0.10	0.11
query5	0.51	0.54	0.52
query6	1.14	0.73	0.73
query7	0.02	0.01	0.02
query8	0.06	0.04	0.03
query9	0.57	0.50	0.49
query10	0.56	0.55	0.56
query11	0.15	0.10	0.10
query12	0.14	0.11	0.12
query13	0.61	0.60	0.59
query14	2.83	2.83	2.85
query15	0.90	0.82	0.83
query16	0.38	0.37	0.38
query17	0.96	1.04	0.97
query18	0.23	0.21	0.22
query19	1.89	1.87	2.02
query20	0.02	0.01	0.01
query21	15.36	0.58	0.57
query22	2.60	2.45	1.48
query23	16.71	0.94	0.83
query24	3.21	1.71	0.98
query25	0.26	0.17	0.07
query26	0.44	0.14	0.14
query27	0.05	0.04	0.04
query28	9.86	0.54	0.51
query29	12.61	3.25	3.25
query30	0.27	0.06	0.05
query31	2.86	0.39	0.39
query32	3.24	0.45	0.45
query33	3.01	3.04	3.02
query34	17.20	4.48	4.45
query35	4.46	4.48	4.49
query36	0.68	0.49	0.48
query37	0.09	0.06	0.06
query38	0.04	0.03	0.03
query39	0.03	0.02	0.03
query40	0.17	0.13	0.12
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.25 s
Total hot run time: 31.93 s

@LiBinfeng-01
Copy link
Contributor Author

run buildall

@LiBinfeng-01
Copy link
Contributor Author

run buildall

1 similar comment
@LiBinfeng-01
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40086 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dc8682758546faa849c6a8c106549e6b0ec5dd9f, data reload: false

------ Round 1 ----------------------------------
q1	17568	6787	6633	6633
q2	2068	179	165	165
q3	10626	1054	1208	1054
q4	10578	762	691	691
q5	7723	2854	2825	2825
q6	217	135	134	134
q7	965	613	592	592
q8	9380	1935	2006	1935
q9	6599	6406	6337	6337
q10	7038	2230	2310	2230
q11	463	270	259	259
q12	399	210	206	206
q13	17802	2969	3000	2969
q14	236	210	204	204
q15	499	454	460	454
q16	679	584	575	575
q17	972	613	566	566
q18	7149	6785	6753	6753
q19	1399	1084	1156	1084
q20	461	207	199	199
q21	3947	3265	3255	3255
q22	1087	975	966	966
Total cold run time: 107855 ms
Total hot run time: 40086 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6635	6588	6574	6574
q2	337	240	232	232
q3	2878	2760	2937	2760
q4	2002	1786	1738	1738
q5	5745	5734	5742	5734
q6	213	128	131	128
q7	2209	1819	1860	1819
q8	3373	3578	3532	3532
q9	8975	8789	8908	8789
q10	3574	3554	3525	3525
q11	583	495	553	495
q12	813	590	604	590
q13	8800	3166	3200	3166
q14	311	296	267	267
q15	507	464	462	462
q16	694	662	633	633
q17	1847	1611	1613	1611
q18	8145	7714	7758	7714
q19	1669	1535	1563	1535
q20	2074	1903	1846	1846
q21	5534	5334	5395	5334
q22	1071	1024	1028	1024
Total cold run time: 67989 ms
Total hot run time: 59508 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197436 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dc8682758546faa849c6a8c106549e6b0ec5dd9f, data reload: false

query1	1283	917	922	917
query2	6238	2040	1950	1950
query3	10817	4452	4219	4219
query4	61635	29161	23772	23772
query5	5233	491	457	457
query6	430	190	177	177
query7	5484	338	315	315
query8	323	221	230	221
query9	8534	2592	2593	2592
query10	466	263	256	256
query11	17493	15654	15745	15654
query12	163	111	104	104
query13	1487	452	436	436
query14	9916	7417	6884	6884
query15	200	183	177	177
query16	7204	517	511	511
query17	1151	585	599	585
query18	1826	346	329	329
query19	218	172	172	172
query20	119	113	111	111
query21	212	101	104	101
query22	4572	4290	4641	4290
query23	34310	33808	33973	33808
query24	6157	3029	2994	2994
query25	528	433	435	433
query26	663	174	171	171
query27	1834	356	364	356
query28	4070	2477	2395	2395
query29	681	449	439	439
query30	252	166	170	166
query31	981	846	856	846
query32	64	59	55	55
query33	456	283	291	283
query34	900	520	527	520
query35	835	722	732	722
query36	1088	953	966	953
query37	115	66	66	66
query38	4017	3975	4022	3975
query39	1576	1489	1463	1463
query40	213	100	95	95
query41	49	46	50	46
query42	117	99	97	97
query43	537	492	466	466
query44	1170	838	819	819
query45	183	171	166	166
query46	1145	720	745	720
query47	2079	1915	1942	1915
query48	479	383	401	383
query49	726	416	398	398
query50	849	439	430	430
query51	7219	7348	7236	7236
query52	100	89	91	89
query53	265	194	190	190
query54	575	471	481	471
query55	85	76	77	76
query56	281	240	251	240
query57	1256	1131	1151	1131
query58	226	216	216	216
query59	3211	3046	2943	2943
query60	276	278	249	249
query61	111	119	131	119
query62	748	683	672	672
query63	218	190	188	188
query64	1393	708	628	628
query65	3224	3258	3195	3195
query66	708	296	305	296
query67	16026	15520	15720	15520
query68	4321	577	576	576
query69	424	269	278	269
query70	1166	1129	1149	1129
query71	347	264	250	250
query72	6376	4013	4365	4013
query73	749	352	358	352
query74	10392	9228	8978	8978
query75	3371	2653	2663	2653
query76	1833	999	1084	999
query77	471	284	276	276
query78	10564	9592	9638	9592
query79	1183	601	588	588
query80	826	448	417	417
query81	526	243	235	235
query82	1276	90	88	88
query83	159	152	140	140
query84	285	89	78	78
query85	865	308	296	296
query86	328	307	304	304
query87	4353	4228	4217	4217
query88	3565	2434	2494	2434
query89	416	306	295	295
query90	1978	188	196	188
query91	181	146	149	146
query92	64	51	49	49
query93	1303	564	557	557
query94	737	280	301	280
query95	346	253	254	253
query96	622	283	287	283
query97	3335	3177	3155	3155
query98	212	204	203	203
query99	1526	1274	1297	1274
Total cold run time: 311100 ms
Total hot run time: 197436 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.32 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dc8682758546faa849c6a8c106549e6b0ec5dd9f, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.03	0.03
query3	0.22	0.07	0.06
query4	1.63	0.10	0.10
query5	0.52	0.51	0.50
query6	1.12	0.72	0.74
query7	0.02	0.02	0.02
query8	0.06	0.03	0.03
query9	0.56	0.52	0.52
query10	0.55	0.56	0.57
query11	0.15	0.11	0.11
query12	0.15	0.11	0.11
query13	0.60	0.59	0.59
query14	2.72	2.77	2.71
query15	0.91	0.81	0.83
query16	0.39	0.40	0.36
query17	0.97	1.08	1.06
query18	0.24	0.23	0.22
query19	1.85	1.90	2.05
query20	0.01	0.02	0.01
query21	15.35	0.59	0.61
query22	2.34	2.62	1.82
query23	16.97	1.03	0.90
query24	3.00	0.97	1.24
query25	0.20	0.24	0.11
query26	0.40	0.14	0.14
query27	0.04	0.03	0.04
query28	10.29	0.47	0.53
query29	12.56	3.23	3.25
query30	0.25	0.06	0.06
query31	2.85	0.39	0.39
query32	3.25	0.46	0.45
query33	2.93	3.04	2.99
query34	16.93	4.48	4.42
query35	4.50	4.52	4.62
query36	0.69	0.48	0.47
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.13	0.12
query41	0.08	0.02	0.03
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.83 s
Total hot run time: 32.32 s

@LiBinfeng-01
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39842 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b12a2dbb6606910163bbc45c726809d0e1d2477a, data reload: false

------ Round 1 ----------------------------------
q1	17399	6672	6585	6585
q2	2076	180	176	176
q3	10480	1035	1120	1035
q4	10212	763	751	751
q5	7725	2852	2785	2785
q6	216	133	132	132
q7	957	618	607	607
q8	9354	1902	2056	1902
q9	6545	6406	6401	6401
q10	6999	2237	2324	2237
q11	460	262	264	262
q12	396	219	212	212
q13	17994	3018	2990	2990
q14	238	208	213	208
q15	503	459	452	452
q16	662	579	584	579
q17	973	541	563	541
q18	7156	6756	6575	6575
q19	1375	1005	1154	1005
q20	466	212	206	206
q21	4010	3311	3214	3214
q22	1089	987	999	987
Total cold run time: 107285 ms
Total hot run time: 39842 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6827	6524	6559	6524
q2	342	233	237	233
q3	2887	2752	2822	2752
q4	2075	1717	1758	1717
q5	5771	5758	5669	5669
q6	217	133	129	129
q7	2195	1768	1792	1768
q8	3356	3494	3529	3494
q9	8907	8677	8810	8677
q10	3593	3531	3536	3531
q11	591	503	496	496
q12	791	577	588	577
q13	8470	3167	3140	3140
q14	301	272	283	272
q15	517	464	467	464
q16	686	645	669	645
q17	1849	1628	1611	1611
q18	8169	7943	7743	7743
q19	1697	1591	1743	1591
q20	2169	1794	1821	1794
q21	5420	5274	5450	5274
q22	1142	1016	1018	1016
Total cold run time: 67972 ms
Total hot run time: 59117 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197905 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b12a2dbb6606910163bbc45c726809d0e1d2477a, data reload: false

query1	1279	918	934	918
query2	6242	2067	1986	1986
query3	10844	4464	4313	4313
query4	61538	28834	23494	23494
query5	5231	481	458	458
query6	409	188	197	188
query7	5472	315	314	314
query8	313	233	230	230
query9	8533	2654	2643	2643
query10	473	298	267	267
query11	17535	15837	15859	15837
query12	160	110	109	109
query13	1488	462	432	432
query14	10333	7234	7102	7102
query15	208	185	184	184
query16	7155	509	521	509
query17	1158	608	613	608
query18	1886	334	313	313
query19	211	161	170	161
query20	120	110	109	109
query21	210	104	101	101
query22	4535	4492	4612	4492
query23	34203	33899	34057	33899
query24	6164	2896	2969	2896
query25	513	409	389	389
query26	647	165	166	165
query27	1850	359	365	359
query28	4497	2485	2460	2460
query29	680	467	429	429
query30	252	162	169	162
query31	989	857	815	815
query32	65	54	57	54
query33	400	275	288	275
query34	898	510	524	510
query35	854	751	719	719
query36	1073	954	963	954
query37	119	73	71	71
query38	4070	4010	3949	3949
query39	1516	1545	1485	1485
query40	204	101	102	101
query41	52	50	52	50
query42	127	107	104	104
query43	534	488	494	488
query44	1193	836	822	822
query45	184	167	168	167
query46	1130	746	756	746
query47	2011	1940	1937	1937
query48	495	396	400	396
query49	786	422	413	413
query50	869	437	436	436
query51	7327	7192	7198	7192
query52	111	102	96	96
query53	269	188	188	188
query54	611	484	488	484
query55	78	85	79	79
query56	281	278	274	274
query57	1290	1146	1184	1146
query58	251	224	235	224
query59	3264	3016	2935	2935
query60	299	262	265	262
query61	138	131	131	131
query62	755	665	676	665
query63	221	197	196	196
query64	1443	674	650	650
query65	3332	3216	3232	3216
query66	708	302	294	294
query67	15778	15533	15483	15483
query68	4257	581	570	570
query69	427	275	271	271
query70	1197	1128	1075	1075
query71	352	269	268	268
query72	6354	3972	4092	3972
query73	762	367	350	350
query74	10269	8913	9012	8913
query75	3368	2647	2635	2635
query76	1989	1110	1130	1110
query77	495	272	276	272
query78	10551	9668	9491	9491
query79	1460	592	612	592
query80	865	428	441	428
query81	521	246	245	245
query82	1269	92	88	88
query83	237	146	135	135
query84	288	81	77	77
query85	887	301	290	290
query86	329	268	304	268
query87	4427	4280	4232	4232
query88	3896	2400	2384	2384
query89	415	299	299	299
query90	1989	186	186	186
query91	179	170	149	149
query92	61	52	51	51
query93	1936	566	556	556
query94	735	302	299	299
query95	368	257	258	257
query96	616	284	284	284
query97	3270	3134	3152	3134
query98	213	197	205	197
query99	1575	1306	1293	1293
Total cold run time: 313421 ms
Total hot run time: 197905 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.4 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b12a2dbb6606910163bbc45c726809d0e1d2477a, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.07	0.07
query4	1.63	0.10	0.10
query5	0.50	0.50	0.51
query6	1.15	0.73	0.73
query7	0.02	0.01	0.01
query8	0.06	0.03	0.03
query9	0.56	0.51	0.49
query10	0.55	0.55	0.55
query11	0.14	0.10	0.10
query12	0.15	0.12	0.11
query13	0.61	0.59	0.59
query14	2.69	2.85	2.81
query15	0.92	0.83	0.82
query16	0.40	0.40	0.40
query17	1.00	0.98	1.04
query18	0.25	0.22	0.23
query19	1.87	1.73	2.02
query20	0.01	0.02	0.01
query21	15.37	0.58	0.59
query22	2.58	2.01	2.31
query23	17.08	0.93	0.75
query24	3.33	1.09	0.99
query25	0.09	0.17	0.11
query26	0.58	0.14	0.15
query27	0.04	0.05	0.04
query28	10.10	0.56	0.50
query29	12.59	3.26	3.27
query30	0.24	0.07	0.06
query31	2.86	0.40	0.39
query32	3.23	0.47	0.47
query33	3.01	3.03	3.03
query34	16.62	4.46	4.51
query35	4.52	4.49	4.50
query36	0.67	0.51	0.51
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.02	0.02
query40	0.16	0.13	0.12
query41	0.08	0.03	0.02
query42	0.04	0.03	0.02
query43	0.03	0.04	0.03
Total cold run time: 106.24 s
Total hot run time: 32.4 s

@LiBinfeng-01
Copy link
Contributor Author

run feut

@LiBinfeng-01
Copy link
Contributor Author

run p0

@LiBinfeng-01
Copy link
Contributor Author

run feut

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit 1bf4983 into apache:branch-3.0 Apr 25, 2025
22 of 23 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants