Skip to content

Conversation

@morrySnow
Copy link
Contributor

pick from #47661 #47975 #48747

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39821 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a214d491be57cc8cf73b117da025e832103f7770, data reload: false

------ Round 1 ----------------------------------
q1	17690	6803	6593	6593
q2	2076	176	165	165
q3	10666	1086	1158	1086
q4	10346	767	798	767
q5	7762	2903	2873	2873
q6	229	136	134	134
q7	989	613	610	610
q8	9355	1953	2026	1953
q9	6681	6438	6429	6429
q10	6987	2276	2294	2276
q11	464	259	258	258
q12	391	218	213	213
q13	17788	2984	2993	2984
q14	236	208	204	204
q15	506	468	470	468
q16	517	378	387	378
q17	988	525	551	525
q18	7522	6627	6747	6627
q19	1398	1042	1034	1034
q20	470	212	203	203
q21	3879	3108	3031	3031
q22	1102	1010	1014	1010
Total cold run time: 108042 ms
Total hot run time: 39821 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6652	6569	6579	6569
q2	328	232	245	232
q3	2912	2787	2889	2787
q4	2075	1759	1765	1759
q5	5765	5758	5744	5744
q6	212	136	132	132
q7	2200	1802	1805	1802
q8	3379	3559	3542	3542
q9	8971	8799	8941	8799
q10	3575	3539	3538	3538
q11	590	496	487	487
q12	811	589	615	589
q13	10063	3145	3171	3145
q14	303	266	275	266
q15	522	465	458	458
q16	496	443	459	443
q17	1845	1632	1600	1600
q18	8205	7811	7799	7799
q19	1704	1571	1634	1571
q20	2112	1834	1827	1827
q21	5098	5048	4904	4904
q22	1173	1018	1047	1018
Total cold run time: 68991 ms
Total hot run time: 59011 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196866 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a214d491be57cc8cf73b117da025e832103f7770, data reload: false

query1	1287	908	896	896
query2	6265	1953	1982	1953
query3	10904	4486	4400	4400
query4	61117	32271	23362	23362
query5	4701	452	441	441
query6	400	169	171	169
query7	5444	312	306	306
query8	308	226	224	224
query9	8634	2554	2544	2544
query10	442	291	268	268
query11	16299	14912	15756	14912
query12	163	105	106	105
query13	1452	419	416	416
query14	10666	7188	6804	6804
query15	208	189	182	182
query16	7200	483	482	482
query17	1154	600	606	600
query18	1890	324	326	324
query19	214	168	158	158
query20	125	108	108	108
query21	218	107	109	107
query22	4644	4774	4581	4581
query23	34351	34433	34401	34401
query24	6206	2902	2988	2902
query25	498	395	401	395
query26	663	168	172	168
query27	1864	356	350	350
query28	4094	2178	2135	2135
query29	683	460	430	430
query30	235	154	162	154
query31	993	817	828	817
query32	70	55	66	55
query33	437	302	301	301
query34	906	512	517	512
query35	864	740	715	715
query36	1082	965	940	940
query37	114	69	70	69
query38	4101	3923	3929	3923
query39	1498	1469	1543	1469
query40	212	101	98	98
query41	48	49	48	48
query42	117	110	105	105
query43	567	494	498	494
query44	1193	802	801	801
query45	182	177	171	171
query46	1148	743	730	730
query47	2051	1925	1951	1925
query48	494	381	390	381
query49	757	404	402	402
query50	826	424	411	411
query51	7492	7318	7111	7111
query52	102	92	97	92
query53	263	189	186	186
query54	562	472	468	468
query55	77	76	79	76
query56	274	245	239	239
query57	1323	1235	1225	1225
query58	223	213	217	213
query59	3328	3300	3051	3051
query60	283	274	256	256
query61	107	108	141	108
query62	801	689	673	673
query63	208	187	184	184
query64	2043	653	628	628
query65	3247	3198	3216	3198
query66	685	302	292	292
query67	15940	15559	15701	15559
query68	4012	567	576	567
query69	432	271	267	267
query70	1107	1081	1108	1081
query71	332	253	257	253
query72	6349	4045	3991	3991
query73	753	356	345	345
query74	10124	9365	9284	9284
query75	3343	2654	2667	2654
query76	1975	1098	1022	1022
query77	536	273	261	261
query78	10500	9540	9619	9540
query79	1444	590	604	590
query80	869	424	416	416
query81	492	221	219	219
query82	892	92	86	86
query83	168	148	149	148
query84	280	84	77	77
query85	829	295	308	295
query86	328	301	294	294
query87	4362	4246	4287	4246
query88	3801	2402	2377	2377
query89	414	290	285	285
query90	1976	182	183	182
query91	178	151	144	144
query92	59	49	48	48
query93	1726	543	543	543
query94	708	296	286	286
query95	351	253	253	253
query96	617	280	282	280
query97	3340	3134	3146	3134
query98	216	202	193	193
query99	1547	1302	1332	1302
Total cold run time: 311007 ms
Total hot run time: 196866 ms

@morrySnow
Copy link
Contributor Author

run buildall

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39877 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9371d86cce8514c029ab266f8c709043b371cfa9, data reload: false

------ Round 1 ----------------------------------
q1	17571	7254	6617	6617
q2	2062	162	158	158
q3	10569	1143	1138	1138
q4	10980	786	790	786
q5	8630	2939	2886	2886
q6	229	142	134	134
q7	1026	642	639	639
q8	10324	1980	2033	1980
q9	6698	6421	6468	6421
q10	6965	2270	2311	2270
q11	455	264	259	259
q12	405	212	219	212
q13	17776	2970	2996	2970
q14	250	210	210	210
q15	516	460	479	460
q16	446	378	391	378
q17	980	536	622	536
q18	7260	6585	6596	6585
q19	1320	1056	997	997
q20	472	202	198	198
q21	3901	3266	3078	3078
q22	1074	965	971	965
Total cold run time: 109909 ms
Total hot run time: 39877 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6630	6548	6624	6548
q2	326	225	239	225
q3	2894	2846	2962	2846
q4	2028	1839	1791	1791
q5	5707	5693	5670	5670
q6	208	130	129	129
q7	2249	1774	1734	1734
q8	3339	3500	3529	3500
q9	8938	8859	8856	8856
q10	3546	3569	3532	3532
q11	590	502	473	473
q12	824	606	601	601
q13	10529	3167	3149	3149
q14	311	275	259	259
q15	498	472	463	463
q16	471	435	430	430
q17	1863	1618	1604	1604
q18	8142	7699	7723	7699
q19	1675	1522	1626	1522
q20	2125	1874	1867	1867
q21	5195	4987	5098	4987
q22	1182	1035	1060	1035
Total cold run time: 69270 ms
Total hot run time: 58920 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189665 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9371d86cce8514c029ab266f8c709043b371cfa9, data reload: false

query1	959	369	370	369
query2	6557	1981	1963	1963
query3	6701	219	225	219
query4	34244	23861	23423	23423
query5	4331	465	454	454
query6	285	186	181	181
query7	4627	306	309	306
query8	288	228	230	228
query9	9509	2554	2554	2554
query10	487	263	257	257
query11	18177	15218	15317	15218
query12	152	102	105	102
query13	1654	414	395	395
query14	9012	6459	7081	6459
query15	240	171	198	171
query16	8073	432	472	432
query17	1618	584	551	551
query18	2124	312	316	312
query19	220	163	184	163
query20	118	107	107	107
query21	206	105	104	104
query22	4406	4228	4043	4043
query23	34901	33437	33600	33437
query24	11285	2873	2875	2873
query25	594	424	413	413
query26	983	170	167	167
query27	2935	350	351	350
query28	7809	2075	2092	2075
query29	697	440	443	440
query30	316	171	157	157
query31	1008	801	772	772
query32	98	59	64	59
query33	817	315	306	306
query34	931	496	518	496
query35	864	704	738	704
query36	1112	923	933	923
query37	114	68	73	68
query38	3982	3799	3801	3799
query39	1492	1404	1432	1404
query40	286	102	105	102
query41	52	53	51	51
query42	115	111	100	100
query43	529	480	491	480
query44	1270	794	784	784
query45	183	171	174	171
query46	1153	714	705	705
query47	1915	1840	1827	1827
query48	436	336	355	336
query49	1224	422	424	422
query50	827	418	429	418
query51	7354	7176	7103	7103
query52	106	99	97	97
query53	257	185	184	184
query54	1255	493	482	482
query55	84	86	86	86
query56	291	254	267	254
query57	1262	1152	1157	1152
query58	249	215	224	215
query59	3151	2962	3033	2962
query60	297	288	260	260
query61	140	140	139	139
query62	871	663	667	663
query63	218	181	192	181
query64	5357	663	640	640
query65	3261	3163	3191	3163
query66	1286	332	305	305
query67	16001	15595	15590	15590
query68	4596	565	563	563
query69	444	278	261	261
query70	1180	1076	1141	1076
query71	418	259	246	246
query72	6195	4284	4065	4065
query73	762	350	361	350
query74	10703	9179	9001	9001
query75	3389	2606	2585	2585
query76	2979	1009	1175	1009
query77	434	264	314	264
query78	10453	9611	9582	9582
query79	1714	589	585	585
query80	1138	429	414	414
query81	526	220	220	220
query82	932	88	89	88
query83	220	146	154	146
query84	238	79	78	78
query85	1355	312	301	301
query86	431	304	305	304
query87	4347	4193	4208	4193
query88	3586	2389	2376	2376
query89	399	300	287	287
query90	1991	187	185	185
query91	140	110	113	110
query92	69	53	50	50
query93	1734	551	543	543
query94	939	294	295	294
query95	365	261	262	261
query96	615	282	284	282
query97	3294	3140	3168	3140
query98	217	198	193	193
query99	1531	1287	1309	1287
Total cold run time: 300690 ms
Total hot run time: 189665 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.28 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9371d86cce8514c029ab266f8c709043b371cfa9, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.06	0.06
query4	1.62	0.10	0.10
query5	0.53	0.51	0.51
query6	1.14	0.74	0.73
query7	0.02	0.02	0.01
query8	0.04	0.03	0.04
query9	0.56	0.50	0.50
query10	0.55	0.57	0.54
query11	0.15	0.10	0.11
query12	0.14	0.11	0.11
query13	0.60	0.59	0.60
query14	0.77	0.78	0.80
query15	0.85	0.82	0.83
query16	0.38	0.37	0.39
query17	0.97	0.96	1.02
query18	0.25	0.21	0.23
query19	1.90	1.81	1.82
query20	0.01	0.01	0.01
query21	15.40	0.60	0.58
query22	2.29	2.48	1.48
query23	16.99	0.91	0.84
query24	3.44	0.57	0.72
query25	0.20	0.06	0.04
query26	0.50	0.13	0.13
query27	0.04	0.06	0.05
query28	10.92	0.50	0.53
query29	12.56	3.23	3.24
query30	0.24	0.06	0.07
query31	2.86	0.38	0.36
query32	3.26	0.47	0.45
query33	2.99	2.99	3.03
query34	16.87	4.50	4.47
query35	4.49	4.45	4.48
query36	0.65	0.48	0.47
query37	0.08	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.18	0.13	0.14
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 104.99 s
Total hot run time: 29.28 s

@morrySnow morrySnow merged commit 171c067 into branch-3.1 Jun 20, 2025
24 of 25 checks passed
@morrySnow morrySnow deleted the 3.1_lazy_topn branch June 20, 2025 15:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants