Skip to content

Conversation

@yujun777
Copy link
Contributor

@yujun777 yujun777 commented Feb 19, 2025

What problem does this PR solve?

When parse SQL random(1, 10) between 2 and 8, it will rewrite as random(1, 10) >= 2 and random(1, 10) <= 8. But at the rewritten moment, the random is still an unbound function, and it can't be known that it's a non-foldable function. Then it will bound it to RANDOM function, but since it contains two unbound random functions, so it will got two distinct bounded RANDOM function, and the expression will evaluate random two times. It's wrong, so at the parse phase, BETWEEN shold not rewrite to AND. Only after had bounded functions, can rewrite BETWEEN to AND.

So we need to add between predicate back. Just revert #23421.

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yujun777
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31554 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9588b9a9b42daee915e2edc00d8a7a675e34e762, data reload: false

------ Round 1 ----------------------------------
q1	17589	5436	5145	5145
q2	2052	296	162	162
q3	10429	1245	749	749
q4	10215	997	547	547
q5	7551	2452	2259	2259
q6	200	170	134	134
q7	911	764	618	618
q8	9311	1314	1223	1223
q9	4795	4555	4684	4555
q10	6833	2314	1886	1886
q11	459	275	261	261
q12	351	370	230	230
q13	17769	3713	3095	3095
q14	232	227	204	204
q15	492	470	456	456
q16	620	619	584	584
q17	588	872	342	342
q18	6505	6096	6065	6065
q19	1207	949	561	561
q20	315	350	197	197
q21	2850	2139	1972	1972
q22	359	327	309	309
Total cold run time: 101633 ms
Total hot run time: 31554 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5213	5229	5379	5229
q2	239	330	234	234
q3	2139	2685	2342	2342
q4	1458	1858	1359	1359
q5	4236	4147	4171	4147
q6	216	166	126	126
q7	1862	1815	1656	1656
q8	2612	2593	2612	2593
q9	7229	7162	7088	7088
q10	3010	3202	2779	2779
q11	577	530	496	496
q12	700	768	603	603
q13	3604	3853	3346	3346
q14	283	305	281	281
q15	509	484	463	463
q16	630	696	645	645
q17	1165	1546	1416	1416
q18	7500	7442	7362	7362
q19	853	965	1113	965
q20	1984	2025	1883	1883
q21	5485	5039	4687	4687
q22	613	573	524	524
Total cold run time: 52117 ms
Total hot run time: 50224 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189840 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9588b9a9b42daee915e2edc00d8a7a675e34e762, data reload: false

query1	1295	959	947	947
query2	6216	1835	1821	1821
query3	10987	4392	4237	4237
query4	56010	24253	23349	23349
query5	5143	585	519	519
query6	369	210	187	187
query7	5130	516	298	298
query8	320	250	249	249
query9	6023	2557	2578	2557
query10	418	297	247	247
query11	15243	15082	14897	14897
query12	158	105	103	103
query13	1120	536	374	374
query14	10274	6674	6358	6358
query15	187	202	171	171
query16	7010	684	468	468
query17	1062	722	538	538
query18	1501	392	301	301
query19	195	193	174	174
query20	130	128	161	128
query21	211	124	115	115
query22	4489	4439	4275	4275
query23	33910	33125	33319	33125
query24	5661	2496	2454	2454
query25	480	468	402	402
query26	637	287	166	166
query27	1663	486	346	346
query28	3010	2480	2468	2468
query29	606	622	449	449
query30	210	196	157	157
query31	943	870	794	794
query32	75	72	68	68
query33	459	392	344	344
query34	783	881	538	538
query35	824	839	768	768
query36	968	970	877	877
query37	136	102	77	77
query38	4319	4307	4321	4307
query39	1495	1451	1458	1451
query40	208	122	111	111
query41	64	57	54	54
query42	126	107	113	107
query43	518	514	478	478
query44	1362	834	815	815
query45	181	175	171	171
query46	936	1112	684	684
query47	1818	1888	1800	1800
query48	399	450	319	319
query49	701	503	402	402
query50	757	771	428	428
query51	4247	4335	4226	4226
query52	109	109	102	102
query53	232	271	201	201
query54	493	508	424	424
query55	87	82	81	81
query56	268	315	246	246
query57	1154	1172	1134	1134
query58	256	239	236	236
query59	2822	2795	2597	2597
query60	300	277	282	277
query61	123	115	116	115
query62	762	733	688	688
query63	242	198	201	198
query64	1403	1056	693	693
query65	3395	3252	3138	3138
query66	762	400	333	333
query67	15824	15504	15375	15375
query68	6090	813	517	517
query69	550	298	269	269
query70	1208	1137	1131	1131
query71	455	291	269	269
query72	5356	3589	3726	3589
query73	1090	795	363	363
query74	9180	9169	9051	9051
query75	3217	3136	2687	2687
query76	3971	1173	744	744
query77	548	398	280	280
query78	10210	10351	9357	9357
query79	1880	892	615	615
query80	846	541	441	441
query81	531	281	241	241
query82	401	130	96	96
query83	194	174	152	152
query84	298	97	72	72
query85	754	361	297	297
query86	421	299	282	282
query87	4448	4393	4357	4357
query88	3012	2235	2204	2204
query89	407	319	285	285
query90	1711	194	195	194
query91	138	137	109	109
query92	76	64	62	62
query93	2465	1032	578	578
query94	713	421	292	292
query95	346	270	260	260
query96	499	559	275	275
query97	2804	2830	2742	2742
query98	243	207	205	205
query99	1303	1394	1287	1287
Total cold run time: 294584 ms
Total hot run time: 189840 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.14 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9588b9a9b42daee915e2edc00d8a7a675e34e762, data reload: false

query1	0.03	0.03	0.03
query2	0.09	0.03	0.04
query3	0.24	0.06	0.07
query4	1.61	0.10	0.10
query5	0.40	0.40	0.40
query6	1.16	0.66	0.67
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.60	0.54	0.53
query10	0.57	0.60	0.57
query11	0.15	0.11	0.11
query12	0.13	0.11	0.11
query13	0.61	0.59	0.61
query14	2.67	2.71	2.70
query15	0.91	0.86	0.86
query16	0.36	0.38	0.37
query17	1.01	1.01	1.03
query18	0.21	0.20	0.19
query19	1.90	1.77	1.98
query20	0.01	0.02	0.02
query21	15.36	0.90	0.53
query22	0.76	1.30	0.80
query23	14.74	1.38	0.63
query24	11.92	1.17	0.42
query25	0.34	0.09	0.18
query26	0.97	0.18	0.14
query27	0.06	0.05	0.05
query28	6.13	0.75	0.43
query29	12.51	3.93	3.27
query30	0.24	0.08	0.06
query31	2.83	0.56	0.38
query32	3.22	0.54	0.46
query33	3.14	2.99	2.94
query34	15.63	5.17	4.49
query35	4.53	4.51	4.54
query36	0.65	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.18	0.14	0.12
query41	0.09	0.03	0.02
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.26 s
Total hot run time: 30.14 s

@yujun777
Copy link
Contributor Author

run buildall

@yujun777 yujun777 force-pushed the add-back-between-predicate branch from 097e500 to e0e2ddd Compare February 24, 2025 01:24
@yujun777
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31365 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e0e2ddd5fd5051ead83464c6d24de5ac99c27153, data reload: false

------ Round 1 ----------------------------------
q1	16662	5334	5168	5168
q2	2050	304	173	173
q3	10486	1342	720	720
q4	10418	986	519	519
q5	7491	2439	2273	2273
q6	202	175	139	139
q7	917	749	634	634
q8	9306	1313	1150	1150
q9	4835	4629	4589	4589
q10	6801	2330	1880	1880
q11	466	280	253	253
q12	353	364	218	218
q13	17787	3649	3058	3058
q14	239	231	211	211
q15	504	448	456	448
q16	614	618	577	577
q17	585	868	342	342
q18	6439	6100	6204	6100
q19	874	946	548	548
q20	317	330	193	193
q21	2715	2106	1862	1862
q22	355	327	310	310
Total cold run time: 100416 ms
Total hot run time: 31365 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5127	5165	5145	5145
q2	241	331	240	240
q3	2165	2678	2305	2305
q4	1391	1814	1363	1363
q5	4228	4111	4122	4111
q6	228	162	125	125
q7	1876	1813	1666	1666
q8	2504	2496	2439	2439
q9	6810	6721	6704	6704
q10	2879	3062	2647	2647
q11	575	498	474	474
q12	655	755	566	566
q13	3254	3667	3093	3093
q14	274	285	275	275
q15	503	470	470	470
q16	629	645	607	607
q17	1100	1588	1290	1290
q18	7171	6932	6875	6875
q19	757	781	921	781
q20	1886	1944	1815	1815
q21	5096	4776	4701	4701
q22	612	557	535	535
Total cold run time: 49961 ms
Total hot run time: 48227 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183203 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e0e2ddd5fd5051ead83464c6d24de5ac99c27153, data reload: false

query1	978	402	362	362
query2	6527	1898	1906	1898
query3	6786	210	210	210
query4	25912	23613	22899	22899
query5	5085	674	487	487
query6	297	199	175	175
query7	4600	496	293	293
query8	286	244	229	229
query9	8617	2572	2576	2572
query10	475	309	265	265
query11	15795	14981	14794	14794
query12	172	106	107	106
query13	1668	516	401	401
query14	11542	6313	6440	6313
query15	238	198	173	173
query16	7723	604	486	486
query17	1512	715	535	535
query18	1982	390	298	298
query19	256	200	155	155
query20	123	117	120	117
query21	210	124	100	100
query22	4536	4314	4497	4314
query23	33687	33009	32914	32914
query24	6913	2353	2376	2353
query25	477	449	378	378
query26	1205	274	153	153
query27	2154	488	339	339
query28	3977	2413	2390	2390
query29	694	540	432	432
query30	221	184	162	162
query31	938	817	740	740
query32	73	62	77	62
query33	557	352	297	297
query34	748	831	503	503
query35	790	815	745	745
query36	928	967	890	890
query37	123	98	72	72
query38	4249	4181	4092	4092
query39	1451	1417	1398	1398
query40	202	118	104	104
query41	54	50	51	50
query42	122	104	103	103
query43	502	513	474	474
query44	1277	777	780	777
query45	176	175	160	160
query46	851	1039	645	645
query47	1780	1804	1708	1708
query48	402	413	300	300
query49	807	516	427	427
query50	691	743	425	425
query51	4163	4199	4122	4122
query52	108	107	97	97
query53	227	253	190	190
query54	502	527	410	410
query55	119	78	79	78
query56	253	260	257	257
query57	1116	1160	1063	1063
query58	243	240	251	240
query59	2647	2673	2598	2598
query60	288	271	255	255
query61	148	123	158	123
query62	793	739	672	672
query63	233	187	190	187
query64	4205	980	652	652
query65	3239	3164	3161	3161
query66	1066	396	300	300
query67	15807	15615	15376	15376
query68	7818	755	509	509
query69	460	301	266	266
query70	1157	1129	1045	1045
query71	420	298	268	268
query72	5738	3583	3735	3583
query73	697	749	358	358
query74	9210	9192	9005	9005
query75	3174	3168	2683	2683
query76	3277	1173	732	732
query77	543	369	289	289
query78	9830	9869	9362	9362
query79	3125	824	586	586
query80	602	533	438	438
query81	492	281	234	234
query82	708	122	96	96
query83	174	170	164	164
query84	243	93	69	69
query85	801	362	296	296
query86	377	307	305	305
query87	4501	4543	4446	4446
query88	4107	2220	2210	2210
query89	413	323	296	296
query90	1976	193	196	193
query91	140	142	113	113
query92	77	60	58	58
query93	2044	1001	566	566
query94	684	423	268	268
query95	348	273	260	260
query96	493	533	276	276
query97	2831	2842	2720	2720
query98	234	215	194	194
query99	1321	1400	1259	1259
Total cold run time: 274541 ms
Total hot run time: 183203 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.21 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e0e2ddd5fd5051ead83464c6d24de5ac99c27153, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.04
query3	0.23	0.07	0.07
query4	1.61	0.10	0.10
query5	0.42	0.42	0.41
query6	1.17	0.67	0.65
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.52	0.51
query10	0.58	0.57	0.57
query11	0.15	0.11	0.11
query12	0.15	0.11	0.11
query13	0.63	0.60	0.60
query14	2.72	2.71	2.71
query15	0.92	0.86	0.85
query16	0.36	0.37	0.38
query17	1.01	1.00	1.02
query18	0.22	0.19	0.20
query19	1.90	1.79	1.96
query20	0.01	0.01	0.01
query21	15.35	0.88	0.54
query22	0.75	1.15	0.61
query23	15.04	1.36	0.60
query24	7.25	1.55	0.56
query25	0.47	0.24	0.13
query26	0.71	0.15	0.14
query27	0.06	0.05	0.05
query28	9.16	0.86	0.41
query29	12.54	3.94	3.30
query30	0.25	0.08	0.05
query31	2.86	0.58	0.37
query32	3.22	0.55	0.48
query33	3.02	3.03	3.03
query34	15.73	5.08	4.48
query35	4.50	4.50	4.56
query36	0.67	0.52	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.14	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 104.9 s
Total hot run time: 30.21 s

@yujun777 yujun777 force-pushed the add-back-between-predicate branch from e0e2ddd to cfe2326 Compare February 26, 2025 09:00
@yujun777
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31733 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cfe23267a384a62455bf11dcafb3a765c22af452, data reload: false

------ Round 1 ----------------------------------
q1	17603	5245	5110	5110
q2	2054	320	171	171
q3	10389	1324	718	718
q4	10215	1034	542	542
q5	7529	2408	2360	2360
q6	187	172	133	133
q7	907	750	598	598
q8	9317	1247	1123	1123
q9	5067	4781	4675	4675
q10	6833	2328	1877	1877
q11	476	275	264	264
q12	343	359	215	215
q13	17768	3671	3116	3116
q14	229	223	207	207
q15	523	462	470	462
q16	641	600	611	600
q17	561	871	343	343
q18	7199	6221	6257	6221
q19	1209	942	536	536
q20	307	329	198	198
q21	2770	2145	1955	1955
q22	357	334	309	309
Total cold run time: 102484 ms
Total hot run time: 31733 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5138	5116	5120	5116
q2	242	333	251	251
q3	2150	2716	2294	2294
q4	1470	1873	1390	1390
q5	4229	4091	4128	4091
q6	207	164	120	120
q7	1870	1817	1679	1679
q8	2664	2543	2567	2543
q9	7327	7165	7203	7165
q10	3031	3198	2786	2786
q11	570	500	515	500
q12	676	796	619	619
q13	3527	3855	3237	3237
q14	269	289	283	283
q15	511	470	468	468
q16	640	679	642	642
q17	1148	1610	1337	1337
q18	7457	7361	7359	7359
q19	771	802	814	802
q20	1972	1976	1857	1857
q21	5397	5077	4926	4926
q22	635	590	547	547
Total cold run time: 51901 ms
Total hot run time: 50012 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183803 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cfe23267a384a62455bf11dcafb3a765c22af452, data reload: false

query1	976	382	369	369
query2	6537	1885	1844	1844
query3	6788	217	220	217
query4	26127	23774	22968	22968
query5	4397	665	497	497
query6	332	213	185	185
query7	4626	498	295	295
query8	296	251	238	238
query9	8637	2603	2611	2603
query10	494	317	252	252
query11	15513	15443	14916	14916
query12	174	102	104	102
query13	1642	501	384	384
query14	11383	6192	6121	6121
query15	229	191	171	171
query16	7691	633	443	443
query17	1566	722	536	536
query18	1982	391	289	289
query19	225	179	149	149
query20	121	118	108	108
query21	203	122	112	112
query22	4214	4344	3951	3951
query23	33866	33021	33037	33021
query24	7008	2374	2396	2374
query25	519	456	391	391
query26	1212	271	157	157
query27	2444	477	327	327
query28	4295	2459	2433	2433
query29	699	549	418	418
query30	231	182	153	153
query31	953	859	782	782
query32	74	64	63	63
query33	560	367	304	304
query34	787	848	501	501
query35	790	818	746	746
query36	943	1011	885	885
query37	117	98	72	72
query38	4123	4104	3968	3968
query39	1474	1395	1397	1395
query40	213	123	105	105
query41	66	58	61	58
query42	126	106	104	104
query43	488	512	468	468
query44	1277	786	787	786
query45	176	173	165	165
query46	887	1039	652	652
query47	1767	1781	1725	1725
query48	389	422	328	328
query49	818	515	465	465
query50	695	748	409	409
query51	4185	4180	4068	4068
query52	116	113	93	93
query53	245	257	188	188
query54	505	493	418	418
query55	87	84	83	83
query56	281	270	278	270
query57	1128	1147	1110	1110
query58	254	235	236	235
query59	2643	2746	2787	2746
query60	282	267	255	255
query61	122	119	116	116
query62	811	716	658	658
query63	231	184	189	184
query64	4243	986	654	654
query65	3214	3151	3154	3151
query66	1057	481	300	300
query67	15857	15540	15369	15369
query68	8450	874	503	503
query69	460	302	262	262
query70	1211	1129	1121	1121
query71	470	298	267	267
query72	5257	3593	3753	3593
query73	805	739	360	360
query74	9225	9036	9171	9036
query75	3934	3205	2674	2674
query76	3704	1177	737	737
query77	800	373	284	284
query78	9997	10043	9305	9305
query79	3220	831	575	575
query80	696	541	449	449
query81	515	278	247	247
query82	666	125	101	101
query83	205	170	155	155
query84	296	100	72	72
query85	794	363	306	306
query86	380	292	295	292
query87	4466	4627	4433	4433
query88	3624	2223	2224	2223
query89	401	321	279	279
query90	1913	198	195	195
query91	142	137	116	116
query92	80	67	57	57
query93	1924	1053	578	578
query94	658	389	294	294
query95	354	270	266	266
query96	489	550	274	274
query97	3387	3441	3350	3350
query98	226	199	204	199
query99	1445	1411	1297	1297
Total cold run time: 276605 ms
Total hot run time: 183803 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.91 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cfe23267a384a62455bf11dcafb3a765c22af452, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.03	0.03
query3	0.23	0.07	0.06
query4	1.62	0.10	0.10
query5	0.57	0.55	0.53
query6	1.20	0.70	0.71
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.56	0.53
query10	0.57	0.57	0.56
query11	0.15	0.10	0.11
query12	0.15	0.12	0.11
query13	0.60	0.60	0.60
query14	2.80	2.81	2.73
query15	0.92	0.84	0.84
query16	0.39	0.38	0.36
query17	0.98	1.05	1.02
query18	0.21	0.19	0.19
query19	1.93	1.76	2.00
query20	0.02	0.01	0.02
query21	15.36	0.93	0.54
query22	0.76	1.18	0.75
query23	14.81	1.39	0.60
query24	6.48	2.20	1.02
query25	0.49	0.20	0.10
query26	0.60	0.15	0.13
query27	0.05	0.05	0.05
query28	9.67	0.90	0.43
query29	12.75	3.94	3.21
query30	0.26	0.10	0.07
query31	2.81	0.61	0.39
query32	3.21	0.55	0.47
query33	3.01	3.01	3.13
query34	15.80	5.11	4.50
query35	4.56	4.53	4.55
query36	0.65	0.48	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.13	0.12
query41	0.09	0.03	0.03
query42	0.04	0.02	0.02
query43	0.03	0.03	0.02
Total cold run time: 104.88 s
Total hot run time: 30.91 s

@yujun777 yujun777 force-pushed the add-back-between-predicate branch from 659a933 to a6f0bd8 Compare February 28, 2025 08:43
@yujun777
Copy link
Contributor Author

run buildall

2 similar comments
@yujun777
Copy link
Contributor Author

run buildall

@yujun777
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31873 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f5beaa36c513cd6ebb0796a1e1c89baa1ba0f7c0, data reload: false

------ Round 1 ----------------------------------
q1	17578	5268	5133	5133
q2	2060	303	166	166
q3	10638	1294	702	702
q4	10255	988	523	523
q5	7900	2382	2383	2382
q6	194	167	134	134
q7	908	745	597	597
q8	9308	1290	1133	1133
q9	4973	4751	4749	4749
q10	6819	2322	1902	1902
q11	479	282	264	264
q12	342	347	219	219
q13	17805	3664	3148	3148
q14	237	239	212	212
q15	493	474	456	456
q16	633	616	575	575
q17	559	860	338	338
q18	6952	6371	6225	6225
q19	1337	946	544	544
q20	321	336	198	198
q21	2839	2124	1974	1974
q22	370	331	299	299
Total cold run time: 103000 ms
Total hot run time: 31873 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5583	5208	5154	5154
q2	243	330	237	237
q3	2192	2665	2277	2277
q4	1395	1831	1356	1356
q5	4297	4079	4137	4079
q6	203	163	125	125
q7	1883	1872	1767	1767
q8	2599	2658	2580	2580
q9	7350	7193	7301	7193
q10	3053	3222	2696	2696
q11	560	511	481	481
q12	683	778	635	635
q13	3587	3898	3282	3282
q14	279	299	277	277
q15	525	486	455	455
q16	639	705	649	649
q17	1143	1622	1314	1314
q18	7754	7462	7366	7366
q19	810	892	1023	892
q20	2002	2021	1883	1883
q21	5587	4796	4896	4796
q22	643	587	559	559
Total cold run time: 53010 ms
Total hot run time: 50053 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190594 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f5beaa36c513cd6ebb0796a1e1c89baa1ba0f7c0, data reload: false

query1	1317	930	946	930
query2	6118	1851	1896	1851
query3	11156	4704	4515	4515
query4	25840	23568	22989	22989
query5	4228	690	524	524
query6	298	193	189	189
query7	4000	497	297	297
query8	282	232	231	231
query9	8468	2607	2589	2589
query10	439	313	244	244
query11	15875	15142	14844	14844
query12	177	108	108	108
query13	1555	512	369	369
query14	10347	6648	6802	6648
query15	215	196	186	186
query16	7610	671	501	501
query17	1151	730	561	561
query18	1976	405	318	318
query19	191	179	153	153
query20	124	130	122	122
query21	205	130	106	106
query22	4637	4623	4376	4376
query23	34456	33621	33630	33621
query24	7794	2416	2423	2416
query25	525	451	385	385
query26	1285	274	157	157
query27	2156	508	333	333
query28	4327	2496	2445	2445
query29	684	558	443	443
query30	215	189	161	161
query31	945	864	797	797
query32	73	70	64	64
query33	536	358	325	325
query34	785	872	514	514
query35	840	895	785	785
query36	971	1048	907	907
query37	129	105	82	82
query38	4153	4281	4183	4183
query39	1486	1429	1437	1429
query40	201	117	105	105
query41	54	58	53	53
query42	123	105	107	105
query43	526	522	511	511
query44	1310	817	809	809
query45	182	182	166	166
query46	905	1043	671	671
query47	1809	1846	1787	1787
query48	395	414	310	310
query49	757	507	430	430
query50	690	759	416	416
query51	4319	4279	4292	4279
query52	112	109	94	94
query53	226	261	193	193
query54	523	537	414	414
query55	83	84	77	77
query56	282	257	260	257
query57	1169	1176	1091	1091
query58	254	245	247	245
query59	2675	2839	2826	2826
query60	302	295	284	284
query61	145	148	145	145
query62	778	739	679	679
query63	239	202	203	202
query64	4285	1100	756	756
query65	3303	3160	3164	3160
query66	939	390	289	289
query67	15968	15933	15274	15274
query68	9010	879	501	501
query69	439	295	274	274
query70	1153	1109	1111	1109
query71	447	300	257	257
query72	5558	3603	3706	3603
query73	699	714	346	346
query74	9205	9198	8693	8693
query75	3934	3194	2723	2723
query76	3376	1185	749	749
query77	768	388	282	282
query78	10063	10135	9349	9349
query79	2832	828	591	591
query80	710	520	447	447
query81	507	275	249	249
query82	680	131	92	92
query83	204	166	149	149
query84	279	91	73	73
query85	773	346	315	315
query86	341	394	276	276
query87	4410	4649	4269	4269
query88	2831	2249	2202	2202
query89	449	328	294	294
query90	1926	194	186	186
query91	147	137	110	110
query92	72	60	55	55
query93	2106	1070	573	573
query94	658	428	306	306
query95	363	265	247	247
query96	480	559	268	268
query97	3342	3418	3236	3236
query98	228	206	202	202
query99	1451	1400	1242	1242
Total cold run time: 279564 ms
Total hot run time: 190594 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.3 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f5beaa36c513cd6ebb0796a1e1c89baa1ba0f7c0, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.61	0.10	0.11
query5	0.54	0.56	0.55
query6	1.18	0.71	0.72
query7	0.02	0.01	0.02
query8	0.04	0.03	0.04
query9	0.58	0.53	0.53
query10	0.57	0.57	0.57
query11	0.15	0.10	0.10
query12	0.15	0.12	0.11
query13	0.62	0.60	0.60
query14	2.81	2.84	2.82
query15	0.92	0.84	0.84
query16	0.38	0.38	0.39
query17	1.04	1.04	1.06
query18	0.21	0.20	0.20
query19	1.91	1.89	1.96
query20	0.01	0.01	0.01
query21	15.35	0.90	0.55
query22	0.77	1.31	0.86
query23	14.73	1.40	0.62
query24	7.63	1.58	0.77
query25	0.50	0.29	0.14
query26	0.65	0.16	0.13
query27	0.05	0.06	0.05
query28	9.77	0.81	0.43
query29	12.55	3.94	3.26
query30	0.25	0.09	0.06
query31	2.82	0.58	0.37
query32	3.22	0.54	0.46
query33	3.03	3.10	3.10
query34	15.85	5.12	4.52
query35	4.54	4.55	4.60
query36	0.66	0.50	0.50
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.94 s
Total hot run time: 31.3 s

@yujun777
Copy link
Contributor Author

yujun777 commented Mar 2, 2025

run p0

@yujun777
Copy link
Contributor Author

yujun777 commented Mar 2, 2025

run cloud_p0

@yujun777
Copy link
Contributor Author

yujun777 commented Mar 3, 2025

run buildall

@yujun777 yujun777 force-pushed the add-back-between-predicate branch from fd3d269 to ee0951b Compare March 3, 2025 03:13
@yujun777
Copy link
Contributor Author

yujun777 commented Mar 3, 2025

run buildall

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 3, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Mar 3, 2025

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 3, 2025

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 31389 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ee0951b2d81d803030dca70207de877003aedd71, data reload: false

------ Round 1 ----------------------------------
q1	17577	5811	5095	5095
q2	2047	292	160	160
q3	10429	1229	743	743
q4	10217	997	511	511
q5	7534	2313	2377	2313
q6	190	177	133	133
q7	903	754	601	601
q8	9328	1281	1044	1044
q9	4854	4869	4640	4640
q10	6828	2340	1866	1866
q11	466	285	272	272
q12	340	347	219	219
q13	17766	3663	3081	3081
q14	226	229	209	209
q15	508	462	452	452
q16	623	608	596	596
q17	576	861	334	334
q18	6978	6172	6331	6172
q19	1220	936	542	542
q20	328	329	196	196
q21	2765	2143	1908	1908
q22	363	322	302	302
Total cold run time: 102066 ms
Total hot run time: 31389 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5115	5224	5134	5134
q2	235	330	230	230
q3	2190	2692	2315	2315
q4	1439	1831	1397	1397
q5	4198	4205	4146	4146
q6	208	163	126	126
q7	1920	1845	1710	1710
q8	2633	2638	2619	2619
q9	7394	7204	7151	7151
q10	3021	3237	2811	2811
q11	564	541	490	490
q12	693	801	604	604
q13	3427	3975	3279	3279
q14	290	295	270	270
q15	517	463	448	448
q16	646	680	645	645
q17	1154	1548	1346	1346
q18	7566	7406	7433	7406
q19	845	844	828	828
q20	1945	2000	1979	1979
q21	5427	5068	4677	4677
q22	619	581	549	549
Total cold run time: 52046 ms
Total hot run time: 50160 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189821 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ee0951b2d81d803030dca70207de877003aedd71, data reload: false

query1	1304	925	961	925
query2	6231	1893	1840	1840
query3	11075	4833	4610	4610
query4	53942	25516	22981	22981
query5	5229	541	481	481
query6	377	189	194	189
query7	5196	503	296	296
query8	323	265	223	223
query9	6735	2546	2553	2546
query10	428	333	239	239
query11	15120	15110	14791	14791
query12	156	108	105	105
query13	1191	502	382	382
query14	10784	6152	6961	6152
query15	192	205	193	193
query16	7003	693	509	509
query17	1092	735	595	595
query18	1548	420	329	329
query19	203	206	174	174
query20	137	130	122	122
query21	221	126	107	107
query22	4445	4560	4455	4455
query23	33807	33488	33456	33456
query24	6061	2390	2443	2390
query25	458	456	379	379
query26	805	269	155	155
query27	1844	517	355	355
query28	2803	2455	2449	2449
query29	583	544	440	440
query30	216	193	154	154
query31	874	875	817	817
query32	69	58	57	57
query33	467	355	287	287
query34	776	882	496	496
query35	823	830	750	750
query36	926	996	887	887
query37	122	101	79	79
query38	4239	4324	4234	4234
query39	1484	1453	1458	1453
query40	216	119	100	100
query41	50	48	52	48
query42	127	128	104	104
query43	473	526	482	482
query44	1327	832	832	832
query45	173	172	167	167
query46	897	1060	664	664
query47	1853	1865	1793	1793
query48	385	417	305	305
query49	712	543	416	416
query50	705	757	423	423
query51	4268	4232	4235	4232
query52	114	114	102	102
query53	238	262	191	191
query54	494	496	426	426
query55	81	80	76	76
query56	272	267	264	264
query57	1173	1165	1131	1131
query58	237	247	257	247
query59	2835	2896	2808	2808
query60	291	279	264	264
query61	119	116	112	112
query62	736	734	685	685
query63	234	201	193	193
query64	2085	1027	710	710
query65	3355	3197	3124	3124
query66	793	389	295	295
query67	15810	15452	15223	15223
query68	6966	882	496	496
query69	537	300	266	266
query70	1195	1103	1076	1076
query71	501	309	268	268
query72	5989	3638	3734	3638
query73	1256	768	345	345
query74	9425	9113	8662	8662
query75	3764	3157	2679	2679
query76	4292	1172	739	739
query77	613	362	288	288
query78	9852	10253	9320	9320
query79	3328	826	579	579
query80	696	526	441	441
query81	512	288	238	238
query82	656	120	94	94
query83	288	216	161	161
query84	287	86	69	69
query85	776	352	296	296
query86	340	295	289	289
query87	4420	4466	4354	4354
query88	2898	2215	2199	2199
query89	415	316	283	283
query90	1970	193	192	192
query91	137	135	107	107
query92	71	59	52	52
query93	1920	1048	563	563
query94	685	420	298	298
query95	336	265	258	258
query96	484	572	270	270
query97	3377	3410	3316	3316
query98	236	195	200	195
query99	1433	1378	1291	1291
Total cold run time: 298997 ms
Total hot run time: 189821 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.66 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ee0951b2d81d803030dca70207de877003aedd71, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.03
query3	0.23	0.07	0.07
query4	1.65	0.10	0.10
query5	0.55	0.55	0.55
query6	1.19	0.72	0.72
query7	0.03	0.02	0.02
query8	0.04	0.02	0.03
query9	0.59	0.53	0.52
query10	0.57	0.57	0.57
query11	0.16	0.11	0.10
query12	0.14	0.11	0.12
query13	0.62	0.60	0.59
query14	2.83	2.82	2.85
query15	0.91	0.86	0.85
query16	0.38	0.38	0.38
query17	1.05	1.02	1.05
query18	0.21	0.19	0.19
query19	1.91	1.87	1.96
query20	0.02	0.01	0.01
query21	15.37	0.91	0.56
query22	0.76	1.16	0.66
query23	15.02	1.37	0.65
query24	6.57	1.38	1.52
query25	0.56	0.27	0.09
query26	0.53	0.15	0.14
query27	0.05	0.05	0.05
query28	10.08	0.80	0.43
query29	12.56	3.91	3.30
query30	0.25	0.09	0.06
query31	2.82	0.60	0.38
query32	3.23	0.55	0.46
query33	2.97	3.01	3.04
query34	15.82	5.19	4.56
query35	4.61	4.56	4.57
query36	0.66	0.49	0.47
query37	0.09	0.07	0.07
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.16	0.14	0.12
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.54 s
Total hot run time: 31.66 s

@yujun777
Copy link
Contributor Author

yujun777 commented Mar 3, 2025

run p0

1 similar comment
@yujun777
Copy link
Contributor Author

yujun777 commented Mar 3, 2025

run p0

@yujun777 yujun777 marked this pull request as draft March 11, 2025 02:20
@yujun777
Copy link
Contributor Author

cod too old, use a new pr: #55407

@yujun777 yujun777 closed this Aug 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants