Skip to content

Conversation

@freemandealer
Copy link
Contributor

…rable

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@freemandealer
Copy link
Contributor Author

run buildall

@freemandealer freemandealer marked this pull request as ready for review April 8, 2025 02:08
…rable

Signed-off-by: zhengyu <zhangzhengyu@selectdb.com>
@freemandealer freemandealer force-pushed the configurable-interval branch from 3fc9621 to 4b50fd2 Compare April 8, 2025 02:21
@freemandealer
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34295 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4b50fd26d95e5887ca984a22e7384eb988039a9c, data reload: false

------ Round 1 ----------------------------------
q1	26087	5080	5080	5080
q2	2062	280	191	191
q3	10380	1247	698	698
q4	10228	1028	519	519
q5	7558	2445	2354	2354
q6	186	168	136	136
q7	925	768	609	609
q8	9330	1318	1117	1117
q9	6820	5194	5219	5194
q10	6868	2347	1884	1884
q11	468	282	263	263
q12	363	363	218	218
q13	17772	3693	3084	3084
q14	240	236	208	208
q15	542	488	469	469
q16	639	617	578	578
q17	591	878	365	365
q18	7975	7302	7138	7138
q19	1629	982	561	561
q20	327	342	221	221
q21	3870	2644	2426	2426
q22	1070	1048	982	982
Total cold run time: 115930 ms
Total hot run time: 34295 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5277	5153	5168	5153
q2	238	327	236	236
q3	2138	2652	2284	2284
q4	1475	1842	1485	1485
q5	4478	4401	4383	4383
q6	225	176	132	132
q7	1998	1933	1742	1742
q8	2628	2598	2547	2547
q9	7365	7191	7057	7057
q10	3026	3174	2745	2745
q11	584	507	483	483
q12	700	768	611	611
q13	3538	3863	3301	3301
q14	290	307	305	305
q15	533	485	495	485
q16	648	692	659	659
q17	1173	1623	1352	1352
q18	7759	7652	7596	7596
q19	817	847	914	847
q20	1987	2007	1841	1841
q21	5297	4926	4911	4911
q22	1093	1100	1051	1051
Total cold run time: 53267 ms
Total hot run time: 51206 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192599 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4b50fd26d95e5887ca984a22e7384eb988039a9c, data reload: false

query1	1381	1053	1040	1040
query2	6267	1982	1964	1964
query3	11162	4570	4732	4570
query4	25148	23613	22723	22723
query5	4203	612	455	455
query6	285	214	198	198
query7	3985	503	284	284
query8	309	248	239	239
query9	8488	2582	2581	2581
query10	502	343	261	261
query11	15372	15325	14684	14684
query12	167	111	107	107
query13	1584	517	387	387
query14	8923	6061	6116	6061
query15	229	195	171	171
query16	7339	638	487	487
query17	1193	721	573	573
query18	2157	444	336	336
query19	204	196	174	174
query20	132	125	121	121
query21	208	135	108	108
query22	4695	4775	4567	4567
query23	34324	33730	33610	33610
query24	8702	2424	2418	2418
query25	531	457	411	411
query26	1352	273	150	150
query27	2888	510	329	329
query28	4640	2434	2446	2434
query29	729	554	452	452
query30	290	227	204	204
query31	902	870	816	816
query32	77	63	63	63
query33	549	371	318	318
query34	799	902	534	534
query35	823	851	761	761
query36	968	1013	916	916
query37	124	106	77	77
query38	4258	4229	4083	4083
query39	1496	1441	1460	1441
query40	218	125	112	112
query41	57	54	52	52
query42	119	111	109	109
query43	500	533	502	502
query44	1373	826	819	819
query45	188	176	165	165
query46	844	1044	636	636
query47	1841	1865	1789	1789
query48	380	423	321	321
query49	782	499	419	419
query50	685	691	416	416
query51	4275	4237	4282	4237
query52	109	113	100	100
query53	229	272	194	194
query54	583	574	532	532
query55	90	85	86	85
query56	327	299	285	285
query57	1165	1185	1141	1141
query58	264	263	258	258
query59	2782	2916	2691	2691
query60	326	328	318	318
query61	135	130	138	130
query62	826	762	668	668
query63	233	198	197	197
query64	4157	1053	708	708
query65	4491	4350	4396	4350
query66	1008	459	311	311
query67	16721	15566	15378	15378
query68	8944	895	523	523
query69	478	301	258	258
query70	1171	1141	1108	1108
query71	460	313	291	291
query72	5565	4717	4826	4717
query73	741	664	359	359
query74	9261	9290	8840	8840
query75	4168	3204	2691	2691
query76	3742	1181	734	734
query77	784	366	275	275
query78	10218	10255	9318	9318
query79	2066	813	563	563
query80	583	506	427	427
query81	495	264	225	225
query82	482	129	98	98
query83	255	266	240	240
query84	247	109	88	88
query85	788	343	315	315
query86	387	298	275	275
query87	4433	4501	4275	4275
query88	3592	2231	2213	2213
query89	402	317	282	282
query90	1847	208	210	208
query91	143	137	111	111
query92	78	60	59	59
query93	1677	957	577	577
query94	659	410	308	308
query95	378	302	292	292
query96	483	558	274	274
query97	3168	3234	3145	3145
query98	230	209	204	204
query99	1413	1413	1275	1275
Total cold run time: 281431 ms
Total hot run time: 192599 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.62 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4b50fd26d95e5887ca984a22e7384eb988039a9c, data reload: false

query1	0.04	0.03	0.04
query2	0.12	0.11	0.10
query3	0.25	0.19	0.18
query4	1.59	0.20	0.20
query5	0.58	0.57	0.59
query6	1.18	0.72	0.71
query7	0.02	0.02	0.02
query8	0.05	0.03	0.03
query9	0.58	0.51	0.52
query10	0.61	0.57	0.57
query11	0.15	0.12	0.11
query12	0.15	0.11	0.12
query13	0.62	0.60	0.60
query14	2.74	2.82	2.73
query15	0.94	0.85	0.86
query16	0.39	0.38	0.38
query17	1.05	1.01	1.01
query18	0.22	0.20	0.21
query19	1.89	1.93	1.84
query20	0.01	0.01	0.02
query21	15.35	0.88	0.54
query22	0.76	1.14	0.59
query23	15.15	1.39	0.63
query24	6.75	1.72	0.31
query25	0.32	0.21	0.07
query26	0.49	0.18	0.14
query27	0.04	0.06	0.05
query28	9.31	0.86	0.45
query29	12.66	4.03	3.31
query30	0.25	0.09	0.06
query31	2.82	0.61	0.39
query32	3.22	0.54	0.46
query33	3.06	3.08	3.07
query34	15.70	5.18	4.49
query35	4.50	4.61	4.50
query36	0.66	0.49	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.13	0.13
query41	0.09	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 104.7 s
Total hot run time: 30.62 s

@freemandealer
Copy link
Contributor Author

run beut

Signed-off-by: zhengyu <zhangzhengyu@selectdb.com>
@freemandealer
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34225 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 50cb59440eb6185a4a722599afc96c72e753a182, data reload: false

------ Round 1 ----------------------------------
q1	26006	5134	5017	5017
q2	2069	284	193	193
q3	10508	1256	681	681
q4	10242	1020	530	530
q5	7694	2422	2337	2337
q6	195	164	134	134
q7	912	741	610	610
q8	9314	1313	1095	1095
q9	7419	5067	5110	5067
q10	6801	2312	1868	1868
q11	486	292	270	270
q12	353	354	220	220
q13	17781	3703	3111	3111
q14	223	228	206	206
q15	530	486	490	486
q16	637	606	588	588
q17	606	874	384	384
q18	7609	7342	7191	7191
q19	1479	959	553	553
q20	334	336	222	222
q21	4417	3419	2471	2471
q22	1056	1017	991	991
Total cold run time: 116671 ms
Total hot run time: 34225 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5104	5245	5101	5101
q2	242	331	223	223
q3	2190	2631	2262	2262
q4	1413	1855	1482	1482
q5	4532	4439	4371	4371
q6	211	164	124	124
q7	1981	1897	1709	1709
q8	2599	2524	2551	2524
q9	7138	7170	7180	7170
q10	2991	3176	2717	2717
q11	573	494	481	481
q12	646	768	606	606
q13	3503	3923	3335	3335
q14	281	281	270	270
q15	522	476	474	474
q16	648	690	660	660
q17	1150	1592	1366	1366
q18	7794	7558	7516	7516
q19	809	802	932	802
q20	1927	1971	1804	1804
q21	5153	4603	4763	4603
q22	1062	1043	979	979
Total cold run time: 52469 ms
Total hot run time: 50579 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186256 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 50cb59440eb6185a4a722599afc96c72e753a182, data reload: false

query1	994	499	471	471
query2	6532	1918	1960	1918
query3	6747	230	222	222
query4	26030	23464	23195	23195
query5	4383	632	482	482
query6	313	216	196	196
query7	4623	480	286	286
query8	297	251	250	250
query9	8612	2614	2586	2586
query10	478	321	277	277
query11	15519	14990	14913	14913
query12	155	113	108	108
query13	1645	512	400	400
query14	9232	6205	6117	6117
query15	234	184	166	166
query16	7174	649	501	501
query17	1183	705	571	571
query18	1957	388	299	299
query19	182	180	153	153
query20	116	114	118	114
query21	220	120	100	100
query22	4020	4208	3979	3979
query23	33914	32916	33073	32916
query24	8459	2373	2382	2373
query25	529	453	381	381
query26	1242	275	146	146
query27	2764	503	332	332
query28	4388	2398	2415	2398
query29	782	551	440	440
query30	286	217	190	190
query31	941	866	784	784
query32	77	69	65	65
query33	574	374	311	311
query34	795	859	519	519
query35	808	832	753	753
query36	968	992	920	920
query37	130	112	81	81
query38	4140	4194	4133	4133
query39	1430	1418	1408	1408
query40	210	119	103	103
query41	56	53	55	53
query42	118	106	104	104
query43	512	533	499	499
query44	1322	800	792	792
query45	178	175	167	167
query46	842	1022	627	627
query47	1738	1792	1708	1708
query48	379	411	301	301
query49	761	526	421	421
query50	632	692	389	389
query51	4249	4139	4023	4023
query52	105	106	105	105
query53	218	250	183	183
query54	580	574	507	507
query55	89	84	82	82
query56	325	312	285	285
query57	1138	1161	1067	1067
query58	263	260	249	249
query59	2720	2710	2553	2553
query60	337	321	311	311
query61	148	128	131	128
query62	808	739	672	672
query63	225	189	189	189
query64	4366	1017	678	678
query65	4372	4237	4255	4237
query66	1201	420	309	309
query67	15853	15205	15177	15177
query68	7386	871	516	516
query69	483	306	274	274
query70	1239	1130	1109	1109
query71	407	325	298	298
query72	5846	4902	4856	4856
query73	670	653	347	347
query74	8992	8882	8782	8782
query75	3174	3180	2680	2680
query76	3155	1186	763	763
query77	502	385	296	296
query78	9966	10059	9444	9444
query79	2255	801	562	562
query80	584	511	442	442
query81	486	258	227	227
query82	477	125	94	94
query83	250	253	243	243
query84	252	105	91	91
query85	770	341	308	308
query86	387	314	296	296
query87	4452	4525	4295	4295
query88	3736	2246	2237	2237
query89	396	306	281	281
query90	1865	218	220	218
query91	146	143	113	113
query92	76	60	60	60
query93	1829	925	572	572
query94	711	421	306	306
query95	359	289	286	286
query96	494	576	275	275
query97	3137	3243	3154	3154
query98	230	210	196	196
query99	1440	1420	1262	1262
Total cold run time: 272770 ms
Total hot run time: 186256 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.68 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 50cb59440eb6185a4a722599afc96c72e753a182, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.11	0.10
query3	0.25	0.20	0.19
query4	1.60	0.20	0.19
query5	0.60	0.59	0.62
query6	1.19	0.72	0.72
query7	0.02	0.02	0.02
query8	0.04	0.04	0.04
query9	0.58	0.51	0.52
query10	0.57	0.60	0.56
query11	0.15	0.11	0.11
query12	0.15	0.11	0.11
query13	0.61	0.61	0.60
query14	2.66	2.84	2.67
query15	0.91	0.85	0.83
query16	0.38	0.38	0.39
query17	1.00	1.02	1.00
query18	0.22	0.20	0.20
query19	1.89	1.90	1.82
query20	0.02	0.01	0.02
query21	15.37	0.91	0.54
query22	0.75	1.32	0.89
query23	14.70	1.42	0.64
query24	6.57	2.21	1.10
query25	0.45	0.12	0.08
query26	0.68	0.17	0.15
query27	0.05	0.05	0.05
query28	9.88	0.88	0.45
query29	12.57	4.01	3.29
query30	0.24	0.08	0.06
query31	2.83	0.60	0.39
query32	3.23	0.54	0.47
query33	3.03	3.09	3.16
query34	15.67	5.13	4.50
query35	4.55	4.53	4.51
query36	0.67	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.02	0.02	0.02
query40	0.17	0.14	0.13
query41	0.09	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.02	0.02
Total cold run time: 104.74 s
Total hot run time: 31.68 s

@freemandealer
Copy link
Contributor Author

run cloud_p0

@gavinchou gavinchou changed the title [enhancement](cloud) make file cache background task interval configu… [enhancement](cloud) make file cache background task interval configurable Apr 9, 2025
Signed-off-by: zhengyu <zhangzhengyu@selectdb.com>
@freemandealer
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33981 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b78a3d94f25801a927198f8f090b94d67772836d, data reload: false

------ Round 1 ----------------------------------
q1	26036	5060	5050	5050
q2	2063	276	177	177
q3	10413	1252	713	713
q4	10234	1023	524	524
q5	7505	2378	2367	2367
q6	187	166	130	130
q7	911	744	608	608
q8	9303	1287	1083	1083
q9	6806	5070	5060	5060
q10	6790	2297	1856	1856
q11	503	275	261	261
q12	348	355	226	226
q13	17759	3706	3083	3083
q14	218	218	205	205
q15	531	489	494	489
q16	622	628	594	594
q17	571	859	353	353
q18	7524	7151	7058	7058
q19	2274	962	548	548
q20	310	328	214	214
q21	3987	2657	2423	2423
q22	1036	995	959	959
Total cold run time: 115931 ms
Total hot run time: 33981 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5193	5122	5087	5087
q2	238	324	235	235
q3	2170	2636	2286	2286
q4	1467	1884	1381	1381
q5	4491	4372	4422	4372
q6	214	165	126	126
q7	1973	1913	1802	1802
q8	2588	2487	2551	2487
q9	7275	7144	7021	7021
q10	3014	3179	2722	2722
q11	581	511	506	506
q12	690	756	634	634
q13	3477	3878	3343	3343
q14	292	326	311	311
q15	525	475	466	466
q16	645	678	674	674
q17	1160	1527	1413	1413
q18	7799	7599	7481	7481
q19	810	800	942	800
q20	1972	1963	1868	1868
q21	5289	4934	4829	4829
q22	1107	1059	1038	1038
Total cold run time: 52970 ms
Total hot run time: 50882 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192445 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b78a3d94f25801a927198f8f090b94d67772836d, data reload: false

query1	1413	1074	1063	1063
query2	6174	1894	1898	1894
query3	11043	4638	4514	4514
query4	53671	24366	23018	23018
query5	5115	516	453	453
query6	329	205	197	197
query7	4936	509	289	289
query8	328	253	236	236
query9	5542	2608	2628	2608
query10	437	331	262	262
query11	15076	15041	14859	14859
query12	161	117	103	103
query13	1062	510	382	382
query14	10153	6395	6268	6268
query15	201	202	179	179
query16	7082	648	488	488
query17	1137	714	561	561
query18	1573	397	310	310
query19	192	201	163	163
query20	130	124	121	121
query21	214	137	111	111
query22	4474	4377	4261	4261
query23	34204	33339	33304	33304
query24	6384	2436	2424	2424
query25	467	482	417	417
query26	690	272	150	150
query27	2211	509	334	334
query28	3107	2462	2422	2422
query29	556	562	443	443
query30	271	229	194	194
query31	886	843	765	765
query32	75	62	69	62
query33	458	413	312	312
query34	784	867	540	540
query35	808	834	780	780
query36	942	1004	911	911
query37	122	100	80	80
query38	4219	4195	4118	4118
query39	1487	1442	1429	1429
query40	217	125	108	108
query41	65	57	64	57
query42	124	109	108	108
query43	486	500	498	498
query44	1300	818	851	818
query45	180	176	165	165
query46	910	1040	657	657
query47	1889	1850	1767	1767
query48	379	412	309	309
query49	686	499	437	437
query50	656	698	401	401
query51	4265	4283	4182	4182
query52	110	107	102	102
query53	228	254	187	187
query54	585	576	524	524
query55	86	82	84	82
query56	338	303	302	302
query57	1161	1206	1099	1099
query58	266	255	261	255
query59	2659	2792	2680	2680
query60	353	332	312	312
query61	132	148	153	148
query62	759	742	682	682
query63	226	191	195	191
query64	1715	1043	708	708
query65	4405	4250	4203	4203
query66	708	403	307	307
query67	15920	15522	15464	15464
query68	6148	844	524	524
query69	564	323	266	266
query70	1216	1099	1095	1095
query71	457	331	295	295
query72	5962	4794	4847	4794
query73	1324	676	352	352
query74	8907	9083	8866	8866
query75	3240	3184	2690	2690
query76	3816	1180	742	742
query77	533	381	285	285
query78	9932	10116	9322	9322
query79	2040	820	568	568
query80	578	509	454	454
query81	479	259	222	222
query82	445	125	100	100
query83	253	244	232	232
query84	295	113	88	88
query85	776	402	306	306
query86	371	287	278	278
query87	4449	4418	4335	4335
query88	3253	2195	2207	2195
query89	411	319	281	281
query90	1786	214	217	214
query91	136	142	109	109
query92	81	56	54	54
query93	1489	934	574	574
query94	711	394	300	300
query95	364	290	292	290
query96	486	563	273	273
query97	3182	3199	3087	3087
query98	232	202	205	202
query99	1438	1377	1274	1274
Total cold run time: 294276 ms
Total hot run time: 192445 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.8 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b78a3d94f25801a927198f8f090b94d67772836d, data reload: false

query1	0.04	0.04	0.02
query2	0.13	0.10	0.11
query3	0.26	0.20	0.18
query4	1.59	0.20	0.19
query5	0.59	0.57	0.58
query6	1.19	0.72	0.72
query7	0.03	0.01	0.02
query8	0.05	0.04	0.03
query9	0.57	0.53	0.50
query10	0.58	0.56	0.57
query11	0.15	0.11	0.12
query12	0.14	0.11	0.11
query13	0.62	0.59	0.60
query14	2.72	2.84	2.71
query15	0.92	0.85	0.87
query16	0.39	0.38	0.38
query17	1.01	1.04	1.02
query18	0.20	0.19	0.19
query19	1.87	1.90	1.86
query20	0.02	0.02	0.01
query21	15.37	0.92	0.54
query22	0.76	1.28	0.70
query23	14.83	1.41	0.61
query24	7.23	1.96	0.51
query25	0.47	0.17	0.10
query26	0.57	0.16	0.13
query27	0.05	0.05	0.04
query28	9.93	0.88	0.43
query29	12.54	4.06	3.32
query30	0.25	0.09	0.07
query31	2.83	0.59	0.38
query32	3.23	0.56	0.46
query33	3.04	3.05	3.03
query34	15.74	5.11	4.48
query35	4.52	4.50	4.50
query36	0.65	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.05	0.04	0.03
Total cold run time: 105.58 s
Total hot run time: 30.8 s

Signed-off-by: zhengyu <zhangzhengyu@selectdb.com>
@freemandealer
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34237 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 86255298984e06a726d4bb9698439957127f1f35, data reload: false

------ Round 1 ----------------------------------
q1	25875	5072	5026	5026
q2	2068	271	187	187
q3	10398	1253	705	705
q4	10242	1027	575	575
q5	7537	2366	2302	2302
q6	191	163	135	135
q7	911	718	618	618
q8	9308	1216	1143	1143
q9	6768	5121	5113	5113
q10	6827	2297	1908	1908
q11	459	288	266	266
q12	360	354	220	220
q13	17776	3758	3111	3111
q14	249	223	209	209
q15	527	484	491	484
q16	623	613	582	582
q17	582	860	345	345
q18	7410	7005	7169	7005
q19	1212	931	569	569
q20	339	333	225	225
q21	4292	3456	2560	2560
q22	1090	1017	949	949
Total cold run time: 115044 ms
Total hot run time: 34237 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5117	5104	5124	5104
q2	241	327	228	228
q3	2129	2656	2256	2256
q4	1418	1852	1438	1438
q5	4483	4422	4393	4393
q6	223	170	131	131
q7	2005	1954	1768	1768
q8	2634	2600	2559	2559
q9	7245	7243	6952	6952
q10	2994	3192	2759	2759
q11	578	529	505	505
q12	672	776	595	595
q13	3639	3924	3316	3316
q14	283	296	296	296
q15	530	495	489	489
q16	667	686	635	635
q17	1160	1567	1417	1417
q18	7813	7577	7367	7367
q19	831	808	832	808
q20	1997	1980	1863	1863
q21	5323	4879	4833	4833
q22	1126	1052	983	983
Total cold run time: 53108 ms
Total hot run time: 50695 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193240 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 86255298984e06a726d4bb9698439957127f1f35, data reload: false

query1	1370	1086	1056	1056
query2	6128	1914	1908	1908
query3	11016	4583	4578	4578
query4	54274	24377	23425	23425
query5	4986	552	442	442
query6	320	225	198	198
query7	4870	493	294	294
query8	311	255	237	237
query9	5440	2615	2624	2615
query10	396	321	271	271
query11	15018	15030	14856	14856
query12	157	110	103	103
query13	1031	509	386	386
query14	10160	6279	6415	6279
query15	199	198	177	177
query16	7099	625	487	487
query17	1077	726	586	586
query18	1556	398	322	322
query19	193	203	170	170
query20	129	126	117	117
query21	208	124	111	111
query22	4478	4529	4295	4295
query23	34384	33429	33539	33429
query24	6774	2460	2473	2460
query25	501	504	447	447
query26	667	287	163	163
query27	2142	519	346	346
query28	3126	2445	2450	2445
query29	616	603	467	467
query30	290	233	202	202
query31	924	884	796	796
query32	76	61	65	61
query33	451	362	317	317
query34	783	897	540	540
query35	809	845	773	773
query36	934	995	904	904
query37	122	105	81	81
query38	4177	4252	4212	4212
query39	1513	1438	1426	1426
query40	229	119	110	110
query41	54	54	51	51
query42	119	106	108	106
query43	486	517	494	494
query44	1348	827	833	827
query45	187	186	171	171
query46	864	1042	641	641
query47	1808	1867	1797	1797
query48	389	410	305	305
query49	696	524	428	428
query50	676	692	425	425
query51	4242	4326	4180	4180
query52	113	114	104	104
query53	249	275	190	190
query54	584	592	525	525
query55	83	89	90	89
query56	313	314	296	296
query57	1165	1198	1138	1138
query58	272	261	267	261
query59	2691	2734	2734	2734
query60	325	326	310	310
query61	153	128	122	122
query62	742	756	689	689
query63	244	192	196	192
query64	1481	1056	689	689
query65	4470	4247	4289	4247
query66	751	404	305	305
query67	15651	15569	15191	15191
query68	7656	891	502	502
query69	521	297	260	260
query70	1212	1103	1105	1103
query71	528	343	307	307
query72	5996	4831	4924	4831
query73	1482	680	344	344
query74	9143	9132	8702	8702
query75	3844	3174	2739	2739
query76	4296	1191	753	753
query77	637	376	285	285
query78	10153	10002	9188	9188
query79	3297	806	556	556
query80	638	511	438	438
query81	491	260	221	221
query82	486	123	95	95
query83	351	265	232	232
query84	298	105	81	81
query85	796	359	334	334
query86	372	303	294	294
query87	4472	4415	4465	4415
query88	3441	2221	2243	2221
query89	395	334	293	293
query90	1829	211	212	211
query91	153	141	110	110
query92	81	62	57	57
query93	2268	959	568	568
query94	661	412	305	305
query95	361	297	288	288
query96	486	566	271	271
query97	3126	3226	3122	3122
query98	244	223	218	218
query99	1401	1427	1297	1297
Total cold run time: 300205 ms
Total hot run time: 193240 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.33 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 86255298984e06a726d4bb9698439957127f1f35, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.10	0.11
query3	0.24	0.19	0.19
query4	1.59	0.20	0.20
query5	0.58	0.60	0.58
query6	1.21	0.72	0.71
query7	0.03	0.02	0.02
query8	0.04	0.04	0.04
query9	0.58	0.54	0.51
query10	0.58	0.58	0.57
query11	0.15	0.11	0.11
query12	0.14	0.11	0.12
query13	0.60	0.60	0.60
query14	2.66	2.68	2.72
query15	0.92	0.85	0.86
query16	0.38	0.38	0.38
query17	1.01	1.03	1.01
query18	0.21	0.20	0.19
query19	1.88	1.94	1.86
query20	0.01	0.02	0.01
query21	15.37	0.90	0.54
query22	0.78	1.28	0.66
query23	14.83	1.39	0.65
query24	6.86	1.31	1.07
query25	0.50	0.20	0.09
query26	0.58	0.16	0.14
query27	0.05	0.06	0.04
query28	10.25	0.92	0.42
query29	12.64	3.99	3.32
query30	0.25	0.10	0.07
query31	2.82	0.61	0.38
query32	3.23	0.55	0.47
query33	3.05	3.04	3.08
query34	15.78	5.14	4.45
query35	4.51	4.50	4.45
query36	0.65	0.49	0.48
query37	0.09	0.07	0.06
query38	0.05	0.03	0.03
query39	0.02	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.04	0.02
Total cold run time: 105.6 s
Total hot run time: 31.33 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 100.00% (7/7) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.46% (14102/26883)
Line Coverage 41.26% (121907/295475)
Region Coverage 40.01% (62078/155146)
Branch Coverage 34.65% (31072/89662)

@freemandealer
Copy link
Contributor Author

run cloud_p0

@freemandealer
Copy link
Contributor Author

run p0

@freemandealer
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33970 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7397b818d05c6dd63995b7687a7bf308b10c1fd2, data reload: false

------ Round 1 ----------------------------------
q1	26202	5024	5004	5004
q2	2070	282	186	186
q3	10383	1223	678	678
q4	10216	1039	523	523
q5	7539	2408	2580	2408
q6	192	164	136	136
q7	941	752	593	593
q8	9299	1285	1034	1034
q9	6740	5104	5071	5071
q10	6797	2349	1878	1878
q11	462	283	278	278
q12	346	358	217	217
q13	17766	3688	3079	3079
q14	232	221	209	209
q15	533	477	499	477
q16	640	622	582	582
q17	581	865	353	353
q18	7556	7128	7058	7058
q19	1219	934	574	574
q20	334	334	214	214
q21	4327	2594	2434	2434
q22	1071	1019	984	984
Total cold run time: 115446 ms
Total hot run time: 33970 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5088	5109	5029	5029
q2	244	320	227	227
q3	2188	2677	2279	2279
q4	1387	1798	1429	1429
q5	4558	4487	4455	4455
q6	211	165	128	128
q7	1979	1895	1738	1738
q8	2597	2654	2621	2621
q9	7075	7147	7195	7147
q10	2985	3169	2733	2733
q11	595	503	506	503
q12	716	751	597	597
q13	3527	3905	3203	3203
q14	291	306	275	275
q15	533	478	469	469
q16	670	685	656	656
q17	1179	1551	1389	1389
q18	7713	7509	7328	7328
q19	793	820	929	820
q20	2000	2028	1869	1869
q21	5249	4618	4593	4593
q22	1057	1036	988	988
Total cold run time: 52635 ms
Total hot run time: 50476 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186519 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7397b818d05c6dd63995b7687a7bf308b10c1fd2, data reload: false

query1	1019	512	524	512
query2	6536	1926	1874	1874
query3	6760	218	218	218
query4	26484	23679	23594	23594
query5	4387	605	443	443
query6	318	211	220	211
query7	4620	489	276	276
query8	311	245	244	244
query9	8642	2570	2583	2570
query10	443	323	250	250
query11	15795	15144	14839	14839
query12	164	107	99	99
query13	1642	499	385	385
query14	9360	6236	6345	6236
query15	202	192	167	167
query16	7230	639	462	462
query17	1201	717	586	586
query18	1978	421	309	309
query19	204	185	162	162
query20	130	126	120	120
query21	218	123	106	106
query22	4068	4007	4088	4007
query23	33975	33022	33023	33022
query24	8475	2381	2391	2381
query25	572	481	427	427
query26	1245	271	148	148
query27	2747	504	327	327
query28	4367	2400	2424	2400
query29	763	577	417	417
query30	287	213	199	199
query31	931	867	764	764
query32	78	61	67	61
query33	560	370	315	315
query34	790	865	510	510
query35	787	796	738	738
query36	953	995	873	873
query37	120	98	74	74
query38	4255	4218	4046	4046
query39	1443	1400	1388	1388
query40	208	118	107	107
query41	55	55	53	53
query42	117	105	104	104
query43	487	499	467	467
query44	1326	797	803	797
query45	173	172	175	172
query46	826	1020	617	617
query47	1752	1770	1693	1693
query48	370	416	299	299
query49	795	514	422	422
query50	633	688	406	406
query51	4248	4171	4074	4074
query52	108	107	97	97
query53	222	261	183	183
query54	584	569	512	512
query55	83	81	81	81
query56	312	300	283	283
query57	1119	1141	1076	1076
query58	261	257	259	257
query59	2576	2644	2532	2532
query60	319	326	296	296
query61	128	130	132	130
query62	783	737	674	674
query63	221	184	181	181
query64	4404	1004	741	741
query65	4332	4236	4248	4236
query66	1139	417	309	309
query67	15864	15909	15223	15223
query68	8475	880	516	516
query69	460	309	264	264
query70	1178	1068	1085	1068
query71	468	314	300	300
query72	5291	4743	4709	4709
query73	704	603	342	342
query74	8932	9155	8962	8962
query75	3945	3233	2694	2694
query76	3671	1178	749	749
query77	782	377	293	293
query78	9953	10192	9200	9200
query79	3524	822	560	560
query80	652	535	437	437
query81	460	267	220	220
query82	584	127	99	99
query83	279	250	240	240
query84	286	114	94	94
query85	777	353	312	312
query86	338	322	295	295
query87	4463	4509	4473	4473
query88	2881	2236	2255	2236
query89	448	326	281	281
query90	1971	220	215	215
query91	142	141	114	114
query92	74	61	55	55
query93	2165	936	571	571
query94	674	386	301	301
query95	376	293	281	281
query96	486	564	277	277
query97	3139	3274	3116	3116
query98	225	209	200	200
query99	1423	1432	1263	1263
Total cold run time: 276731 ms
Total hot run time: 186519 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.88 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7397b818d05c6dd63995b7687a7bf308b10c1fd2, data reload: false

query1	0.04	0.03	0.03
query2	0.13	0.10	0.11
query3	0.27	0.19	0.19
query4	1.60	0.20	0.19
query5	0.58	0.57	0.60
query6	1.19	0.72	0.72
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.55	0.53	0.52
query10	0.58	0.56	0.56
query11	0.16	0.10	0.10
query12	0.14	0.10	0.11
query13	0.62	0.60	0.60
query14	2.70	2.68	2.68
query15	0.94	0.84	0.87
query16	0.39	0.36	0.38
query17	1.01	1.03	1.00
query18	0.21	0.19	0.20
query19	1.88	1.82	1.96
query20	0.01	0.02	0.01
query21	15.36	0.90	0.55
query22	0.73	1.08	0.96
query23	14.71	1.42	0.64
query24	6.93	1.83	0.39
query25	0.47	0.39	0.07
query26	0.59	0.16	0.15
query27	0.05	0.05	0.05
query28	9.36	0.87	0.43
query29	12.54	4.04	3.30
query30	0.24	0.09	0.06
query31	2.82	0.60	0.38
query32	3.22	0.54	0.46
query33	2.97	3.12	3.05
query34	15.78	5.12	4.48
query35	4.50	4.53	4.48
query36	0.69	0.50	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.18	0.15	0.13
query41	0.09	0.03	0.03
query42	0.04	0.03	0.02
query43	0.03	0.04	0.03
Total cold run time: 104.52 s
Total hot run time: 30.88 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 100.00% (7/7) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.49% (14111/26883)
Line Coverage 41.29% (122009/295476)
Region Coverage 40.05% (62129/155146)
Branch Coverage 34.68% (31097/89662)

@freemandealer
Copy link
Contributor Author

run cloud_p0

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 15, 2025
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit 9ee8d95 into apache:master Apr 15, 2025
26 of 27 checks passed
seawinde pushed a commit to seawinde/doris that referenced this pull request Apr 17, 2025
dataroaring pushed a commit that referenced this pull request May 8, 2025
#50646)

…rable

pick #49832

Signed-off-by: zhengyu <zhangzhengyu@selectdb.com>
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
suxiaogang223 pushed a commit to suxiaogang223/doris that referenced this pull request Jul 15, 2025
Hastyshell pushed a commit to Hastyshell/doris that referenced this pull request Jul 21, 2025
apache#50646)

…rable

pick apache#49832

Signed-off-by: zhengyu <zhangzhengyu@selectdb.com>
Hastyshell pushed a commit to Hastyshell/doris that referenced this pull request Jul 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.6-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants