Skip to content

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Feb 7, 2025

Cherry-picked from #47473

evict in advance if current cache size is over threshold to avoid sync
evict during query, which may affect query performance.
@github-actions github-actions bot requested a review from dataroaring as a code owner February 7, 2025 14:58
@Thearas
Copy link
Contributor

Thearas commented Feb 7, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring closed this Feb 7, 2025
@dataroaring dataroaring reopened this Feb 7, 2025
@Thearas
Copy link
Contributor

Thearas commented Feb 7, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41032 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 10f21ae27eb3411ba0e1f0e2ffd286517ec63ffe, data reload: false

------ Round 1 ----------------------------------
q1	17583	7431	7231	7231
q2	2087	180	175	175
q3	10616	1062	1163	1062
q4	10291	744	720	720
q5	7742	2879	2880	2879
q6	238	151	148	148
q7	1002	614	615	614
q8	9351	1955	2026	1955
q9	6605	6404	6434	6404
q10	6988	2290	2324	2290
q11	466	261	266	261
q12	411	214	205	205
q13	17782	3022	3047	3022
q14	246	216	214	214
q15	573	510	518	510
q16	695	576	605	576
q17	981	556	551	551
q18	7401	6762	6768	6762
q19	1432	1134	1051	1051
q20	488	209	199	199
q21	4128	3210	3260	3210
q22	1085	1009	993	993
Total cold run time: 108191 ms
Total hot run time: 41032 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7216	7190	7207	7190
q2	337	232	223	223
q3	2925	2996	2963	2963
q4	2047	1870	1892	1870
q5	5716	5720	5749	5720
q6	229	143	142	142
q7	2253	1837	1859	1837
q8	3422	3560	3533	3533
q9	8770	8967	8899	8899
q10	3626	3567	3544	3544
q11	617	517	516	516
q12	789	596	632	596
q13	9907	3142	3149	3142
q14	299	276	298	276
q15	596	524	541	524
q16	695	633	648	633
q17	1863	1637	1608	1608
q18	8237	7835	7600	7600
q19	1655	1639	1571	1571
q20	2110	1913	1843	1843
q21	5483	5391	5455	5391
q22	1181	1078	1029	1029
Total cold run time: 69973 ms
Total hot run time: 60650 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 198847 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 10f21ae27eb3411ba0e1f0e2ffd286517ec63ffe, data reload: false

query1	1300	923	940	923
query2	6226	2089	2082	2082
query3	10846	4317	4356	4317
query4	66743	28724	23615	23615
query5	5035	455	466	455
query6	437	183	184	183
query7	5675	324	319	319
query8	312	230	220	220
query9	9413	2719	2704	2704
query10	478	269	252	252
query11	17509	15581	16023	15581
query12	150	101	105	101
query13	1538	437	433	433
query14	9794	7794	7332	7332
query15	218	174	186	174
query16	7061	451	488	451
query17	1082	597	600	597
query18	1932	337	325	325
query19	229	158	169	158
query20	117	109	113	109
query21	216	103	105	103
query22	4808	4431	4637	4431
query23	34582	34302	34168	34168
query24	6088	2908	2967	2908
query25	547	424	427	424
query26	658	183	180	180
query27	1887	352	371	352
query28	4289	2510	2462	2462
query29	738	493	433	433
query30	246	160	162	160
query31	990	874	833	833
query32	68	56	60	56
query33	454	276	284	276
query34	911	509	525	509
query35	867	744	745	744
query36	1093	974	951	951
query37	128	75	71	71
query38	4061	4112	4051	4051
query39	1550	1460	1487	1460
query40	214	100	101	100
query41	49	51	46	46
query42	119	98	108	98
query43	544	494	484	484
query44	1216	829	833	829
query45	188	169	164	164
query46	1178	762	732	732
query47	2052	1973	1969	1969
query48	482	367	389	367
query49	741	410	421	410
query50	850	434	419	419
query51	7351	7093	7134	7093
query52	107	87	86	86
query53	264	181	180	180
query54	573	449	453	449
query55	76	78	75	75
query56	252	249	250	249
query57	1214	1100	1107	1100
query58	220	214	213	213
query59	3143	3017	3176	3017
query60	284	259	259	259
query61	111	110	109	109
query62	853	732	717	717
query63	217	193	183	183
query64	1405	688	662	662
query65	3320	3224	3278	3224
query66	703	297	306	297
query67	16111	15844	15628	15628
query68	4125	597	594	594
query69	447	264	269	264
query70	1177	1078	1135	1078
query71	362	266	258	258
query72	6518	4088	4014	4014
query73	758	353	352	352
query74	10335	9010	9253	9010
query75	3353	2689	2675	2675
query76	2001	1043	1001	1001
query77	490	280	273	273
query78	10642	9605	9616	9605
query79	2035	615	603	603
query80	1377	441	436	436
query81	526	246	237	237
query82	1258	127	115	115
query83	165	144	143	143
query84	283	78	83	78
query85	1027	310	296	296
query86	419	288	286	286
query87	4426	4333	4296	4296
query88	3917	2400	2345	2345
query89	424	292	300	292
query90	1942	186	193	186
query91	183	149	150	149
query92	67	50	52	50
query93	2685	560	563	560
query94	877	299	294	294
query95	367	257	255	255
query96	628	285	279	279
query97	3355	3257	3158	3158
query98	224	201	204	201
query99	1780	1455	1402	1402
Total cold run time: 322286 ms
Total hot run time: 198847 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.79 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 10f21ae27eb3411ba0e1f0e2ffd286517ec63ffe, data reload: false

query1	0.03	0.02	0.03
query2	0.07	0.03	0.03
query3	0.23	0.06	0.06
query4	1.62	0.10	0.10
query5	0.54	0.50	0.53
query6	1.13	0.74	0.72
query7	0.02	0.02	0.01
query8	0.04	0.03	0.05
query9	0.56	0.50	0.50
query10	0.56	0.55	0.54
query11	0.14	0.10	0.10
query12	0.14	0.12	0.12
query13	0.62	0.60	0.60
query14	2.82	2.84	2.75
query15	0.91	0.83	0.81
query16	0.40	0.37	0.37
query17	1.10	1.05	1.04
query18	0.23	0.21	0.21
query19	1.93	1.89	2.02
query20	0.01	0.01	0.00
query21	15.36	0.59	0.59
query22	2.50	2.53	1.68
query23	17.04	0.87	0.82
query24	2.79	1.16	1.72
query25	0.14	0.13	0.06
query26	0.53	0.13	0.14
query27	0.04	0.04	0.04
query28	10.08	1.10	1.06
query29	12.56	3.19	3.22
query30	0.24	0.06	0.06
query31	2.83	0.38	0.40
query32	3.24	0.47	0.45
query33	2.97	3.03	3.03
query34	16.85	4.45	4.47
query35	4.55	4.55	4.50
query36	0.68	0.49	0.49
query37	0.09	0.06	0.06
query38	0.04	0.03	0.04
query39	0.04	0.02	0.03
query40	0.17	0.12	0.13
query41	0.08	0.02	0.03
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.99 s
Total hot run time: 32.79 s

@freemandealer
Copy link
Contributor

run p0

@gavinchou
Copy link
Contributor

skip build

@gavinchou
Copy link
Contributor

skip buildall

@hello-stephen hello-stephen merged commit 5e95141 into branch-3.0 Feb 8, 2025
21 of 22 checks passed
@hello-stephen hello-stephen deleted the auto-pick-47473-branch-3.0 branch February 8, 2025 10:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants