Skip to content

Conversation

@github-actions
Copy link
Contributor

Cherry-picked from #51197

monitor file cache gc, i.e. eviction caused by bad compaction, tablet
meta removal(drop table/partion or rebalance)

Signed-off-by: zhengyu <zhangzhengyu@selectdb.com>
@github-actions github-actions bot requested a review from morrySnow as a code owner June 20, 2025 04:19
@morrySnow morrySnow closed this Jun 20, 2025
@morrySnow morrySnow reopened this Jun 20, 2025
@morrySnow
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40005 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c09acb0a06d3cf1a616f9afdaef8936a0f71e9b2, data reload: false

------ Round 1 ----------------------------------
q1	17986	7562	6631	6631
q2	2090	166	163	163
q3	10704	1104	1220	1104
q4	10379	730	697	697
q5	7789	2909	2870	2870
q6	226	143	140	140
q7	966	621	617	617
q8	9370	1971	2040	1971
q9	6578	6407	6404	6404
q10	7014	2269	2288	2269
q11	461	259	261	259
q12	405	214	216	214
q13	17791	2981	3014	2981
q14	230	207	212	207
q15	498	477	469	469
q16	477	393	378	378
q17	987	542	583	542
q18	7610	6665	6591	6591
q19	1423	1067	1066	1066
q20	488	201	199	199
q21	4097	3265	3293	3265
q22	1088	992	968	968
Total cold run time: 108657 ms
Total hot run time: 40005 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6647	6529	6551	6529
q2	322	229	233	229
q3	2908	2803	2952	2803
q4	2032	1824	1784	1784
q5	5809	5784	5747	5747
q6	215	135	133	133
q7	2209	1843	1770	1770
q8	3424	3592	3569	3569
q9	8893	8896	8923	8896
q10	3581	3510	3553	3510
q11	610	509	492	492
q12	827	635	619	619
q13	8091	3140	3181	3140
q14	297	275	251	251
q15	510	465	475	465
q16	507	450	461	450
q17	1871	1668	1613	1613
q18	8325	7767	7728	7728
q19	1707	1491	1585	1491
q20	2143	1831	1812	1812
q21	5199	5014	5029	5014
q22	1121	1047	1022	1022
Total cold run time: 67248 ms
Total hot run time: 59067 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197880 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c09acb0a06d3cf1a616f9afdaef8936a0f71e9b2, data reload: false

query1	1307	920	898	898
query2	6347	2006	1923	1923
query3	10844	4344	4401	4344
query4	61253	29642	23648	23648
query5	5328	454	471	454
query6	390	182	183	182
query7	5540	330	301	301
query8	298	228	227	227
query9	8668	2601	2594	2594
query10	474	267	260	260
query11	17851	15136	16194	15136
query12	168	108	109	108
query13	1457	466	441	441
query14	10996	7557	7485	7485
query15	200	199	177	177
query16	7342	467	501	467
query17	1178	585	590	585
query18	1882	316	312	312
query19	226	175	165	165
query20	116	113	107	107
query21	208	103	111	103
query22	4688	4390	4645	4390
query23	34386	34635	34210	34210
query24	6282	2952	2988	2952
query25	536	419	433	419
query26	675	179	177	177
query27	2024	361	357	357
query28	4080	2199	2191	2191
query29	734	486	490	486
query30	239	160	154	154
query31	1003	807	832	807
query32	66	60	54	54
query33	431	295	316	295
query34	920	518	513	513
query35	847	743	746	743
query36	1101	942	957	942
query37	121	64	71	64
query38	4157	3955	3949	3949
query39	1548	1474	1457	1457
query40	201	105	98	98
query41	49	47	50	47
query42	120	106	107	106
query43	553	481	497	481
query44	1195	855	845	845
query45	189	176	177	176
query46	1175	731	733	731
query47	2008	1900	1912	1900
query48	507	386	387	386
query49	730	407	398	398
query50	844	423	431	423
query51	7494	7395	7217	7217
query52	102	95	90	90
query53	273	191	189	189
query54	588	476	461	461
query55	79	77	81	77
query56	278	250	251	250
query57	1294	1232	1206	1206
query58	228	215	225	215
query59	3318	3163	3023	3023
query60	300	262	283	262
query61	146	119	107	107
query62	759	677	671	671
query63	219	195	190	190
query64	1445	707	664	664
query65	3293	3223	3227	3223
query66	710	299	301	299
query67	15912	15513	15514	15513
query68	4167	606	592	592
query69	486	262	269	262
query70	1207	1162	1115	1115
query71	355	272	262	262
query72	6360	3860	4032	3860
query73	748	349	345	345
query74	10243	9153	9397	9153
query75	3362	2698	2678	2678
query76	2010	1045	1072	1045
query77	505	291	269	269
query78	10642	9523	9575	9523
query79	1677	627	618	618
query80	877	438	428	428
query81	495	226	224	224
query82	1292	91	86	86
query83	246	140	150	140
query84	285	81	80	80
query85	887	314	301	301
query86	335	288	299	288
query87	4367	4276	4251	4251
query88	3803	2416	2363	2363
query89	423	294	288	288
query90	1989	189	188	188
query91	185	152	151	151
query92	65	50	52	50
query93	1963	562	568	562
query94	734	296	294	294
query95	353	258	259	258
query96	623	285	285	285
query97	3305	3144	3137	3137
query98	216	204	202	202
query99	1569	1363	1257	1257
Total cold run time: 315694 ms
Total hot run time: 197880 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.7 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c09acb0a06d3cf1a616f9afdaef8936a0f71e9b2, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.02
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.54	0.52	0.53
query6	1.13	0.71	0.73
query7	0.02	0.02	0.02
query8	0.04	0.03	0.05
query9	0.56	0.50	0.49
query10	0.55	0.55	0.57
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.60	0.60	0.59
query14	0.77	0.78	0.80
query15	0.84	0.83	0.82
query16	0.38	0.38	0.38
query17	0.99	0.97	0.96
query18	0.24	0.21	0.22
query19	1.95	1.87	1.77
query20	0.01	0.01	0.02
query21	15.41	0.58	0.60
query22	2.58	1.99	1.61
query23	16.95	0.94	0.95
query24	4.03	0.63	1.73
query25	0.18	0.27	0.20
query26	0.29	0.14	0.14
query27	0.04	0.03	0.04
query28	9.42	0.48	0.51
query29	12.56	3.21	3.18
query30	0.24	0.06	0.06
query31	2.86	0.39	0.38
query32	3.25	0.47	0.46
query33	3.00	3.00	3.01
query34	17.07	4.44	4.47
query35	4.53	4.53	4.53
query36	0.67	0.47	0.47
query37	0.10	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.43 s
Total hot run time: 29.7 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 66.67% (4/6) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 41.15% (10899/26488)
Line Coverage 31.95% (93201/291688)
Region Coverage 31.03% (48071/154935)
Branch Coverage 27.50% (24623/89538)

@morrySnow morrySnow merged commit 823b70f into branch-3.1 Jun 20, 2025
20 of 22 checks passed
@github-actions github-actions bot deleted the auto-pick-51197-branch-3.1 branch June 20, 2025 09:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants