Skip to content

[bugfix](memleak) fix memory leak for tabletschema and result cache #51786

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
yiguolei merged 4 commits into from
Jun 19, 2025
Merged

[bugfix](memleak) fix memory leak for tabletschema and result cache #51786

yiguolei merged 4 commits into from
Jun 19, 2025

Conversation

@yiguolei
Copy link
Contributor

@yiguolei yiguolei commented Jun 17, 2025

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

hello-stephen commented Jun 17, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yiguolei
Copy link
Contributor Author

yiguolei commented Jun 17, 2025

run buildall

1 similar comment
@yiguolei
Copy link
Contributor Author

yiguolei commented Jun 17, 2025

run buildall

@yiguolei
Copy link
Contributor Author

yiguolei commented Jun 17, 2025

run buildall

@yiguolei
Copy link
Contributor Author

yiguolei commented Jun 17, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jun 17, 2025

TPC-H: Total hot run time: 34052 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d9a1cd65ec5e0e52cfb45f5aa4b479cecb91f722, data reload: false

------ Round 1 ----------------------------------
q1	17587	5248	5085	5085
q2	1948	290	179	179
q3	10292	1268	789	789
q4	10199	1016	517	517
q5	7515	2383	2338	2338
q6	182	163	133	133
q7	909	747	611	611
q8	9307	1298	1149	1149
q9	6797	5012	5190	5012
q10	6900	2397	1959	1959
q11	509	297	270	270
q12	346	350	222	222
q13	17765	3668	3106	3106
q14	238	228	220	220
q15	568	473	481	473
q16	447	424	381	381
q17	614	859	358	358
q18	7561	7162	7150	7150
q19	1342	966	566	566
q20	344	342	225	225
q21	3806	3230	2346	2346
q22	1034	1003	963	963
Total cold run time: 106210 ms
Total hot run time: 34052 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5089	5037	5075	5037
q2	241	325	228	228
q3	2141	2680	2297	2297
q4	1375	1794	1335	1335
q5	4253	4113	4337	4113
q6	216	174	129	129
q7	2039	1992	1787	1787
q8	2631	2568	2475	2475
q9	7260	7173	7243	7173
q10	3084	3285	2763	2763
q11	594	517	515	515
q12	682	794	612	612
q13	3492	3900	3295	3295
q14	288	301	285	285
q15	520	500	493	493
q16	462	483	444	444
q17	1145	1636	1368	1368
q18	7826	7494	7464	7464
q19	819	808	886	808
q20	1984	2058	1889	1889
q21	5081	4532	4471	4471
q22	1094	1090	1014	1014
Total cold run time: 52316 ms
Total hot run time: 49995 ms

@doris-robot
Copy link

doris-robot commented Jun 17, 2025

TPC-DS: Total hot run time: 193820 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d9a1cd65ec5e0e52cfb45f5aa4b479cecb91f722, data reload: false

query1	1415	1032	999	999
query2	6512	1825	1821	1821
query3	11028	4481	4449	4449
query4	55814	24981	23405	23405
query5	5023	533	479	479
query6	332	213	205	205
query7	4882	516	290	290
query8	279	267	206	206
query9	5322	2662	2664	2662
query10	438	330	269	269
query11	15033	15136	14824	14824
query12	167	120	113	113
query13	1036	543	388	388
query14	10140	6357	6472	6357
query15	202	203	205	203
query16	7088	663	507	507
query17	1114	758	615	615
query18	1564	437	368	368
query19	206	217	187	187
query20	133	129	126	126
query21	212	130	110	110
query22	4474	4533	4216	4216
query23	34416	33690	33778	33690
query24	6699	2474	2458	2458
query25	478	467	405	405
query26	716	277	154	154
query27	2237	549	368	368
query28	2840	2203	2200	2200
query29	585	578	428	428
query30	276	222	194	194
query31	879	892	805	805
query32	71	66	81	66
query33	457	361	320	320
query34	797	872	532	532
query35	814	856	777	777
query36	953	995	919	919
query37	109	100	79	79
query38	4294	4258	4249	4249
query39	1508	1454	1501	1454
query40	212	119	109	109
query41	63	55	54	54
query42	129	127	110	110
query43	478	519	474	474
query44	1349	857	864	857
query45	175	180	171	171
query46	887	1042	669	669
query47	1850	1902	1809	1809
query48	394	445	349	349
query49	638	486	437	437
query50	677	722	420	420
query51	4254	4402	4261	4261
query52	111	116	116	116
query53	235	265	188	188
query54	593	605	517	517
query55	85	87	93	87
query56	328	347	309	309
query57	1236	1250	1185	1185
query58	285	297	273	273
query59	2678	2760	2705	2705
query60	378	330	334	330
query61	125	125	140	125
query62	736	770	684	684
query63	240	205	197	197
query64	1810	1027	700	700
query65	4353	4176	4204	4176
query66	772	417	303	303
query67	15920	15549	15694	15549
query68	7742	923	524	524
query69	557	312	277	277
query70	1190	1151	1078	1078
query71	488	328	316	316
query72	6013	4802	4855	4802
query73	1502	659	360	360
query74	9372	9267	9010	9010
query75	3806	3221	2703	2703
query76	4179	1204	818	818
query77	639	368	292	292
query78	10377	10189	9409	9409
query79	2740	847	585	585
query80	772	516	447	447
query81	496	255	225	225
query82	438	123	98	98
query83	384	250	226	226
query84	298	118	92	92
query85	785	350	317	317
query86	397	304	294	294
query87	4391	4467	4374	4374
query88	3395	2253	2296	2253
query89	440	325	279	279
query90	1781	207	209	207
query91	142	138	113	113
query92	77	64	61	61
query93	2223	950	577	577
query94	661	416	307	307
query95	372	292	289	289
query96	503	581	280	280
query97	2789	2737	2666	2666
query98	239	208	208	208
query99	1445	1416	1272	1272
Total cold run time: 302167 ms
Total hot run time: 193820 ms

@doris-robot
Copy link

doris-robot commented Jun 17, 2025

ClickBench: Total hot run time: 29.23 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d9a1cd65ec5e0e52cfb45f5aa4b479cecb91f722, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.04	0.04
query3	0.25	0.07	0.06
query4	1.60	0.10	0.11
query5	0.45	0.42	0.42
query6	1.16	0.67	0.68
query7	0.03	0.02	0.01
query8	0.05	0.03	0.04
query9	0.59	0.51	0.52
query10	0.57	0.58	0.58
query11	0.16	0.11	0.11
query12	0.15	0.11	0.12
query13	0.63	0.60	0.60
query14	0.81	0.82	0.81
query15	0.89	0.87	0.88
query16	0.39	0.40	0.40
query17	1.06	1.02	1.07
query18	0.22	0.21	0.20
query19	2.00	1.85	1.90
query20	0.01	0.01	0.02
query21	15.45	0.90	0.57
query22	0.77	1.09	0.67
query23	15.03	1.39	0.65
query24	6.90	1.82	0.49
query25	0.47	0.14	0.08
query26	0.58	0.17	0.14
query27	0.06	0.06	0.05
query28	9.52	0.87	0.45
query29	12.62	4.02	3.34
query30	0.24	0.09	0.06
query31	2.84	0.59	0.40
query32	3.24	0.56	0.47
query33	3.20	3.08	3.14
query34	15.91	5.32	4.76
query35	4.80	4.77	4.77
query36	0.71	0.49	0.49
query37	0.08	0.06	0.07
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.18	0.15	0.13
query41	0.08	0.03	0.03
query42	0.03	0.02	0.03
query43	0.04	0.04	0.03
Total cold run time: 103.96 s
Total hot run time: 29.23 s

@yiguolei
Copy link
Contributor Author

yiguolei commented Jun 18, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jun 18, 2025

TPC-H: Total hot run time: 34000 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3cd3585193ae56ad5d2dd201ab79e83207d0b827, data reload: false

------ Round 1 ----------------------------------
q1	17600	5238	5018	5018
q2	1930	272	176	176
q3	10317	1244	788	788
q4	10208	1015	542	542
q5	7540	2398	2298	2298
q6	179	159	131	131
q7	890	722	631	631
q8	9318	1440	1114	1114
q9	6743	5044	5101	5044
q10	6883	2389	1967	1967
q11	478	302	279	279
q12	352	358	227	227
q13	17752	3681	3147	3147
q14	222	228	208	208
q15	582	482	474	474
q16	425	431	375	375
q17	587	850	358	358
q18	7485	7056	7032	7032
q19	1258	945	556	556
q20	340	351	220	220
q21	3816	3217	2460	2460
q22	1034	1043	955	955
Total cold run time: 105939 ms
Total hot run time: 34000 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5159	5023	5109	5023
q2	237	323	227	227
q3	2167	2683	2307	2307
q4	1394	1810	1363	1363
q5	4271	4081	4292	4081
q6	215	168	132	132
q7	2017	1953	1764	1764
q8	2672	2600	2632	2600
q9	7232	7140	7198	7140
q10	3078	3280	2749	2749
q11	571	507	502	502
q12	674	816	629	629
q13	3591	3977	3313	3313
q14	284	312	273	273
q15	535	471	483	471
q16	426	483	467	467
q17	1165	1585	1391	1391
q18	7761	7407	7417	7407
q19	825	812	877	812
q20	2035	2059	1882	1882
q21	5110	4466	4454	4454
q22	1122	1049	1044	1044
Total cold run time: 52541 ms
Total hot run time: 50031 ms

@doris-robot
Copy link

doris-robot commented Jun 18, 2025

TPC-DS: Total hot run time: 193043 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3cd3585193ae56ad5d2dd201ab79e83207d0b827, data reload: false

query1	1401	1034	989	989
query2	6375	1827	1898	1827
query3	11126	4649	4557	4557
query4	54445	24939	23196	23196
query5	5248	512	466	466
query6	414	213	215	213
query7	5330	516	284	284
query8	300	248	224	224
query9	7266	2682	2676	2676
query10	412	333	280	280
query11	15237	15047	14869	14869
query12	167	111	115	111
query13	1284	533	412	412
query14	10119	6404	6336	6336
query15	197	210	188	188
query16	6916	676	472	472
query17	1088	751	570	570
query18	1528	395	321	321
query19	205	196	169	169
query20	136	131	122	122
query21	211	131	109	109
query22	4345	4393	4285	4285
query23	34332	33512	33600	33512
query24	6627	2507	2499	2499
query25	454	478	418	418
query26	634	282	158	158
query27	2255	517	360	360
query28	2947	2193	2181	2181
query29	592	557	446	446
query30	277	252	204	204
query31	897	892	794	794
query32	70	63	60	60
query33	439	357	312	312
query34	764	915	528	528
query35	779	848	779	779
query36	973	1023	889	889
query37	113	100	78	78
query38	4290	4357	4329	4329
query39	1505	1458	1463	1458
query40	218	120	111	111
query41	60	58	57	57
query42	123	115	111	111
query43	503	511	503	503
query44	1389	847	871	847
query45	185	182	184	182
query46	852	1055	656	656
query47	1821	1866	1789	1789
query48	415	436	323	323
query49	659	477	411	411
query50	668	695	416	416
query51	4235	4255	4160	4160
query52	116	111	105	105
query53	235	278	192	192
query54	588	583	534	534
query55	94	84	79	79
query56	318	310	341	310
query57	1270	1269	1207	1207
query58	298	295	282	282
query59	2732	2885	2720	2720
query60	334	356	328	328
query61	168	159	146	146
query62	744	714	650	650
query63	228	192	190	190
query64	1410	994	674	674
query65	4281	4200	4147	4147
query66	826	403	300	300
query67	15767	15613	15494	15494
query68	7231	919	536	536
query69	548	312	272	272
query70	1211	1133	1146	1133
query71	503	329	294	294
query72	6076	4960	5043	4960
query73	1179	737	355	355
query74	9279	9155	8723	8723
query75	3751	3205	2686	2686
query76	4283	1189	775	775
query77	645	375	289	289
query78	10164	10119	9325	9325
query79	2124	813	587	587
query80	584	513	439	439
query81	498	258	233	233
query82	466	130	102	102
query83	395	249	247	247
query84	340	109	85	85
query85	797	345	307	307
query86	406	286	282	282
query87	4367	4530	4364	4364
query88	3561	2262	2253	2253
query89	406	315	277	277
query90	1882	211	215	211
query91	147	147	112	112
query92	71	58	58	58
query93	1796	930	590	590
query94	658	411	306	306
query95	372	293	283	283
query96	488	560	282	282
query97	2688	2766	2598	2598
query98	229	207	201	201
query99	1446	1432	1273	1273
Total cold run time: 300826 ms
Total hot run time: 193043 ms

@doris-robot
Copy link

doris-robot commented Jun 18, 2025

ClickBench: Total hot run time: 29.75 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3cd3585193ae56ad5d2dd201ab79e83207d0b827, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.04	0.04
query3	0.25	0.06	0.08
query4	1.60	0.11	0.11
query5	0.43	0.41	0.39
query6	1.17	0.66	0.66
query7	0.03	0.02	0.02
query8	0.05	0.03	0.03
query9	0.58	0.53	0.53
query10	0.57	0.58	0.58
query11	0.16	0.11	0.12
query12	0.16	0.12	0.11
query13	0.63	0.60	0.61
query14	0.81	0.85	0.81
query15	0.88	0.90	0.87
query16	0.39	0.38	0.38
query17	1.08	1.07	1.04
query18	0.23	0.21	0.21
query19	2.00	1.87	1.83
query20	0.02	0.01	0.02
query21	15.39	0.91	0.54
query22	0.76	1.05	0.88
query23	14.79	1.40	0.63
query24	7.09	1.19	0.92
query25	0.48	0.22	0.07
query26	0.51	0.16	0.13
query27	0.06	0.05	0.04
query28	9.58	0.93	0.44
query29	12.54	4.00	3.28
query30	0.25	0.09	0.06
query31	2.83	0.59	0.39
query32	3.23	0.55	0.46
query33	3.10	3.05	3.16
query34	16.24	5.36	4.80
query35	4.87	4.83	4.84
query36	0.68	0.51	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.17	0.14	0.15
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 104.05 s
Total hot run time: 29.75 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Jun 18, 2025

BE UT Coverage Report

Increment line coverage 83.33% (5/6) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 56.34% (15050/26712)
Line Coverage 45.11% (134596/298374)
Region Coverage 44.24% (67681/152982)
Branch Coverage 38.83% (34728/89440)

@yiguolei
Copy link
Contributor Author

yiguolei commented Jun 18, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Jun 18, 2025

BE UT Coverage Report

Increment line coverage 100.00% (7/7) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 56.33% (15046/26711)
Line Coverage 45.10% (134564/298373)
Region Coverage 44.23% (67674/153003)
Branch Coverage 38.81% (34719/89454)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jun 18, 2025

BE Regression && UT Coverage Report

Increment line coverage 100.00% (7/7) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 61.22% (16093/26288)
Line Coverage 50.77% (151417/298214)
Region Coverage 48.10% (86573/179972)
Branch Coverage 41.62% (42562/102258)

eldenmoon
eldenmoon approved these changes Jun 19, 2025
View reviewed changes
Copy link
Member

@eldenmoon eldenmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

github-actions bot commented Jun 19, 2025

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Jun 19, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Jun 19, 2025

PR approved by anyone and no changes requested.

airborne12
airborne12 approved these changes Jun 19, 2025
View reviewed changes
Copy link
Member

@airborne12 airborne12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@doris-robot
Copy link

doris-robot commented Jun 19, 2025

TPC-H: Total hot run time: 34250 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b5704d7df5c09b42c5b43a401a9df0339e4b63d2, data reload: false

------ Round 1 ----------------------------------
q1	17639	5144	5037	5037
q2	1939	292	213	213
q3	10255	1315	713	713
q4	10219	996	534	534
q5	8115	2441	2411	2411
q6	183	166	137	137
q7	921	770	617	617
q8	9316	1298	1154	1154
q9	6814	5096	5122	5096
q10	6916	2410	1996	1996
q11	487	294	269	269
q12	345	345	209	209
q13	17769	3677	3105	3105
q14	231	230	223	223
q15	574	486	479	479
q16	431	430	372	372
q17	614	877	368	368
q18	7737	7114	7143	7114
q19	2011	981	591	591
q20	344	334	217	217
q21	4071	3214	2408	2408
q22	1083	1058	987	987
Total cold run time: 108014 ms
Total hot run time: 34250 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5149	5239	5063	5063
q2	239	331	230	230
q3	2206	2690	2297	2297
q4	1346	1796	1331	1331
q5	4290	4296	4492	4296
q6	212	181	132	132
q7	2035	1955	1748	1748
q8	2632	2545	2554	2545
q9	7153	7185	7174	7174
q10	3140	3284	2822	2822
q11	566	510	482	482
q12	680	793	593	593
q13	3551	3875	3371	3371
q14	298	315	283	283
q15	524	482	474	474
q16	466	490	441	441
q17	1176	1540	1378	1378
q18	7873	7444	7438	7438
q19	834	852	916	852
q20	1999	2029	1884	1884
q21	5057	4554	4331	4331
q22	1103	1066	1025	1025
Total cold run time: 52529 ms
Total hot run time: 50190 ms

@doris-robot
Copy link

doris-robot commented Jun 19, 2025

TPC-DS: Total hot run time: 185780 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b5704d7df5c09b42c5b43a401a9df0339e4b63d2, data reload: false

query1	1001	390	386	386
query2	6525	1847	1816	1816
query3	6744	230	219	219
query4	26244	23275	23312	23275
query5	4385	651	462	462
query6	304	212	211	211
query7	4624	506	295	295
query8	274	230	221	221
query9	8606	2630	2629	2629
query10	458	342	299	299
query11	15739	15138	14827	14827
query12	157	108	102	102
query13	1634	515	412	412
query14	9725	6124	6026	6026
query15	208	189	177	177
query16	7274	645	522	522
query17	1182	735	556	556
query18	1973	409	306	306
query19	187	208	159	159
query20	120	119	114	114
query21	215	125	114	114
query22	3984	4048	3907	3907
query23	34142	33135	33235	33135
query24	8314	2411	2380	2380
query25	542	464	401	401
query26	1224	286	155	155
query27	2728	509	343	343
query28	4343	2119	2093	2093
query29	781	550	450	450
query30	286	223	196	196
query31	944	847	765	765
query32	73	67	66	66
query33	552	383	328	328
query34	817	845	543	543
query35	782	817	760	760
query36	994	976	885	885
query37	109	100	85	85
query38	4123	4168	4056	4056
query39	1635	1401	1406	1401
query40	213	128	109	109
query41	64	60	62	60
query42	133	113	109	109
query43	509	518	486	486
query44	1399	872	836	836
query45	180	174	168	168
query46	849	1023	656	656
query47	1777	1826	1717	1717
query48	385	423	311	311
query49	752	496	401	401
query50	633	689	397	397
query51	4092	4140	4180	4140
query52	106	106	104	104
query53	231	254	187	187
query54	574	568	502	502
query55	84	84	84	84
query56	293	303	282	282
query57	1191	1193	1125	1125
query58	268	263	255	255
query59	2594	2653	2551	2551
query60	332	329	297	297
query61	123	124	127	124
query62	804	715	657	657
query63	224	198	192	192
query64	4479	1111	763	763
query65	4285	4222	4219	4219
query66	1156	427	330	330
query67	15818	15659	15478	15478
query68	7904	902	524	524
query69	471	311	282	282
query70	1164	1073	1159	1073
query71	468	323	299	299
query72	5215	4687	4642	4642
query73	679	578	359	359
query74	8871	9174	8636	8636
query75	3874	3204	2707	2707
query76	3720	1186	760	760
query77	776	374	286	286
query78	10132	10146	9348	9348
query79	2368	886	595	595
query80	674	506	437	437
query81	503	263	229	229
query82	493	132	98	98
query83	253	251	228	228
query84	254	112	93	93
query85	800	358	319	319
query86	381	323	287	287
query87	4409	4445	4416	4416
query88	3890	2292	2267	2267
query89	383	320	295	295
query90	1863	208	205	205
query91	140	139	112	112
query92	80	68	59	59
query93	2056	945	574	574
query94	678	416	312	312
query95	377	289	281	281
query96	496	570	282	282
query97	2714	2779	2641	2641
query98	242	210	202	202
query99	1669	1387	1315	1315
Total cold run time: 275497 ms
Total hot run time: 185780 ms

@doris-robot
Copy link

doris-robot commented Jun 19, 2025

ClickBench: Total hot run time: 30.23 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b5704d7df5c09b42c5b43a401a9df0339e4b63d2, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.03
query3	0.24	0.08	0.07
query4	1.61	0.11	0.10
query5	0.41	0.42	0.40
query6	1.17	0.66	0.66
query7	0.02	0.02	0.01
query8	0.05	0.03	0.03
query9	0.56	0.54	0.53
query10	0.56	0.58	0.56
query11	0.16	0.11	0.11
query12	0.14	0.12	0.12
query13	0.64	0.60	0.61
query14	0.81	0.86	0.85
query15	0.90	0.88	0.86
query16	0.39	0.39	0.39
query17	1.07	1.08	1.09
query18	0.22	0.21	0.21
query19	1.94	1.84	1.86
query20	0.02	0.01	0.01
query21	15.40	0.90	0.58
query22	0.76	1.19	0.78
query23	14.80	1.33	0.64
query24	6.67	1.27	1.67
query25	0.47	0.12	0.15
query26	0.71	0.17	0.14
query27	0.07	0.05	0.05
query28	10.00	0.90	0.47
query29	12.54	3.95	3.30
query30	0.25	0.09	0.06
query31	2.83	0.61	0.40
query32	3.25	0.54	0.48
query33	3.09	3.03	3.15
query34	16.08	5.42	4.78
query35	4.87	4.88	4.84
query36	0.69	0.50	0.48
query37	0.09	0.07	0.07
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.18	0.15	0.13
query41	0.08	0.02	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.98 s
Total hot run time: 30.23 s

@yiguolei yiguolei merged commit d3ba307 into apache:master Jun 19, 2025
23 of 27 checks passed
@yiguolei yiguolei mentioned this pull request Jun 19, 2025
Merged
16 tasks
yiguolei added a commit that referenced this pull request Jun 19, 2025
@yiguolei
[bugfix](memleak) fix memory leak for tabletschema and result cache (#…
aa562b3 
…51931)

### What problem does this PR solve?

pick #51786

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
apache/doris-website#1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
yiguolei added a commit to yiguolei/incubator-doris that referenced this pull request Jun 19, 2025
@yiguolei
[bugfix](memleak) fix memory leak for tabletschema and result cache (a…
b3a1c06 
…pache#51931)

pick apache#51786

Related PR: #xxx

Problem Summary:

None

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
apache/doris-website#1214 -->

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
@yiguolei yiguolei mentioned this pull request Jun 19, 2025
Merged
29 tasks
dataroaring pushed a commit that referenced this pull request Jun 20, 2025
@yiguolei
[bugfix](memleak) fix memory leak for tabletschema and result cache (#…
e757432 
…51931) (#51952)

pick #51786
yiguolei added a commit to yiguolei/incubator-doris that referenced this pull request Jun 20, 2025
@yiguolei
[bugfix](memleak) fix memory leak for tabletschema and result cache (a…
515f695 
…pache#51931) (apache#51952)

pick apache#51786
@yiguolei yiguolei mentioned this pull request Jun 20, 2025
Merged
16 tasks
morrySnow pushed a commit that referenced this pull request Jun 20, 2025
@yiguolei
branch-3.1: [fix](memleak) fix memory leak for tabletschema and resul…
dffb4bb 
…t cache and fix memleak in arrow input stream (#52074)

pick #51786
pick #51929
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@airborne12 airborne12 airborne12 approved these changes

@eldenmoon eldenmoon eldenmoon approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.11-merged dev/3.0.7-merged dev/3.1.0-merged reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@yiguolei @hello-stephen @doris-robot @airborne12 @eldenmoon @dataroaring @morrySnow