Skip to content

Conversation

@HappenLee
Copy link
Contributor

@HappenLee HappenLee commented Oct 17, 2025

What problem does this PR solve?

To reduce the page fault like clickhouse do the work

Related PR: #clickhouse](ClickHouse/ClickHouse#80245)

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

Improve memory reuse efficiency and reduce page faults to change jemalloc conf
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@HappenLee
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-DS: Total hot run time: 190415 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2d4638a8e4c1c7f8f825f84276b74479514a7da2, data reload: false

query1	1069	438	411	411
query2	6582	1699	1701	1699
query3	6768	219	225	219
query4	26228	23736	23492	23492
query5	5762	635	497	497
query6	333	237	210	210
query7	4682	492	298	298
query8	301	258	254	254
query9	8689	2553	2584	2553
query10	580	351	283	283
query11	15243	15094	14787	14787
query12	191	125	115	115
query13	1666	540	430	430
query14	11395	9129	9119	9119
query15	222	236	170	170
query16	7700	730	560	560
query17	1650	975	672	672
query18	2792	451	337	337
query19	238	229	210	210
query20	139	133	131	131
query21	225	154	123	123
query22	4735	5002	4919	4919
query23	35359	34289	34091	34091
query24	8579	2657	2502	2502
query25	639	558	490	490
query26	1242	296	170	170
query27	2917	543	410	410
query28	4586	2272	2235	2235
query29	832	676	573	573
query30	340	255	205	205
query31	925	789	728	728
query32	78	74	74	74
query33	648	379	316	316
query34	831	853	512	512
query35	828	836	753	753
query36	949	1014	886	886
query37	116	111	83	83
query38	3547	3510	3462	3462
query39	1489	1408	1432	1408
query40	220	128	114	114
query41	60	58	56	56
query42	121	114	113	113
query43	487	494	464	464
query44	1329	842	857	842
query45	186	179	170	170
query46	845	1011	644	644
query47	1773	1819	1712	1712
query48	389	426	317	317
query49	771	526	404	404
query50	650	751	402	402
query51	3877	3862	3930	3862
query52	112	109	98	98
query53	237	264	199	199
query54	590	587	529	529
query55	89	81	80	80
query56	323	322	301	301
query57	1186	1193	1128	1128
query58	302	277	282	277
query59	2526	2615	2485	2485
query60	365	345	327	327
query61	162	161	162	161
query62	849	733	700	700
query63	239	190	188	188
query64	4442	1160	832	832
query65	4040	3986	4018	3986
query66	1085	428	330	330
query67	15367	15235	15034	15034
query68	9560	905	600	600
query69	512	326	294	294
query70	1369	1298	1307	1298
query71	594	333	327	327
query72	6096	4944	4948	4944
query73	709	598	356	356
query74	8886	9140	8696	8696
query75	4578	3383	2864	2864
query76	4466	1174	732	732
query77	1021	410	298	298
query78	9590	9929	8861	8861
query79	3566	860	577	577
query80	699	564	497	497
query81	501	264	224	224
query82	229	165	133	133
query83	298	264	247	247
query84	316	115	98	98
query85	866	552	427	427
query86	341	316	313	313
query87	3764	3786	3600	3600
query88	2829	2224	2194	2194
query89	434	339	303	303
query90	2063	210	215	210
query91	158	175	130	130
query92	88	71	68	68
query93	2253	964	640	640
query94	679	449	327	327
query95	400	331	304	304
query96	495	591	284	284
query97	2904	3003	2880	2880
query98	238	223	214	214
query99	1439	1427	1333	1333
Total cold run time: 285658 ms
Total hot run time: 190415 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.36 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2d4638a8e4c1c7f8f825f84276b74479514a7da2, data reload: false

query1	0.05	0.05	0.05
query2	0.09	0.06	0.05
query3	0.25	0.09	0.09
query4	1.61	0.12	0.11
query5	0.28	0.27	0.25
query6	1.18	0.65	0.65
query7	0.04	0.02	0.03
query8	0.05	0.04	0.05
query9	0.64	0.53	0.53
query10	0.58	0.58	0.57
query11	0.17	0.11	0.12
query12	0.15	0.11	0.13
query13	0.64	0.62	0.60
query14	1.04	1.04	1.05
query15	0.86	0.85	0.86
query16	0.45	0.42	0.41
query17	1.06	1.06	1.05
query18	0.22	0.20	0.21
query19	1.97	1.79	1.82
query20	0.02	0.02	0.01
query21	15.43	0.89	0.56
query22	0.78	1.34	0.91
query23	14.74	1.50	0.67
query24	7.98	0.99	0.38
query25	0.31	0.25	0.10
query26	0.64	0.16	0.13
query27	0.09	0.06	0.05
query28	8.91	1.37	0.94
query29	12.54	3.96	3.38
query30	0.28	0.13	0.11
query31	2.83	0.59	0.39
query32	3.25	0.57	0.48
query33	3.04	3.11	3.06
query34	16.28	5.52	4.85
query35	4.93	4.95	4.93
query36	0.67	0.54	0.51
query37	0.10	0.07	0.07
query38	0.06	0.05	0.04
query39	0.04	0.03	0.03
query40	0.17	0.15	0.15
query41	0.08	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 104.58 s
Total hot run time: 30.36 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Oct 20, 2025
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@BiteTheDDDDt BiteTheDDDDt merged commit ab1a05a into apache:master Oct 20, 2025
29 of 30 checks passed
github-actions bot pushed a commit that referenced this pull request Oct 20, 2025
…s to change jemalloc conf (#57076)

To reduce the page fault like clickhouse do the work

Related PR:
#clickhouse](ClickHouse/ClickHouse#80245)
github-actions bot pushed a commit that referenced this pull request Oct 20, 2025
…s to change jemalloc conf (#57076)

To reduce the page fault like clickhouse do the work

Related PR:
#clickhouse](ClickHouse/ClickHouse#80245)
yiguolei pushed a commit that referenced this pull request Oct 20, 2025
…e page faults to change jemalloc conf #57076 (#57151)

Cherry-picked from #57076

Co-authored-by: HappenLee <happenlee@selectdb.com>
morrySnow pushed a commit that referenced this pull request Nov 4, 2025
…e page faults to change jemalloc conf #57076 (#57152)

Cherry-picked from #57076

Co-authored-by: HappenLee <happenlee@selectdb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.1.3-merged dev/4.0.1-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants