Skip to content

Conversation

@github-actions
Copy link
Contributor

Cherry-picked from #57076

…s to change jemalloc conf (#57076)

To reduce the page fault like clickhouse do the work

Related PR:
#clickhouse](ClickHouse/ClickHouse#80245)
@github-actions github-actions bot requested a review from morrySnow as a code owner October 20, 2025 07:41
@Thearas
Copy link
Contributor

Thearas commented Oct 20, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Oct 20, 2025
@Thearas
Copy link
Contributor

Thearas commented Oct 20, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32810 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 16b147fb6a1279cefe55ecc6c5ef55be3fbec3a9, data reload: false

------ Round 1 ----------------------------------
q1	17602	5551	5547	5547
q2	2028	398	283	283
q3	11830	1239	748	748
q4	10299	870	461	461
q5	8967	2394	2128	2128
q6	186	163	134	134
q7	918	761	628	628
q8	9332	1447	1143	1143
q9	5184	4973	4907	4907
q10	6772	2286	1844	1844
q11	464	283	258	258
q12	326	354	209	209
q13	17780	3578	3058	3058
q14	230	227	217	217
q15	511	464	461	461
q16	437	427	368	368
q17	587	851	363	363
q18	6881	6454	6369	6369
q19	1225	952	530	530
q20	344	342	204	204
q21	2747	2132	1981	1981
q22	1039	1034	969	969
Total cold run time: 105689 ms
Total hot run time: 32810 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5582	5537	5551	5537
q2	239	328	242	242
q3	2255	2675	2314	2314
q4	1357	1811	1341	1341
q5	4407	4948	5027	4948
q6	171	162	133	133
q7	2045	1992	1836	1836
q8	2647	2810	2704	2704
q9	7262	7282	7232	7232
q10	3014	3299	2736	2736
q11	585	512	502	502
q12	665	776	636	636
q13	3436	3779	3237	3237
q14	278	314	256	256
q15	537	478	479	478
q16	441	483	442	442
q17	1226	1751	1236	1236
q18	7783	7621	7460	7460
q19	799	1081	1116	1081
q20	2047	2073	1941	1941
q21	5304	4896	4573	4573
q22	1103	1101	1035	1035
Total cold run time: 53183 ms
Total hot run time: 51900 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193299 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 16b147fb6a1279cefe55ecc6c5ef55be3fbec3a9, data reload: false

query1	934	408	398	398
query2	6221	1978	1861	1861
query3	8695	204	201	201
query4	34540	24177	23805	23805
query5	3673	615	475	475
query6	302	209	200	200
query7	4198	484	310	310
query8	301	273	243	243
query9	9180	2604	2592	2592
query10	471	319	262	262
query11	18081	15528	15194	15194
query12	165	110	112	110
query13	1560	537	415	415
query14	10286	6977	7368	6977
query15	237	192	179	179
query16	8106	644	511	511
query17	1578	782	619	619
query18	2192	444	337	337
query19	224	188	167	167
query20	129	125	127	125
query21	219	135	110	110
query22	4493	4570	4403	4403
query23	35747	34536	34246	34246
query24	7309	2703	2728	2703
query25	505	497	445	445
query26	844	273	174	174
query27	1937	475	366	366
query28	5309	2224	2216	2216
query29	599	578	466	466
query30	245	198	173	173
query31	1013	933	878	878
query32	91	60	57	57
query33	494	365	323	323
query34	764	821	528	528
query35	784	836	761	761
query36	1018	1106	994	994
query37	113	94	72	72
query38	4040	4082	4035	4035
query39	1528	1492	1455	1455
query40	217	124	110	110
query41	53	55	48	48
query42	123	112	105	105
query43	507	532	488	488
query44	1400	837	821	821
query45	187	180	173	173
query46	881	1062	668	668
query47	1978	2000	1926	1926
query48	416	440	351	351
query49	730	490	414	414
query50	676	683	426	426
query51	7333	7227	7186	7186
query52	105	106	97	97
query53	241	259	199	199
query54	587	545	489	489
query55	88	77	79	77
query56	282	281	275	275
query57	1227	1275	1189	1189
query58	256	225	221	221
query59	3052	3286	3025	3025
query60	307	280	265	265
query61	117	140	111	111
query62	799	788	721	721
query63	227	194	191	191
query64	3999	999	657	657
query65	3404	3300	3319	3300
query66	845	418	311	311
query67	16570	15801	15751	15751
query68	7637	813	533	533
query69	490	308	278	278
query70	1219	1137	1101	1101
query71	409	303	273	273
query72	5676	3777	3865	3777
query73	645	743	350	350
query74	10533	9142	9245	9142
query75	3768	3152	2705	2705
query76	3352	1188	769	769
query77	762	372	295	295
query78	10426	10445	9585	9585
query79	3730	853	580	580
query80	760	542	442	442
query81	486	255	223	223
query82	594	121	90	90
query83	161	160	147	147
query84	252	109	79	79
query85	801	373	300	300
query86	397	326	296	296
query87	4371	4360	4271	4271
query88	5000	2415	2389	2389
query89	408	332	293	293
query90	1756	193	193	193
query91	144	143	107	107
query92	66	56	53	53
query93	2244	887	523	523
query94	640	420	314	314
query95	353	283	273	273
query96	494	606	283	283
query97	3138	3273	3138	3138
query98	249	224	210	210
query99	1533	1398	1306	1306
Total cold run time: 297226 ms
Total hot run time: 193299 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.83 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 16b147fb6a1279cefe55ecc6c5ef55be3fbec3a9, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.04
query3	0.24	0.06	0.07
query4	1.62	0.11	0.10
query5	0.53	0.51	0.53
query6	1.14	0.75	0.73
query7	0.02	0.02	0.02
query8	0.05	0.04	0.03
query9	0.58	0.50	0.49
query10	0.55	0.55	0.56
query11	0.14	0.11	0.10
query12	0.14	0.11	0.10
query13	0.62	0.60	0.59
query14	0.80	0.79	0.82
query15	0.85	0.82	0.82
query16	0.40	0.40	0.40
query17	0.98	1.05	1.01
query18	0.23	0.22	0.22
query19	1.90	1.89	1.91
query20	0.02	0.01	0.01
query21	15.38	0.95	0.58
query22	0.73	0.86	0.55
query23	15.21	1.44	0.56
query24	3.26	0.91	1.25
query25	0.17	0.11	0.05
query26	0.35	0.16	0.14
query27	0.06	0.04	0.03
query28	13.12	1.00	0.43
query29	12.54	3.94	3.27
query30	0.25	0.09	0.07
query31	2.83	0.60	0.37
query32	3.24	0.53	0.47
query33	3.00	3.02	3.04
query34	16.72	5.20	4.53
query35	4.56	4.58	4.57
query36	0.62	0.49	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.17	0.14	0.14
query41	0.07	0.02	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.42 s
Total hot run time: 28.83 s

@morrySnow
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32992 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 16b147fb6a1279cefe55ecc6c5ef55be3fbec3a9, data reload: false

------ Round 1 ----------------------------------
q1	17796	5499	5477	5477
q2	2033	391	285	285
q3	12289	1266	750	750
q4	10266	882	463	463
q5	8502	2437	2175	2175
q6	192	165	134	134
q7	924	758	627	627
q8	9352	1450	1190	1190
q9	5247	5069	4975	4975
q10	6788	2284	1814	1814
q11	493	271	269	269
q12	346	362	221	221
q13	17794	3580	3039	3039
q14	232	235	206	206
q15	517	465	462	462
q16	420	433	366	366
q17	603	875	368	368
q18	7167	6455	6465	6455
q19	1748	966	550	550
q20	318	337	200	200
q21	2925	2184	1997	1997
q22	1026	1005	969	969
Total cold run time: 106978 ms
Total hot run time: 32992 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5561	5524	5497	5497
q2	234	342	228	228
q3	2266	2677	2279	2279
q4	1347	1788	1355	1355
q5	4437	4962	4998	4962
q6	172	162	130	130
q7	2106	1976	1837	1837
q8	2644	2865	2736	2736
q9	7306	7327	7266	7266
q10	3047	3362	2702	2702
q11	563	500	501	500
q12	646	776	616	616
q13	3416	3782	3207	3207
q14	287	300	261	261
q15	515	472	474	472
q16	440	498	434	434
q17	1260	1738	1263	1263
q18	7520	7343	7366	7343
q19	827	1217	1068	1068
q20	2061	2071	1897	1897
q21	5412	4933	4680	4680
q22	1113	1059	1003	1003
Total cold run time: 53180 ms
Total hot run time: 51736 ms

@doris-robot
Copy link

TPC-H: Total hot run time: 32654 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 16b147fb6a1279cefe55ecc6c5ef55be3fbec3a9, data reload: false

------ Round 1 ----------------------------------
q1	17584	5490	5423	5423
q2	2026	389	280	280
q3	12222	1245	751	751
q4	10291	871	455	455
q5	8758	2396	2131	2131
q6	189	165	135	135
q7	901	757	625	625
q8	9325	1413	1174	1174
q9	5270	5022	4923	4923
q10	6802	2272	1824	1824
q11	479	283	260	260
q12	332	373	216	216
q13	17808	3641	3026	3026
q14	222	220	202	202
q15	536	467	460	460
q16	417	431	381	381
q17	612	855	362	362
q18	7024	6277	6288	6277
q19	1507	966	562	562
q20	345	341	203	203
q21	2907	2207	1996	1996
q22	1063	1039	988	988
Total cold run time: 106620 ms
Total hot run time: 32654 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5555	5536	5552	5536
q2	241	332	231	231
q3	2358	2687	2371	2371
q4	1452	1859	1429	1429
q5	4527	5131	4969	4969
q6	176	168	132	132
q7	2067	1999	1853	1853
q8	2651	2879	2702	2702
q9	7285	7294	7157	7157
q10	2993	3331	2763	2763
q11	564	518	488	488
q12	710	782	675	675
q13	3444	3767	3166	3166
q14	297	297	294	294
q15	512	476	477	476
q16	463	477	435	435
q17	1236	1729	1273	1273
q18	7630	7515	7293	7293
q19	852	1213	1076	1076
q20	2020	2057	1910	1910
q21	5348	4978	4526	4526
q22	1090	1120	1052	1052
Total cold run time: 53471 ms
Total hot run time: 51807 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193836 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 16b147fb6a1279cefe55ecc6c5ef55be3fbec3a9, data reload: false

query1	969	387	395	387
query2	6173	1970	1969	1969
query3	8677	205	200	200
query4	33672	24019	23654	23654
query5	3798	612	471	471
query6	294	205	210	205
query7	4211	504	317	317
query8	311	257	252	252
query9	9329	2618	2628	2618
query10	477	326	264	264
query11	18117	15467	15210	15210
query12	163	105	106	105
query13	1550	546	432	432
query14	9547	7218	7338	7218
query15	237	190	180	180
query16	8125	694	516	516
query17	1580	798	631	631
query18	2167	439	331	331
query19	223	193	182	182
query20	133	127	118	118
query21	202	136	114	114
query22	4606	4548	4408	4408
query23	35209	34792	34520	34520
query24	7349	2777	2743	2743
query25	552	505	432	432
query26	811	294	180	180
query27	1929	501	367	367
query28	5432	2258	2212	2212
query29	743	641	479	479
query30	242	189	167	167
query31	1053	909	845	845
query32	83	61	59	59
query33	509	379	312	312
query34	791	882	539	539
query35	814	837	758	758
query36	1016	1124	998	998
query37	112	94	77	77
query38	4023	4054	3953	3953
query39	1501	1499	1506	1499
query40	216	122	106	106
query41	49	51	48	48
query42	127	113	109	109
query43	534	545	502	502
query44	1399	842	831	831
query45	196	174	173	173
query46	923	1080	709	709
query47	2017	2015	1924	1924
query48	413	441	376	376
query49	762	497	402	402
query50	725	710	439	439
query51	7234	7367	7143	7143
query52	111	109	97	97
query53	243	268	196	196
query54	557	572	478	478
query55	90	84	79	79
query56	271	285	269	269
query57	1291	1266	1212	1212
query58	241	226	225	225
query59	3198	3287	3157	3157
query60	305	309	274	274
query61	140	129	121	121
query62	787	778	718	718
query63	243	201	202	201
query64	3838	1023	652	652
query65	3423	3327	3322	3322
query66	791	416	320	320
query67	16386	16050	15440	15440
query68	7806	861	544	544
query69	478	311	276	276
query70	1225	1227	1106	1106
query71	375	291	261	261
query72	5131	3818	3960	3818
query73	639	781	364	364
query74	10379	9298	9017	9017
query75	3219	3224	2681	2681
query76	2999	1227	788	788
query77	465	387	286	286
query78	10331	10457	9602	9602
query79	3472	892	608	608
query80	680	532	436	436
query81	483	254	226	226
query82	579	123	88	88
query83	157	164	144	144
query84	244	109	83	83
query85	789	384	309	309
query86	387	329	307	307
query87	4332	4400	4351	4351
query88	5050	2407	2391	2391
query89	415	334	289	289
query90	1797	189	191	189
query91	135	142	109	109
query92	67	55	54	54
query93	2109	878	549	549
query94	684	423	312	312
query95	343	287	276	276
query96	491	624	284	284
query97	3176	3224	3151	3151
query98	237	208	194	194
query99	1616	1455	1298	1298
Total cold run time: 293530 ms
Total hot run time: 193836 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.44 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 16b147fb6a1279cefe55ecc6c5ef55be3fbec3a9, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.07
query4	1.62	0.11	0.11
query5	0.51	0.51	0.52
query6	1.12	0.75	0.73
query7	0.03	0.02	0.02
query8	0.05	0.03	0.03
query9	0.59	0.49	0.50
query10	0.56	0.55	0.55
query11	0.13	0.10	0.10
query12	0.13	0.11	0.10
query13	0.63	0.61	0.59
query14	0.77	0.82	0.80
query15	0.84	0.84	0.82
query16	0.38	0.38	0.38
query17	1.08	1.08	1.04
query18	0.24	0.22	0.23
query19	1.88	1.88	1.91
query20	0.02	0.01	0.01
query21	15.38	0.95	0.58
query22	0.75	0.82	0.65
query23	15.14	1.50	0.59
query24	3.60	0.47	0.29
query25	0.16	0.06	0.09
query26	0.21	0.15	0.14
query27	0.05	0.05	0.05
query28	12.62	1.09	0.44
query29	12.60	3.93	3.27
query30	0.24	0.09	0.06
query31	2.83	0.58	0.39
query32	3.22	0.54	0.45
query33	2.99	3.02	3.02
query34	16.73	5.22	4.57
query35	4.56	4.60	4.61
query36	0.65	0.50	0.47
query37	0.08	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.13	0.12
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.14 s
Total hot run time: 28.44 s

@morrySnow morrySnow merged commit 1a0309b into branch-3.1 Nov 4, 2025
23 checks passed
@github-actions github-actions bot deleted the auto-pick-57076-branch-3.1 branch November 4, 2025 01:59
@morrySnow morrySnow mentioned this pull request Nov 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants