Skip to content

Conversation

@bobhan1
Copy link
Contributor

@bobhan1 bobhan1 commented Jul 2, 2025

What problem does this PR solve?

fix #52596, DeleteBitmapAggCache should be destructed before CacheManager

SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior /root/doris/be/src/runtime/memory/cache_policy.cpp:35:31 
*** Query id: 0-0 ***
*** is nereids: 0 ***
*** tablet id: 0 ***
*** Aborted at 1751405577 (unix time) try "date -d @1751405577" if you are using GNU date ***
*** Current BE git commitID: cd35cf0eb5 ***
*** SIGSEGV address not mapped to object (@0x10) received by PID 15013 (TID 15013 OR 0x7fced202a4c0) from PID 16; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris/be/src/common/signal_handler.h:420
 1# PosixSignals::chained_handler(int, siginfo_t*, void*) [clone .part.0] in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 3# 0x00007FCED2404090 in /lib/x86_64-linux-gnu/libc.so.6
 4# __pthread_mutex_lock at ../nptl/pthread_mutex_lock.c:67
 5# doris::CacheManager::unregister_cache(doris::CachePolicy::CacheType) at /root/doris/be/src/runtime/memory/cache_manager.h:56
 6# doris::CachePolicy::~CachePolicy() at /root/doris/be/src/runtime/memory/cache_policy.cpp:36
 7# doris::DeleteBitmap::AggCachePolicy::~AggCachePolicy() at /root/doris/be/src/olap/tablet_meta.h:568
 8# __run_exit_handlers at /build/glibc-SzIz7B/glibc-2.31/stdlib/exit.c:109
 9# on_exit at /build/glibc-SzIz7B/glibc-2.31/stdlib/on_exit.c:26
10# __libc_start_main at ../csu/libc-start.c:261
11# _start in /home/work/unlimit_teamcity/TeamCity/Agents/20250702042258agent_172.16.0.200_1/work/60183217f6ee2a9c/output/be/lib/doris_be

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@bobhan1 bobhan1 force-pushed the move-dbm-agg-cache branch 2 times, most recently from 324ad3a to 2ae3265 Compare July 2, 2025 08:02
@bobhan1 bobhan1 force-pushed the move-dbm-agg-cache branch from 2ae3265 to d9ca8b6 Compare July 2, 2025 08:03
@bobhan1 bobhan1 marked this pull request as ready for review July 2, 2025 08:04
@bobhan1
Copy link
Contributor Author

bobhan1 commented Jul 2, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34084 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d9ca8b6093427d102845ab938ff4dd667539a502, data reload: false

------ Round 1 ----------------------------------
q1	17574	5146	5112	5112
q2	1934	287	186	186
q3	10319	1331	766	766
q4	10249	1024	557	557
q5	7719	2439	2300	2300
q6	183	163	130	130
q7	912	761	611	611
q8	9324	1312	1068	1068
q9	6761	5130	5101	5101
q10	6889	2366	1983	1983
q11	490	290	275	275
q12	342	346	214	214
q13	17771	3725	3095	3095
q14	220	228	215	215
q15	560	476	473	473
q16	426	445	368	368
q17	603	880	353	353
q18	7460	7169	7171	7169
q19	1580	957	548	548
q20	332	348	226	226
q21	3840	3196	2392	2392
q22	1044	991	942	942
Total cold run time: 106532 ms
Total hot run time: 34084 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5151	5109	5109	5109
q2	246	325	217	217
q3	2140	2657	2301	2301
q4	1334	1775	1351	1351
q5	4260	4568	4593	4568
q6	219	166	126	126
q7	1965	1904	1761	1761
q8	2633	2536	2479	2479
q9	7393	7317	7273	7273
q10	3144	3348	2919	2919
q11	584	540	500	500
q12	673	747	615	615
q13	3872	3945	3332	3332
q14	299	312	285	285
q15	546	462	470	462
q16	448	506	446	446
q17	1174	1589	1407	1407
q18	7875	8028	7425	7425
q19	849	804	908	804
q20	2058	2114	1882	1882
q21	4684	4328	4311	4311
q22	1095	1036	1005	1005
Total cold run time: 52642 ms
Total hot run time: 50578 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186935 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d9ca8b6093427d102845ab938ff4dd667539a502, data reload: false

query1	1009	421	407	407
query2	6542	1662	1649	1649
query3	6736	211	212	211
query4	26292	23744	23854	23744
query5	4399	610	469	469
query6	304	218	211	211
query7	4621	508	295	295
query8	276	223	215	215
query9	8587	2641	2644	2641
query10	453	354	291	291
query11	15755	15207	14976	14976
query12	170	113	102	102
query13	1654	543	425	425
query14	8625	5847	5922	5847
query15	208	189	179	179
query16	7576	665	489	489
query17	1212	711	594	594
query18	2034	415	323	323
query19	198	210	184	184
query20	123	125	116	116
query21	211	132	112	112
query22	4043	4131	4107	4107
query23	33963	33253	32994	32994
query24	8586	2375	2369	2369
query25	531	491	395	395
query26	1229	267	149	149
query27	2759	538	347	347
query28	4311	2141	2120	2120
query29	747	560	436	436
query30	293	227	197	197
query31	928	842	787	787
query32	70	67	63	63
query33	550	355	326	326
query34	796	890	543	543
query35	780	805	755	755
query36	919	991	869	869
query37	112	103	85	85
query38	4207	4115	4093	4093
query39	1548	1438	1411	1411
query40	212	113	108	108
query41	55	56	50	50
query42	124	105	102	102
query43	501	523	466	466
query44	1371	834	817	817
query45	177	166	160	160
query46	831	1017	642	642
query47	1761	1781	1712	1712
query48	381	423	306	306
query49	745	494	398	398
query50	653	699	412	412
query51	4238	4230	4245	4230
query52	109	113	107	107
query53	231	262	192	192
query54	596	564	501	501
query55	85	79	82	79
query56	307	289	307	289
query57	1205	1208	1127	1127
query58	258	263	261	261
query59	2523	2628	2598	2598
query60	321	326	300	300
query61	130	123	150	123
query62	798	741	660	660
query63	224	182	185	182
query64	4285	1040	651	651
query65	4370	4245	4221	4221
query66	1105	417	317	317
query67	15664	15452	15318	15318
query68	8716	900	525	525
query69	467	307	275	275
query70	1148	1106	1116	1106
query71	456	340	291	291
query72	5343	4816	4859	4816
query73	735	648	351	351
query74	9168	9004	9003	9003
query75	4077	3207	2707	2707
query76	3627	1176	757	757
query77	781	387	297	297
query78	10540	10489	9685	9685
query79	2347	843	612	612
query80	636	532	448	448
query81	478	266	232	232
query82	471	132	96	96
query83	280	259	241	241
query84	296	108	83	83
query85	776	397	311	311
query86	337	293	285	285
query87	4595	4456	4290	4290
query88	2947	2295	2290	2290
query89	403	317	292	292
query90	1944	217	218	217
query91	139	141	111	111
query92	77	58	60	58
query93	1243	960	590	590
query94	684	415	305	305
query95	377	291	283	283
query96	504	581	282	282
query97	2796	2807	2692	2692
query98	221	200	203	200
query99	1402	1423	1349	1349
Total cold run time: 274628 ms
Total hot run time: 186935 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.37 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d9ca8b6093427d102845ab938ff4dd667539a502, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.24	0.08	0.08
query4	1.61	0.11	0.11
query5	0.45	0.44	0.41
query6	1.18	0.67	0.65
query7	0.02	0.01	0.02
query8	0.05	0.04	0.03
query9	0.59	0.52	0.53
query10	0.55	0.57	0.57
query11	0.15	0.11	0.11
query12	0.14	0.12	0.11
query13	0.61	0.62	0.61
query14	0.79	0.83	0.81
query15	0.91	0.86	0.87
query16	0.39	0.38	0.38
query17	1.07	1.08	1.09
query18	0.22	0.21	0.21
query19	2.01	1.83	1.98
query20	0.02	0.02	0.01
query21	15.37	0.91	0.53
query22	0.76	1.18	0.64
query23	15.00	1.36	0.56
query24	7.69	0.83	0.76
query25	0.51	0.23	0.08
query26	0.65	0.18	0.14
query27	0.05	0.04	0.04
query28	9.24	0.91	0.46
query29	12.56	3.95	3.30
query30	0.25	0.08	0.06
query31	2.84	0.60	0.38
query32	3.24	0.55	0.47
query33	3.03	3.12	3.09
query34	16.03	5.40	4.76
query35	4.79	4.85	4.83
query36	0.70	0.50	0.49
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.32 s
Total hot run time: 29.37 s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Jul 2, 2025

run buildall

@bobhan1
Copy link
Contributor Author

bobhan1 commented Jul 2, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33919 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e8e6bc8ed428eebf43f7646393ec17dc9f341726, data reload: false

------ Round 1 ----------------------------------
q1	17595	5184	5074	5074
q2	1951	284	207	207
q3	10486	1299	728	728
q4	10312	1076	530	530
q5	8594	2438	2350	2350
q6	193	162	134	134
q7	915	731	602	602
q8	9321	1301	1066	1066
q9	7547	5164	5150	5150
q10	6872	2418	1951	1951
q11	478	285	275	275
q12	340	346	216	216
q13	17761	3707	3059	3059
q14	226	232	219	219
q15	547	475	469	469
q16	414	417	384	384
q17	617	859	365	365
q18	7668	7136	7051	7051
q19	1362	964	539	539
q20	336	349	222	222
q21	3766	2596	2343	2343
q22	1074	1043	985	985
Total cold run time: 108375 ms
Total hot run time: 33919 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5127	5095	5085	5085
q2	245	326	228	228
q3	2155	2672	2292	2292
q4	1389	1791	1359	1359
q5	4301	4560	4605	4560
q6	212	163	126	126
q7	2016	1922	1860	1860
q8	2662	2820	2654	2654
q9	7415	7369	7428	7369
q10	3115	3170	2841	2841
q11	566	523	489	489
q12	719	798	648	648
q13	3609	4057	3358	3358
q14	299	306	278	278
q15	527	465	472	465
q16	440	501	446	446
q17	1297	1642	1382	1382
q18	8020	7859	7626	7626
q19	817	859	1097	859
q20	2009	2059	2041	2041
q21	4931	4736	4549	4549
q22	1143	1101	1055	1055
Total cold run time: 53014 ms
Total hot run time: 51570 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186305 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e8e6bc8ed428eebf43f7646393ec17dc9f341726, data reload: false

query1	1023	388	378	378
query2	6547	1632	1656	1632
query3	6736	215	210	210
query4	26064	23699	23024	23024
query5	4349	609	424	424
query6	315	217	194	194
query7	4627	533	296	296
query8	257	221	219	219
query9	8608	2642	2678	2642
query10	483	342	304	304
query11	15311	15016	14757	14757
query12	154	107	99	99
query13	1644	564	395	395
query14	8518	5660	5693	5660
query15	216	186	189	186
query16	7149	663	483	483
query17	1040	721	562	562
query18	1957	396	298	298
query19	189	222	158	158
query20	118	115	108	108
query21	220	126	102	102
query22	4243	4869	4631	4631
query23	34772	34086	33966	33966
query24	8491	2369	2346	2346
query25	558	462	392	392
query26	1223	277	146	146
query27	2751	557	340	340
query28	4297	2139	2118	2118
query29	777	573	463	463
query30	283	254	184	184
query31	894	830	738	738
query32	75	61	59	59
query33	539	375	302	302
query34	808	890	504	504
query35	810	828	725	725
query36	947	977	881	881
query37	106	134	73	73
query38	4257	4093	4078	4078
query39	1480	1400	1433	1400
query40	207	119	105	105
query41	54	52	49	49
query42	129	107	112	107
query43	503	495	457	457
query44	1351	819	811	811
query45	175	162	160	160
query46	899	1073	612	612
query47	1752	1810	1730	1730
query48	387	421	308	308
query49	742	483	384	384
query50	667	730	409	409
query51	4095	4175	4028	4028
query52	113	108	101	101
query53	231	261	189	189
query54	570	565	487	487
query55	83	82	80	80
query56	306	318	286	286
query57	1177	1221	1134	1134
query58	279	267	268	267
query59	2558	2716	2569	2569
query60	345	330	324	324
query61	159	145	146	145
query62	794	724	657	657
query63	236	198	192	192
query64	4492	1101	744	744
query65	4357	4170	4186	4170
query66	1155	417	309	309
query67	16022	15552	15414	15414
query68	8929	935	520	520
query69	496	301	273	273
query70	1195	1155	1116	1116
query71	485	348	297	297
query72	5594	4827	4889	4827
query73	707	660	348	348
query74	8929	9205	8840	8840
query75	4181	3203	2737	2737
query76	3703	1216	754	754
query77	755	377	302	302
query78	9930	10311	9412	9412
query79	1896	837	591	591
query80	632	512	444	444
query81	463	268	226	226
query82	431	130	101	101
query83	276	251	236	236
query84	298	111	84	84
query85	775	350	390	350
query86	331	317	256	256
query87	4450	4459	4304	4304
query88	2984	2297	2292	2292
query89	390	311	286	286
query90	1978	210	211	210
query91	136	142	111	111
query92	69	57	56	56
query93	1114	982	585	585
query94	672	410	309	309
query95	371	296	285	285
query96	512	609	285	285
query97	2705	2720	2687	2687
query98	222	211	205	205
query99	1503	1381	1271	1271
Total cold run time: 273786 ms
Total hot run time: 186305 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.32 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e8e6bc8ed428eebf43f7646393ec17dc9f341726, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.24	0.09	0.08
query4	1.60	0.10	0.11
query5	0.44	0.44	0.42
query6	1.20	0.67	0.66
query7	0.02	0.02	0.02
query8	0.04	0.04	0.04
query9	0.60	0.52	0.52
query10	0.58	0.56	0.57
query11	0.16	0.11	0.11
query12	0.14	0.11	0.12
query13	0.63	0.62	0.59
query14	0.82	0.81	0.81
query15	0.90	0.89	0.85
query16	0.38	0.39	0.40
query17	1.06	1.05	1.05
query18	0.22	0.22	0.21
query19	1.92	1.85	1.81
query20	0.01	0.02	0.01
query21	15.40	0.91	0.55
query22	0.76	1.20	0.73
query23	14.90	1.36	0.66
query24	7.30	1.27	0.47
query25	0.43	0.21	0.09
query26	0.59	0.17	0.15
query27	0.06	0.05	0.05
query28	9.25	0.90	0.44
query29	12.67	4.02	3.38
query30	0.25	0.09	0.07
query31	2.84	0.59	0.38
query32	3.25	0.55	0.47
query33	2.98	3.15	3.02
query34	16.16	5.46	4.81
query35	4.91	4.91	4.82
query36	0.69	0.51	0.48
query37	0.09	0.07	0.07
query38	0.05	0.05	0.04
query39	0.03	0.03	0.03
query40	0.19	0.15	0.13
query41	0.08	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.04
Total cold run time: 104.04 s
Total hot run time: 29.32 s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Jul 2, 2025

run buildall

@bobhan1 bobhan1 force-pushed the move-dbm-agg-cache branch from b25d8d0 to 4c51757 Compare July 2, 2025 13:38
@bobhan1
Copy link
Contributor Author

bobhan1 commented Jul 2, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33825 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4c517572876acc9b27fcc5827723d5beeaf25f06, data reload: false

------ Round 1 ----------------------------------
q1	17571	5492	5065	5065
q2	1930	295	172	172
q3	10463	1297	701	701
q4	10312	1033	513	513
q5	8704	2377	2306	2306
q6	197	161	128	128
q7	896	748	626	626
q8	9329	1297	1053	1053
q9	6871	5065	5140	5065
q10	6925	2368	1966	1966
q11	506	296	287	287
q12	347	357	211	211
q13	17774	3646	3029	3029
q14	219	226	203	203
q15	564	476	471	471
q16	422	421	382	382
q17	600	848	376	376
q18	7508	7223	7206	7206
q19	1333	943	547	547
q20	328	345	220	220
q21	3832	2542	2333	2333
q22	998	1025	965	965
Total cold run time: 107629 ms
Total hot run time: 33825 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5125	5267	5129	5129
q2	240	326	220	220
q3	2182	2707	2272	2272
q4	1368	1771	1310	1310
q5	4250	4613	4537	4537
q6	207	165	139	139
q7	2047	2002	1781	1781
q8	2655	2567	2572	2567
q9	7181	7205	7261	7205
q10	3126	3322	2886	2886
q11	576	526	502	502
q12	692	780	762	762
q13	3571	4055	3234	3234
q14	283	301	278	278
q15	515	482	498	482
q16	444	492	437	437
q17	1232	1629	1372	1372
q18	7998	7928	7323	7323
q19	783	748	810	748
q20	1908	1936	1825	1825
q21	4790	4362	4349	4349
q22	1075	1034	1025	1025
Total cold run time: 52248 ms
Total hot run time: 50383 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183919 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4c517572876acc9b27fcc5827723d5beeaf25f06, data reload: false

query1	981	380	376	376
query2	6542	1706	1722	1706
query3	6738	212	212	212
query4	26297	23386	22614	22614
query5	4370	574	417	417
query6	290	204	190	190
query7	4613	480	280	280
query8	298	205	194	194
query9	8627	2623	2633	2623
query10	458	334	261	261
query11	15581	15118	14857	14857
query12	159	105	97	97
query13	1652	528	397	397
query14	8677	5623	5651	5623
query15	198	190	182	182
query16	7235	608	424	424
query17	1201	709	591	591
query18	1980	406	308	308
query19	197	186	162	162
query20	116	126	114	114
query21	213	123	106	106
query22	4335	4151	4217	4151
query23	33939	32951	33075	32951
query24	8424	2360	2384	2360
query25	621	472	380	380
query26	1218	264	147	147
query27	2742	504	329	329
query28	4310	2126	2118	2118
query29	769	567	434	434
query30	284	216	190	190
query31	915	826	751	751
query32	70	63	58	58
query33	630	353	318	318
query34	784	824	528	528
query35	783	818	730	730
query36	930	971	896	896
query37	108	94	76	76
query38	4170	4058	4050	4050
query39	1478	1394	1447	1394
query40	213	114	100	100
query41	59	54	52	52
query42	128	110	108	108
query43	498	508	479	479
query44	1367	821	824	821
query45	178	165	155	155
query46	821	1009	626	626
query47	1784	1838	1706	1706
query48	377	406	309	309
query49	739	483	376	376
query50	620	677	406	406
query51	4082	4257	4081	4081
query52	114	104	97	97
query53	220	249	194	194
query54	558	554	497	497
query55	90	79	80	79
query56	309	285	269	269
query57	1169	1172	1125	1125
query58	258	248	257	248
query59	2557	2680	2499	2499
query60	321	318	311	311
query61	124	119	115	115
query62	821	716	659	659
query63	222	181	177	177
query64	4382	1037	650	650
query65	4268	4122	4146	4122
query66	1139	399	308	308
query67	15894	15638	15318	15318
query68	8050	863	511	511
query69	476	303	262	262
query70	1340	1128	1122	1122
query71	466	310	293	293
query72	5665	4775	4856	4775
query73	712	638	349	349
query74	9246	9231	8954	8954
query75	3800	3189	2691	2691
query76	3670	1127	705	705
query77	808	391	289	289
query78	10039	10076	9444	9444
query79	2796	807	569	569
query80	678	495	444	444
query81	484	250	217	217
query82	449	124	96	96
query83	281	257	230	230
query84	287	114	91	91
query85	809	355	318	318
query86	329	311	275	275
query87	4441	4400	4368	4368
query88	3519	2270	2279	2270
query89	399	314	277	277
query90	1940	202	204	202
query91	155	136	104	104
query92	123	59	53	53
query93	2042	916	579	579
query94	682	400	297	297
query95	372	288	278	278
query96	492	569	279	279
query97	2738	2735	2614	2614
query98	238	201	208	201
query99	1439	1402	1280	1280
Total cold run time: 275210 ms
Total hot run time: 183919 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.68 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4c517572876acc9b27fcc5827723d5beeaf25f06, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.05
query3	0.25	0.08	0.08
query4	1.61	0.11	0.10
query5	0.43	0.44	0.41
query6	1.15	0.65	0.66
query7	0.03	0.02	0.02
query8	0.04	0.04	0.04
query9	0.62	0.50	0.52
query10	0.57	0.56	0.56
query11	0.16	0.11	0.11
query12	0.15	0.11	0.11
query13	0.63	0.62	0.60
query14	0.81	0.81	0.82
query15	0.91	0.87	0.87
query16	0.38	0.39	0.41
query17	1.06	1.07	1.08
query18	0.22	0.22	0.20
query19	1.95	1.84	1.81
query20	0.01	0.01	0.01
query21	15.42	0.87	0.54
query22	0.76	1.21	0.65
query23	14.92	1.36	0.60
query24	7.46	1.23	1.02
query25	0.54	0.23	0.08
query26	0.57	0.16	0.14
query27	0.07	0.06	0.05
query28	9.58	0.90	0.44
query29	12.62	4.02	3.34
query30	0.26	0.10	0.06
query31	2.84	0.58	0.39
query32	3.25	0.56	0.49
query33	3.01	3.13	3.09
query34	16.02	5.34	4.75
query35	4.80	4.86	4.79
query36	0.71	0.50	0.49
query37	0.09	0.07	0.07
query38	0.06	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.15	0.13
query41	0.08	0.03	0.03
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.44 s
Total hot run time: 29.68 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 83.33% (25/30) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 57.15% (15397/26940)
Line Coverage 46.17% (139639/302434)
Region Coverage 45.49% (70789/155615)
Branch Coverage 40.24% (37347/92820)

@shuke987
Copy link
Collaborator

shuke987 commented Jul 3, 2025

run cloud_p0

@shuke987 shuke987 requested review from mymeiyi and zhannngchen and removed request for mymeiyi and zhannngchen July 3, 2025 03:26
@hello-stephen hello-stephen merged commit cc6c9ac into apache:master Jul 3, 2025
28 of 30 checks passed
github-actions bot pushed a commit that referenced this pull request Jul 3, 2025
### What problem does this PR solve?

fix #52596, DeleteBitmapAggCache
should be destructed before CacheManager
```
SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior /root/doris/be/src/runtime/memory/cache_policy.cpp:35:31 
*** Query id: 0-0 ***
*** is nereids: 0 ***
*** tablet id: 0 ***
*** Aborted at 1751405577 (unix time) try "date -d @1751405577" if you are using GNU date ***
*** Current BE git commitID: cd35cf0eb5 ***
*** SIGSEGV address not mapped to object (@0x10) received by PID 15013 (TID 15013 OR 0x7fced202a4c0) from PID 16; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris/be/src/common/signal_handler.h:420
 1# PosixSignals::chained_handler(int, siginfo_t*, void*) [clone .part.0] in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 3# 0x00007FCED2404090 in /lib/x86_64-linux-gnu/libc.so.6
 4# __pthread_mutex_lock at ../nptl/pthread_mutex_lock.c:67
 5# doris::CacheManager::unregister_cache(doris::CachePolicy::CacheType) at /root/doris/be/src/runtime/memory/cache_manager.h:56
 6# doris::CachePolicy::~CachePolicy() at /root/doris/be/src/runtime/memory/cache_policy.cpp:36
 7# doris::DeleteBitmap::AggCachePolicy::~AggCachePolicy() at /root/doris/be/src/olap/tablet_meta.h:568
 8# __run_exit_handlers at /build/glibc-SzIz7B/glibc-2.31/stdlib/exit.c:109
 9# on_exit at /build/glibc-SzIz7B/glibc-2.31/stdlib/on_exit.c:26
10# __libc_start_main at ../csu/libc-start.c:261
11# _start in /home/work/unlimit_teamcity/TeamCity/Agents/20250702042258agent_172.16.0.200_1/work/60183217f6ee2a9c/output/be/lib/doris_be
bobhan1 added a commit to bobhan1/doris that referenced this pull request Jul 3, 2025
fix apache#52596, DeleteBitmapAggCache
should be destructed before CacheManager
```
SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior /root/doris/be/src/runtime/memory/cache_policy.cpp:35:31
*** Query id: 0-0 ***
*** is nereids: 0 ***
*** tablet id: 0 ***
*** Aborted at 1751405577 (unix time) try "date -d @1751405577" if you are using GNU date ***
*** Current BE git commitID: cd35cf0eb5 ***
*** SIGSEGV address not mapped to object (@0x10) received by PID 15013 (TID 15013 OR 0x7fced202a4c0) from PID 16; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris/be/src/common/signal_handler.h:420
 1# PosixSignals::chained_handler(int, siginfo_t*, void*) [clone .part.0] in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 3# 0x00007FCED2404090 in /lib/x86_64-linux-gnu/libc.so.6
 4# __pthread_mutex_lock at ../nptl/pthread_mutex_lock.c:67
 5# doris::CacheManager::unregister_cache(doris::CachePolicy::CacheType) at /root/doris/be/src/runtime/memory/cache_manager.h:56
 6# doris::CachePolicy::~CachePolicy() at /root/doris/be/src/runtime/memory/cache_policy.cpp:36
 7# doris::DeleteBitmap::AggCachePolicy::~AggCachePolicy() at /root/doris/be/src/olap/tablet_meta.h:568
 8# __run_exit_handlers at /build/glibc-SzIz7B/glibc-2.31/stdlib/exit.c:109
 9# on_exit at /build/glibc-SzIz7B/glibc-2.31/stdlib/on_exit.c:26
10# __libc_start_main at ../csu/libc-start.c:261
11# _start in /home/work/unlimit_teamcity/TeamCity/Agents/20250702042258agent_172.16.0.200_1/work/60183217f6ee2a9c/output/be/lib/doris_be
bobhan1 added a commit to bobhan1/doris that referenced this pull request Jul 3, 2025
fix apache#52596, DeleteBitmapAggCache
should be destructed before CacheManager
```
SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior /root/doris/be/src/runtime/memory/cache_policy.cpp:35:31
*** Query id: 0-0 ***
*** is nereids: 0 ***
*** tablet id: 0 ***
*** Aborted at 1751405577 (unix time) try "date -d @1751405577" if you are using GNU date ***
*** Current BE git commitID: cd35cf0eb5 ***
*** SIGSEGV address not mapped to object (@0x10) received by PID 15013 (TID 15013 OR 0x7fced202a4c0) from PID 16; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris/be/src/common/signal_handler.h:420
 1# PosixSignals::chained_handler(int, siginfo_t*, void*) [clone .part.0] in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 3# 0x00007FCED2404090 in /lib/x86_64-linux-gnu/libc.so.6
 4# __pthread_mutex_lock at ../nptl/pthread_mutex_lock.c:67
 5# doris::CacheManager::unregister_cache(doris::CachePolicy::CacheType) at /root/doris/be/src/runtime/memory/cache_manager.h:56
 6# doris::CachePolicy::~CachePolicy() at /root/doris/be/src/runtime/memory/cache_policy.cpp:36
 7# doris::DeleteBitmap::AggCachePolicy::~AggCachePolicy() at /root/doris/be/src/olap/tablet_meta.h:568
 8# __run_exit_handlers at /build/glibc-SzIz7B/glibc-2.31/stdlib/exit.c:109
 9# on_exit at /build/glibc-SzIz7B/glibc-2.31/stdlib/on_exit.c:26
10# __libc_start_main at ../csu/libc-start.c:261
11# _start in /home/work/unlimit_teamcity/TeamCity/Agents/20250702042258agent_172.16.0.200_1/work/60183217f6ee2a9c/output/be/lib/doris_be
morrySnow pushed a commit that referenced this pull request Jul 4, 2025
#52705)

Cherry-picked from #52649

Co-authored-by: bobhan1 <baohan@selectdb.com>
koarz pushed a commit to koarz/doris that referenced this pull request Jul 4, 2025
### What problem does this PR solve?

fix apache#52596, DeleteBitmapAggCache
should be destructed before CacheManager
```
SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior /root/doris/be/src/runtime/memory/cache_policy.cpp:35:31 
*** Query id: 0-0 ***
*** is nereids: 0 ***
*** tablet id: 0 ***
*** Aborted at 1751405577 (unix time) try "date -d @1751405577" if you are using GNU date ***
*** Current BE git commitID: cd35cf0eb5 ***
*** SIGSEGV address not mapped to object (@0x10) received by PID 15013 (TID 15013 OR 0x7fced202a4c0) from PID 16; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris/be/src/common/signal_handler.h:420
 1# PosixSignals::chained_handler(int, siginfo_t*, void*) [clone .part.0] in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 3# 0x00007FCED2404090 in /lib/x86_64-linux-gnu/libc.so.6
 4# __pthread_mutex_lock at ../nptl/pthread_mutex_lock.c:67
 5# doris::CacheManager::unregister_cache(doris::CachePolicy::CacheType) at /root/doris/be/src/runtime/memory/cache_manager.h:56
 6# doris::CachePolicy::~CachePolicy() at /root/doris/be/src/runtime/memory/cache_policy.cpp:36
 7# doris::DeleteBitmap::AggCachePolicy::~AggCachePolicy() at /root/doris/be/src/olap/tablet_meta.h:568
 8# __run_exit_handlers at /build/glibc-SzIz7B/glibc-2.31/stdlib/exit.c:109
 9# on_exit at /build/glibc-SzIz7B/glibc-2.31/stdlib/on_exit.c:26
10# __libc_start_main at ../csu/libc-start.c:261
11# _start in /home/work/unlimit_teamcity/TeamCity/Agents/20250702042258agent_172.16.0.200_1/work/60183217f6ee2a9c/output/be/lib/doris_be
koarz pushed a commit to koarz/doris that referenced this pull request Jul 4, 2025
### What problem does this PR solve?

fix apache#52596, DeleteBitmapAggCache
should be destructed before CacheManager
```
SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior /root/doris/be/src/runtime/memory/cache_policy.cpp:35:31 
*** Query id: 0-0 ***
*** is nereids: 0 ***
*** tablet id: 0 ***
*** Aborted at 1751405577 (unix time) try "date -d @1751405577" if you are using GNU date ***
*** Current BE git commitID: cd35cf0eb5 ***
*** SIGSEGV address not mapped to object (@0x10) received by PID 15013 (TID 15013 OR 0x7fced202a4c0) from PID 16; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris/be/src/common/signal_handler.h:420
 1# PosixSignals::chained_handler(int, siginfo_t*, void*) [clone .part.0] in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 3# 0x00007FCED2404090 in /lib/x86_64-linux-gnu/libc.so.6
 4# __pthread_mutex_lock at ../nptl/pthread_mutex_lock.c:67
 5# doris::CacheManager::unregister_cache(doris::CachePolicy::CacheType) at /root/doris/be/src/runtime/memory/cache_manager.h:56
 6# doris::CachePolicy::~CachePolicy() at /root/doris/be/src/runtime/memory/cache_policy.cpp:36
 7# doris::DeleteBitmap::AggCachePolicy::~AggCachePolicy() at /root/doris/be/src/olap/tablet_meta.h:568
 8# __run_exit_handlers at /build/glibc-SzIz7B/glibc-2.31/stdlib/exit.c:109
 9# on_exit at /build/glibc-SzIz7B/glibc-2.31/stdlib/on_exit.c:26
10# __libc_start_main at ../csu/libc-start.c:261
11# _start in /home/work/unlimit_teamcity/TeamCity/Agents/20250702042258agent_172.16.0.200_1/work/60183217f6ee2a9c/output/be/lib/doris_be
koarz pushed a commit to koarz/doris that referenced this pull request Jul 4, 2025
### What problem does this PR solve?

fix apache#52596, DeleteBitmapAggCache
should be destructed before CacheManager
```
SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior /root/doris/be/src/runtime/memory/cache_policy.cpp:35:31 
*** Query id: 0-0 ***
*** is nereids: 0 ***
*** tablet id: 0 ***
*** Aborted at 1751405577 (unix time) try "date -d @1751405577" if you are using GNU date ***
*** Current BE git commitID: cd35cf0eb5 ***
*** SIGSEGV address not mapped to object (@0x10) received by PID 15013 (TID 15013 OR 0x7fced202a4c0) from PID 16; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris/be/src/common/signal_handler.h:420
 1# PosixSignals::chained_handler(int, siginfo_t*, void*) [clone .part.0] in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 3# 0x00007FCED2404090 in /lib/x86_64-linux-gnu/libc.so.6
 4# __pthread_mutex_lock at ../nptl/pthread_mutex_lock.c:67
 5# doris::CacheManager::unregister_cache(doris::CachePolicy::CacheType) at /root/doris/be/src/runtime/memory/cache_manager.h:56
 6# doris::CachePolicy::~CachePolicy() at /root/doris/be/src/runtime/memory/cache_policy.cpp:36
 7# doris::DeleteBitmap::AggCachePolicy::~AggCachePolicy() at /root/doris/be/src/olap/tablet_meta.h:568
 8# __run_exit_handlers at /build/glibc-SzIz7B/glibc-2.31/stdlib/exit.c:109
 9# on_exit at /build/glibc-SzIz7B/glibc-2.31/stdlib/on_exit.c:26
10# __libc_start_main at ../csu/libc-start.c:261
11# _start in /home/work/unlimit_teamcity/TeamCity/Agents/20250702042258agent_172.16.0.200_1/work/60183217f6ee2a9c/output/be/lib/doris_be
seawinde pushed a commit to seawinde/doris that referenced this pull request Jul 4, 2025
### What problem does this PR solve?

fix apache#52596, DeleteBitmapAggCache
should be destructed before CacheManager
```
SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior /root/doris/be/src/runtime/memory/cache_policy.cpp:35:31 
*** Query id: 0-0 ***
*** is nereids: 0 ***
*** tablet id: 0 ***
*** Aborted at 1751405577 (unix time) try "date -d @1751405577" if you are using GNU date ***
*** Current BE git commitID: cd35cf0eb5 ***
*** SIGSEGV address not mapped to object (@0x10) received by PID 15013 (TID 15013 OR 0x7fced202a4c0) from PID 16; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris/be/src/common/signal_handler.h:420
 1# PosixSignals::chained_handler(int, siginfo_t*, void*) [clone .part.0] in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 3# 0x00007FCED2404090 in /lib/x86_64-linux-gnu/libc.so.6
 4# __pthread_mutex_lock at ../nptl/pthread_mutex_lock.c:67
 5# doris::CacheManager::unregister_cache(doris::CachePolicy::CacheType) at /root/doris/be/src/runtime/memory/cache_manager.h:56
 6# doris::CachePolicy::~CachePolicy() at /root/doris/be/src/runtime/memory/cache_policy.cpp:36
 7# doris::DeleteBitmap::AggCachePolicy::~AggCachePolicy() at /root/doris/be/src/olap/tablet_meta.h:568
 8# __run_exit_handlers at /build/glibc-SzIz7B/glibc-2.31/stdlib/exit.c:109
 9# on_exit at /build/glibc-SzIz7B/glibc-2.31/stdlib/on_exit.c:26
10# __libc_start_main at ../csu/libc-start.c:261
11# _start in /home/work/unlimit_teamcity/TeamCity/Agents/20250702042258agent_172.16.0.200_1/work/60183217f6ee2a9c/output/be/lib/doris_be
bobhan1 added a commit to bobhan1/doris that referenced this pull request Jul 7, 2025
fix apache#52596, DeleteBitmapAggCache
should be destructed before CacheManager
```
SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior /root/doris/be/src/runtime/memory/cache_policy.cpp:35:31
*** Query id: 0-0 ***
*** is nereids: 0 ***
*** tablet id: 0 ***
*** Aborted at 1751405577 (unix time) try "date -d @1751405577" if you are using GNU date ***
*** Current BE git commitID: cd35cf0eb5 ***
*** SIGSEGV address not mapped to object (@0x10) received by PID 15013 (TID 15013 OR 0x7fced202a4c0) from PID 16; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris/be/src/common/signal_handler.h:420
 1# PosixSignals::chained_handler(int, siginfo_t*, void*) [clone .part.0] in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 2# JVM_handle_linux_signal in /usr/lib/jvm/java-17-openjdk-amd64/lib/server/libjvm.so
 3# 0x00007FCED2404090 in /lib/x86_64-linux-gnu/libc.so.6
 4# __pthread_mutex_lock at ../nptl/pthread_mutex_lock.c:67
 5# doris::CacheManager::unregister_cache(doris::CachePolicy::CacheType) at /root/doris/be/src/runtime/memory/cache_manager.h:56
 6# doris::CachePolicy::~CachePolicy() at /root/doris/be/src/runtime/memory/cache_policy.cpp:36
 7# doris::DeleteBitmap::AggCachePolicy::~AggCachePolicy() at /root/doris/be/src/olap/tablet_meta.h:568
 8# __run_exit_handlers at /build/glibc-SzIz7B/glibc-2.31/stdlib/exit.c:109
 9# on_exit at /build/glibc-SzIz7B/glibc-2.31/stdlib/on_exit.c:26
10# __libc_start_main at ../csu/libc-start.c:261
11# _start in /home/work/unlimit_teamcity/TeamCity/Agents/20250702042258agent_172.16.0.200_1/work/60183217f6ee2a9c/output/be/lib/doris_be
etah000 pushed a commit to etah000/doris that referenced this pull request Jul 7, 2025
…e#52649 (apache#52705)

Cherry-picked from apache#52649

Co-authored-by: bobhan1 <baohan@selectdb.com>
dataroaring pushed a commit that referenced this pull request Jul 8, 2025
yiguolei pushed a commit that referenced this pull request Jul 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants