Skip to content

Conversation

@mrhhsg
Copy link
Member

@mrhhsg mrhhsg commented Mar 19, 2025

What problem does this PR solve?

==8578==ERROR: AddressSanitizer: global-buffer-overflow on address 0x5612d9af6be0 at pc 0x56130d816170 bp 0x7f1d4400bcb0 sp 0x7f1d4400bca8
READ of size 1 at 0x5612d9af6be0 thread T2081 (Scan_normal [wo)
    #0 0x56130d81616f in doris::validate_ascii_fast_avx(char const*, unsigned long) /root/doris/be/src/util/simd/vstring_function.h:92:27
    #1 0x56130d96dd9b in doris::simd::VStringFunctions::is_ascii(doris::StringRef const&) /root/doris/be/src/util/simd/vstring_function.h:210:16
    #2 0x56130d96dd9b in auto doris::vectorized::SubReplaceImpl::replace_execute(doris::vectorized::Block&, std::vector> const&, unsigned long, unsigned long)::'lambda'(auto, auto, auto, auto)::operator(), std::integral_constant, std::integral_constant, std::integral_constant>(auto, auto, auto, auto) const /root/doris/be/src/vec/functions/function_string.h:3474:25
    #3 0x56130d95d64e in decltype(auto) std::visit> const&, unsigned long, unsigned long)::'lambda'(auto, auto, auto, auto), std::variant, std::integral_constant>, std::variant, std::integral_constant>, std::variant, std::integral_constant>, std::variant, std::integral_constant>>(auto&&, std::variant, std::integral_constant>&&, std::variant, std::integral_constant>&&, std::variant, std::integral_constant>&&, std::variant, std::integral_constant>&&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/variant:1769:9
    #4 0x56130d95d64e in doris::vectorized::SubReplaceImpl::replace_execute(doris::vectorized::Block&, std::vector> const&, unsigned long, unsigned long) /root/doris/be/src/vec/functions/function_string.h:3472:9
    #5 0x56130d95be14 in doris::vectorized::SubReplaceThreeImpl::execute_impl(doris::FunctionContext*, doris::vectorized::Block&, std::vector> const&, unsigned long, unsigned long) /root/doris/be/src/vec/functions/function_string.h:3596:16
    #6 0x56130d959f97 in doris::vectorized::FunctionSubReplace::execute_impl(doris::FunctionContext*, doris::vectorized::Block&, std::vector> const&, unsigned long, unsigned long) const /root/doris/be/src/vec/functions/function_string.h:3449:16
    #7 0x5613046320fa in doris::vectorized::DefaultExecutable::execute_impl(doris::FunctionContext*, doris::vectorized::Block&, std::vector> const&, unsigned long, unsigned long) const /root/doris/be/src/vec/functions/function.h:464:26
    #8 0x561308ff0ce0 in doris::vectorized::PreparedFunctionImpl::_execute_skipped_constant_deal(doris::FunctionContext*, doris::vectorized::Block&, std::vector> const&, unsigned long, unsigned long, bool) const /root/doris/be/src/vec/functions/function.cpp
    #9 0x561308fe36ae in doris::vectorized::PreparedFunctionImpl::execute_without_low_cardinality_columns(doris::FunctionContext*, doris::vectorized::Block&, std::vector> const&, unsigned long, unsigned long, bool) const /root/doris/be/src/vec/functions/function.cpp:245:12
    #10 0x561308fe2b2c in doris::vectorized::PreparedFunctionImpl::default_implementation_for_nulls(doris::FunctionContext*, doris::vectorized::Block&, std::vector> const&, unsigned long, unsigned long, bool, bool*) const /root/doris/be/src/vec/functions/function.cpp:217:9
    #11 0x561308ff0b2e in doris::vectorized::PreparedFunctionImpl::_execute_skipped_constant_deal(doris::FunctionContext*, doris::vectorized::Block&, std::vector> const&, unsigned long, unsigned long, bool) const /root/doris/be/src/vec/functions/function.cpp:111:5
    #12 0x561308fe36ae in doris::vectorized::PreparedFunctionImpl::execute_without_low_cardinality_columns(doris::FunctionContext*, doris::vectorized::Block&, std::vector> const&, unsigned long, unsigned long, bool) const /root/doris/be/src/vec/functions/function.cpp:245:12
    #13 0x561308fe3922 in doris::vectorized::PreparedFunctionImpl::execute(doris::FunctionContext*, doris::vectorized::Block&, std::vector> const&, unsigned long, unsigned long, bool) const /root/doris/be/src/vec/functions/function.cpp:251:12
    #14 0x56130462f8f8 in doris::vectorized::IFunctionBase::execute(doris::FunctionContext*, doris::vectorized::Block&, std::vector> const&, unsigned long, unsigned long, bool) const /root/doris/be/src/vec/functions/function.h:195:19
    #15 0x56130462173c in doris::vectorized::VectorizedFnCall::_do_execute(doris::vectorized::VExprContext*, doris::vectorized::Block*, int*, std::vector>&) /root/doris/be/src/vec/exprs/vectorized_fn_call.cpp:190:5
    #16 0x561304622255 in doris::vectorized::VectorizedFnCall::execute(doris::vectorized::VExprContext*, doris::vectorized::Block*, int*) /root/doris/be/src/vec/exprs/vectorized_fn_call.cpp:205:12
    #17 0x5613046e569c in doris::vectorized::VExprContext::execute(doris::vectorized::Block*, int*) /root/doris/be/src/vec/exprs/vexpr_context.cpp:55:5
    #18 0x5613045cab0f in doris::vectorized::VScanner::_do_projections(doris::vectorized::Block*, doris::vectorized::Block*) /root/doris/be/src/vec/exec/scan/vscanner.cpp:197:9
    #19 0x5613045c701e in doris::vectorized::VScanner::get_block_after_projects(doris::RuntimeState*, doris::vectorized::Block*, bool*) /root/doris/be/src/vec/exec/scan/vscanner.cpp:83:16
    #20 0x561304584d3b in doris::vectorized::ScannerScheduler::_scanner_scan(std::shared_ptr, std::shared_ptr) /root/doris/be/src/vec/exec/scan/scanner_scheduler.cpp:221:5
    #21 0x561304588c8e in doris::vectorized::ScannerScheduler::submit(std::shared_ptr, std::shared_ptr)::$_1::operator()() const::'lambda'()::operator()() const::'lambda'()::operator()() const /root/doris/be/src/vec/exec/scan/scanner_scheduler.cpp:154:21
    #22 0x561304588c8e in doris::vectorized::ScannerScheduler::submit(std::shared_ptr, std::shared_ptr)::$_1::operator()() const::'lambda'()::operator()() const /root/doris/be/src/vec/exec/scan/scanner_scheduler.cpp:153:31
    #23 0x561304588c8e in void std::__invoke_impl, std::shared_ptr)::$_1::operator()() const::'lambda'()&>(std::__invoke_other, doris::vectorized::ScannerScheduler::submit(std::shared_ptr, std::shared_ptr)::$_1::operator()() const::'lambda'()&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:61:14
    #24 0x561304588c8e in std::enable_if, std::shared_ptr)::$_1::operator()() const::'lambda'()&>, void>::type std::__invoke_r, std::shared_ptr)::$_1::operator()() const::'lambda'()&>(doris::vectorized::ScannerScheduler::submit(std::shared_ptr, std::shared_ptr)::$_1::operator()() const::'lambda'()&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:111:2
    #25 0x561304588c8e in std::_Function_handler, std::shared_ptr)::$_1::operator()() const::'lambda'()>::_M_invoke(std::_Any_data const&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:291:9
    #26 0x5612e924be29 in doris::ThreadPool::dispatch_thread() /root/doris/be/src/util/threadpool.cpp:599:24
    #27 0x5612e92227b7 in doris::Thread::supervise_thread(void*) /root/doris/be/src/util/thread.cpp:498:5
    #28 0x7f2722294ac2 in start_thread nptl/pthread_create.c:442:8
    #29 0x7f272232684f  misc/../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Mar 19, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@mrhhsg
Copy link
Member Author

mrhhsg commented Mar 19, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32219 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 17a387d3f0961763b96a6496d15fca8a7ebf2036, data reload: false

------ Round 1 ----------------------------------
q1	23828	5083	4991	4991
q2	2037	280	165	165
q3	10446	1241	742	742
q4	10215	1026	521	521
q5	7658	2327	2364	2327
q6	182	157	128	128
q7	899	763	609	609
q8	9305	1244	1081	1081
q9	4882	4884	4699	4699
q10	6864	2317	1898	1898
q11	490	268	264	264
q12	347	346	219	219
q13	17759	3674	3065	3065
q14	227	240	203	203
q15	535	495	486	486
q16	605	602	572	572
q17	564	863	332	332
q18	6750	6340	6298	6298
q19	1223	944	537	537
q20	321	327	193	193
q21	2753	2084	1899	1899
q22	1032	1023	990	990
Total cold run time: 108922 ms
Total hot run time: 32219 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5168	5108	5141	5108
q2	228	324	244	244
q3	2200	2675	2283	2283
q4	1409	1773	1404	1404
q5	4217	4090	4287	4090
q6	210	171	124	124
q7	1989	1922	1781	1781
q8	2650	2582	2530	2530
q9	7246	7202	7260	7202
q10	2991	3199	2767	2767
q11	565	491	487	487
q12	699	755	622	622
q13	3547	3873	3260	3260
q14	275	284	273	273
q15	520	473	477	473
q16	657	687	659	659
q17	1146	1538	1393	1393
q18	7683	7603	7499	7499
q19	806	778	789	778
q20	1982	2035	1866	1866
q21	5472	4781	4885	4781
q22	1135	1056	1047	1047
Total cold run time: 52795 ms
Total hot run time: 50671 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191716 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 17a387d3f0961763b96a6496d15fca8a7ebf2036, data reload: false

query1	1453	1070	1020	1020
query2	6170	1970	1935	1935
query3	11118	4657	4546	4546
query4	25284	23733	23487	23487
query5	4797	661	490	490
query6	299	202	184	184
query7	3980	521	291	291
query8	307	245	235	235
query9	8513	2618	2610	2610
query10	503	299	256	256
query11	15600	15114	14986	14986
query12	170	112	108	108
query13	1562	515	394	394
query14	9775	6130	6115	6115
query15	210	194	171	171
query16	7620	631	477	477
query17	1172	723	571	571
query18	2026	431	315	315
query19	189	182	161	161
query20	125	115	118	115
query21	201	127	112	112
query22	4504	4745	4321	4321
query23	34017	33475	33461	33461
query24	8533	2399	2459	2399
query25	489	453	383	383
query26	1180	298	157	157
query27	2904	510	323	323
query28	5068	2474	2434	2434
query29	723	607	425	425
query30	280	218	185	185
query31	911	853	788	788
query32	69	63	62	62
query33	542	392	303	303
query34	790	897	495	495
query35	832	872	750	750
query36	1002	988	896	896
query37	120	99	80	80
query38	4184	4188	4075	4075
query39	1466	1426	1410	1410
query40	211	131	106	106
query41	53	52	48	48
query42	123	103	102	102
query43	512	518	496	496
query44	1311	810	803	803
query45	179	174	163	163
query46	839	1026	636	636
query47	1836	1877	1763	1763
query48	387	423	306	306
query49	756	502	428	428
query50	704	761	414	414
query51	4232	4340	4312	4312
query52	109	107	92	92
query53	235	272	190	190
query54	494	516	426	426
query55	92	78	76	76
query56	276	267	250	250
query57	1159	1186	1100	1100
query58	252	239	243	239
query59	2738	2736	2887	2736
query60	294	289	260	260
query61	121	112	118	112
query62	808	737	671	671
query63	227	192	186	186
query64	4409	1033	670	670
query65	4482	4450	4462	4450
query66	1059	403	297	297
query67	16163	15346	15632	15346
query68	8330	851	499	499
query69	470	298	254	254
query70	1190	1119	1109	1109
query71	441	290	249	249
query72	5739	3571	3726	3571
query73	741	739	342	342
query74	8959	9075	8871	8871
query75	3837	3155	2681	2681
query76	3523	1179	743	743
query77	797	356	277	277
query78	9896	10125	9344	9344
query79	1894	877	590	590
query80	691	537	443	443
query81	472	253	220	220
query82	199	125	92	92
query83	166	164	149	149
query84	230	91	76	76
query85	740	345	305	305
query86	333	291	282	282
query87	4394	4536	4315	4315
query88	3804	2301	2280	2280
query89	392	314	278	278
query90	1972	213	218	213
query91	137	137	109	109
query92	76	57	56	56
query93	1507	1079	582	582
query94	635	411	305	305
query95	361	272	262	262
query96	480	557	286	286
query97	3246	3369	3262	3262
query98	229	205	201	201
query99	1326	1387	1266	1266
Total cold run time: 279956 ms
Total hot run time: 191716 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.49 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 17a387d3f0961763b96a6496d15fca8a7ebf2036, data reload: false

query1	0.04	0.04	0.04
query2	0.12	0.11	0.11
query3	0.24	0.20	0.20
query4	1.59	0.20	0.18
query5	0.59	0.59	0.61
query6	1.17	0.71	0.72
query7	0.02	0.02	0.02
query8	0.04	0.04	0.04
query9	0.59	0.52	0.53
query10	0.57	0.60	0.57
query11	0.16	0.10	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.60
query14	2.83	2.68	2.75
query15	0.94	0.86	0.85
query16	0.39	0.38	0.39
query17	1.01	1.03	1.02
query18	0.22	0.19	0.19
query19	1.91	2.01	1.78
query20	0.02	0.01	0.01
query21	15.36	0.89	0.54
query22	0.77	1.28	0.93
query23	14.71	1.38	0.61
query24	6.81	0.89	2.17
query25	0.51	0.25	0.09
query26	0.53	0.14	0.14
query27	0.05	0.06	0.05
query28	10.79	0.88	0.44
query29	12.53	4.03	3.35
query30	0.26	0.09	0.06
query31	2.83	0.59	0.38
query32	3.25	0.54	0.47
query33	2.99	2.97	3.01
query34	15.85	5.15	4.55
query35	4.55	4.54	4.51
query36	0.67	0.50	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.17	0.14	0.13
query41	0.09	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.16 s
Total hot run time: 31.49 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 100.00% (2/2) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 48.82% (13075/26784)
Line Coverage 38.41% (112828/293710)
Region Coverage 37.19% (57326/154140)
Branch Coverage 32.30% (28827/89240)

@mrhhsg
Copy link
Member Author

mrhhsg commented Mar 20, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32053 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 17a387d3f0961763b96a6496d15fca8a7ebf2036, data reload: false

------ Round 1 ----------------------------------
q1	23831	5457	5013	5013
q2	2045	309	195	195
q3	10351	1212	656	656
q4	10230	990	529	529
q5	7511	2353	2323	2323
q6	188	160	130	130
q7	899	735	588	588
q8	9292	1223	1071	1071
q9	4851	4630	4858	4630
q10	6819	2299	1903	1903
q11	485	273	259	259
q12	345	357	214	214
q13	17776	3691	3097	3097
q14	240	233	214	214
q15	531	481	474	474
q16	626	619	594	594
q17	564	863	339	339
q18	6655	6580	6198	6198
q19	1827	945	569	569
q20	327	328	189	189
q21	2723	2108	1895	1895
q22	1043	1002	973	973
Total cold run time: 109159 ms
Total hot run time: 32053 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5194	5122	5095	5095
q2	239	329	236	236
q3	2143	2672	2295	2295
q4	1411	1815	1350	1350
q5	4227	4158	4330	4158
q6	230	175	128	128
q7	2046	1919	1791	1791
q8	2634	2589	2531	2531
q9	7259	7216	7246	7216
q10	3022	3173	2665	2665
q11	570	504	510	504
q12	660	761	606	606
q13	3516	3859	3318	3318
q14	308	287	265	265
q15	524	475	479	475
q16	638	704	672	672
q17	1153	1600	1330	1330
q18	7765	7560	7591	7560
q19	797	854	905	854
q20	1973	2009	1902	1902
q21	5392	4811	4797	4797
q22	1126	1074	1046	1046
Total cold run time: 52827 ms
Total hot run time: 50794 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192093 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 17a387d3f0961763b96a6496d15fca8a7ebf2036, data reload: false

query1	1413	1065	1012	1012
query2	6180	1947	1938	1938
query3	11145	4648	4616	4616
query4	26164	23731	23206	23206
query5	4317	624	467	467
query6	299	197	209	197
query7	3985	491	291	291
query8	295	255	249	249
query9	8520	2591	2580	2580
query10	453	306	251	251
query11	15327	15012	14838	14838
query12	159	109	103	103
query13	1553	510	378	378
query14	9296	6135	6250	6135
query15	222	180	171	171
query16	7282	617	465	465
query17	1165	696	580	580
query18	1947	411	327	327
query19	191	183	170	170
query20	129	136	120	120
query21	230	127	111	111
query22	4571	4665	4526	4526
query23	34212	33345	33404	33345
query24	8004	2404	2413	2404
query25	513	455	397	397
query26	1173	276	158	158
query27	2481	492	325	325
query28	4823	2432	2387	2387
query29	716	572	436	436
query30	272	227	199	199
query31	945	873	803	803
query32	70	60	64	60
query33	531	364	310	310
query34	806	855	541	541
query35	819	841	759	759
query36	992	1010	923	923
query37	119	101	72	72
query38	4201	4262	4206	4206
query39	1459	1431	1454	1431
query40	206	117	104	104
query41	54	51	50	50
query42	124	103	110	103
query43	514	519	477	477
query44	1323	816	798	798
query45	185	175	167	167
query46	847	1030	650	650
query47	1842	1902	1807	1807
query48	382	423	319	319
query49	767	509	428	428
query50	706	740	421	421
query51	4301	4310	4318	4310
query52	106	100	96	96
query53	231	268	191	191
query54	495	505	411	411
query55	87	82	77	77
query56	286	273	255	255
query57	1184	1193	1102	1102
query58	253	238	233	233
query59	2807	2835	2856	2835
query60	296	272	297	272
query61	127	124	117	117
query62	794	734	665	665
query63	232	189	192	189
query64	4332	1016	674	674
query65	4522	4431	4443	4431
query66	1151	388	318	318
query67	16058	15534	15540	15534
query68	8370	864	491	491
query69	474	313	279	279
query70	1221	1117	1135	1117
query71	420	287	259	259
query72	5354	3609	3874	3609
query73	748	713	342	342
query74	9167	8820	9077	8820
query75	3287	3171	2675	2675
query76	3412	1176	744	744
query77	643	363	281	281
query78	10148	10147	9386	9386
query79	2694	830	596	596
query80	616	513	527	513
query81	497	267	224	224
query82	707	124	96	96
query83	177	163	152	152
query84	245	96	72	72
query85	787	353	297	297
query86	372	316	274	274
query87	4394	4425	4279	4279
query88	3772	2239	2218	2218
query89	413	308	288	288
query90	1894	211	215	211
query91	140	139	109	109
query92	73	57	57	57
query93	2000	1052	574	574
query94	690	404	292	292
query95	346	265	271	265
query96	477	563	279	279
query97	3317	3367	3283	3283
query98	236	212	194	194
query99	1508	1403	1296	1296
Total cold run time: 279790 ms
Total hot run time: 192093 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 17a387d3f0961763b96a6496d15fca8a7ebf2036, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.10	0.10
query3	0.25	0.20	0.20
query4	1.59	0.19	0.19
query5	0.59	0.58	0.58
query6	1.19	0.72	0.71
query7	0.02	0.02	0.01
query8	0.05	0.04	0.03
query9	0.58	0.52	0.51
query10	0.57	0.58	0.56
query11	0.16	0.10	0.10
query12	0.15	0.12	0.11
query13	0.61	0.60	0.61
query14	2.83	2.83	2.68
query15	0.95	0.84	0.84
query16	0.40	0.39	0.38
query17	1.07	1.04	1.04
query18	0.21	0.20	0.19
query19	1.90	2.05	1.85
query20	0.02	0.01	0.01
query21	15.38	0.90	0.55
query22	0.75	1.17	0.79
query23	14.79	1.37	0.64
query24	6.80	1.19	1.05
query25	0.52	0.18	0.13
query26	0.67	0.16	0.14
query27	0.06	0.05	0.04
query28	9.00	0.88	0.44
query29	12.54	4.00	3.36
query30	0.25	0.09	0.06
query31	2.86	0.60	0.40
query32	3.22	0.54	0.47
query33	2.97	3.00	2.99
query34	15.91	5.15	4.54
query35	4.60	4.60	4.50
query36	0.68	0.49	0.48
query37	0.08	0.07	0.07
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.18	0.12	0.12
query41	0.08	0.02	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 104.77 s
Total hot run time: 31.61 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 100.00% (2/2) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 48.81% (13073/26784)
Line Coverage 38.39% (112769/293711)
Region Coverage 37.18% (57310/154141)
Branch Coverage 32.28% (28810/89242)

@mrhhsg
Copy link
Member Author

mrhhsg commented Mar 20, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33106 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 43ed58eeb66616762a716a9b988ea460cb75107b, data reload: false

------ Round 1 ----------------------------------
q1	24175	5142	5077	5077
q2	2040	303	186	186
q3	11252	1263	698	698
q4	10229	1031	546	546
q5	7754	2531	2369	2369
q6	190	165	134	134
q7	917	747	616	616
q8	9305	1299	1090	1090
q9	6004	4881	4725	4725
q10	6862	2346	1915	1915
q11	470	269	261	261
q12	351	350	216	216
q13	19433	3780	3498	3498
q14	251	240	230	230
q15	543	493	486	486
q16	641	642	591	591
q17	589	862	364	364
q18	8560	7112	6418	6418
q19	3729	963	541	541
q20	324	309	192	192
q21	2829	2182	1972	1972
q22	1034	1031	981	981
Total cold run time: 117482 ms
Total hot run time: 33106 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5347	5162	5083	5083
q2	231	329	223	223
q3	2143	2633	2263	2263
q4	1450	1835	1430	1430
q5	4485	4487	4409	4409
q6	216	173	124	124
q7	1957	1901	1741	1741
q8	2637	2686	2543	2543
q9	7270	7282	7181	7181
q10	3086	3226	2793	2793
q11	594	526	520	520
q12	706	785	634	634
q13	3776	4107	3472	3472
q14	311	335	285	285
q15	526	500	479	479
q16	654	677	632	632
q17	1170	1632	1364	1364
q18	8083	7892	7492	7492
q19	810	788	923	788
q20	1886	1997	1833	1833
q21	5403	5271	4865	4865
q22	1119	1096	1035	1035
Total cold run time: 53860 ms
Total hot run time: 51189 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192257 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 43ed58eeb66616762a716a9b988ea460cb75107b, data reload: false

query1	1406	1041	1036	1036
query2	6179	1931	1887	1887
query3	11007	4567	4521	4521
query4	53278	25905	22974	22974
query5	4958	609	484	484
query6	329	204	186	186
query7	4863	518	296	296
query8	328	258	240	240
query9	5582	2594	2594	2594
query10	437	313	257	257
query11	15117	15040	14959	14959
query12	150	107	102	102
query13	1031	522	379	379
query14	10179	6614	6732	6614
query15	214	191	171	171
query16	6788	652	484	484
query17	1070	727	568	568
query18	1052	385	328	328
query19	201	212	172	172
query20	130	123	126	123
query21	212	126	109	109
query22	4431	4543	4273	4273
query23	33954	33509	33467	33467
query24	6470	2467	2443	2443
query25	457	481	406	406
query26	703	272	152	152
query27	2024	495	337	337
query28	3106	2432	2438	2432
query29	563	582	451	451
query30	272	227	192	192
query31	863	855	784	784
query32	76	65	64	64
query33	509	363	312	312
query34	935	850	546	546
query35	813	843	738	738
query36	947	1006	945	945
query37	122	103	77	77
query38	4481	4348	4214	4214
query39	1497	1457	1465	1457
query40	216	129	107	107
query41	60	57	56	56
query42	126	108	110	108
query43	514	505	482	482
query44	1414	814	826	814
query45	180	173	169	169
query46	874	1040	687	687
query47	1817	1849	1786	1786
query48	395	430	315	315
query49	695	533	434	434
query50	743	752	425	425
query51	4289	4312	4300	4300
query52	112	111	97	97
query53	235	268	196	196
query54	493	491	419	419
query55	89	89	93	89
query56	268	289	276	276
query57	1159	1200	1138	1138
query58	256	241	235	235
query59	2724	2707	2759	2707
query60	285	282	284	282
query61	123	122	115	115
query62	726	725	687	687
query63	239	204	209	204
query64	1811	1082	690	690
query65	4687	4516	4435	4435
query66	741	422	288	288
query67	15677	15421	15444	15421
query68	8543	871	497	497
query69	542	303	269	269
query70	1191	1147	1096	1096
query71	484	305	281	281
query72	5804	3612	3732	3612
query73	1143	763	343	343
query74	9143	8954	8707	8707
query75	3569	3178	2706	2706
query76	4115	1181	744	744
query77	680	367	279	279
query78	10077	10087	9270	9270
query79	2712	828	588	588
query80	666	514	460	460
query81	476	264	218	218
query82	485	125	96	96
query83	174	164	156	156
query84	286	90	78	78
query85	752	344	313	313
query86	358	311	304	304
query87	4479	4467	4448	4448
query88	3475	2240	2217	2217
query89	410	312	277	277
query90	1763	207	209	207
query91	158	141	111	111
query92	75	57	56	56
query93	2208	1059	570	570
query94	695	420	296	296
query95	343	261	263	261
query96	481	563	275	275
query97	3294	3441	3280	3280
query98	223	201	212	201
query99	1372	1373	1305	1305
Total cold run time: 297858 ms
Total hot run time: 192257 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.49 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 43ed58eeb66616762a716a9b988ea460cb75107b, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.10	0.11
query3	0.25	0.20	0.19
query4	1.58	0.19	0.19
query5	0.61	0.59	0.59
query6	1.18	0.72	0.72
query7	0.02	0.02	0.02
query8	0.04	0.04	0.04
query9	0.60	0.53	0.53
query10	0.59	0.60	0.57
query11	0.16	0.11	0.12
query12	0.14	0.11	0.11
query13	0.62	0.61	0.60
query14	2.70	2.73	2.73
query15	0.93	0.84	0.83
query16	0.38	0.39	0.37
query17	1.02	1.03	1.03
query18	0.21	0.20	0.20
query19	1.89	1.99	1.81
query20	0.02	0.01	0.01
query21	15.36	0.89	0.54
query22	0.76	1.28	0.70
query23	14.82	1.43	0.63
query24	6.69	1.64	1.01
query25	0.50	0.23	0.14
query26	0.59	0.16	0.14
query27	0.06	0.05	0.05
query28	9.22	0.89	0.44
query29	12.56	4.02	3.32
query30	0.25	0.08	0.06
query31	2.84	0.59	0.39
query32	3.23	0.55	0.45
query33	3.01	3.07	3.04
query34	15.85	5.23	4.49
query35	4.51	4.54	4.49
query36	0.68	0.50	0.50
query37	0.08	0.06	0.07
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.14	0.14
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 104.49 s
Total hot run time: 31.49 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 48.80% (13068/26781)
Line Coverage 38.38% (112709/293668)
Region Coverage 37.17% (57288/154130)
Branch Coverage 32.27% (28794/89234)

@mrhhsg
Copy link
Member Author

mrhhsg commented Mar 24, 2025

Duplicated with #49241

@mrhhsg mrhhsg closed this Mar 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants