[fix](memory) Fix pipelinex submit task attach memory tracker #33732

xinyiZzz · 2024-04-16T13:25:28Z

Proposed changes

fix

F20240415 23:42:47.509416  9710 thread_context.h:204] Check failed: !doris::config::enable_memory_orphan_check || thread_mem_tracker()->label() != "Orphan" If you crash here, it means that SCOPED_ATTACH_TASK and SCOPED_SWITCH_THREAD_MEM_TRACKER_LIMITER are not used correctly. starting position of each thread is expected to use SCOPED_ATTACH_TASK to bind a MemTrackerLimiter belonging to Query/Load/Compaction/Other Tasks, otherwise memory alloc using Doris Allocator in the thread will crash. If you want to switch MemTrackerLimiter during thread execution, please use SCOPED_SWITCH_THREAD_MEM_TRACKER_LIMITER, do not repeat Attach. Of course, you can modify enable_memory_orphan_check=false in be.conf to avoid this crash.F20240415 23:42:47.509719  9730 thread_context.h:204] Check failed: !doris::config::enable_memory_orphan_check || thread_mem_tracker()->label() != "Orphan" If you crash here, it means that SCOPED_ATTACH_TASK and SCOPED_SWITCH_THREAD_MEM_TRACKER_LIMITER are not used correctly. starting position of each thread is expected to use SCOPED_ATTACH_TASK to bind a MemTrackerLimiter belonging to Query/Load/Compaction/Other Tasks, otherwise memory alloc using Doris Allocator in the thread will crash. If you want to switch MemTrackerLimiter during thread execution, please use SCOPED_SWITCH_THREAD_MEM_TRACKER_LIMITER, do not repeat Attach. Of course, you can modify enable_memory_orphan_check=false in be.conf to avoid this crash.
23:54:03   *** Check failure stack trace: ***
23:54:03    0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_master/doris/be/src/common/signal_handler.h:421
23:54:03    1# 0x00007F4CB957A090 in /lib/x86_64-linux-gnu/libc.so.6
23:54:03    2# raise at ../sysdeps/unix/sysv/linux/raise.c:51
23:54:03    3# abort at /build/glibc-SzIz7B/glibc-2.31/stdlib/abort.c:81
23:54:03    4# 0x000055D07A68DBDD in /mnt/hdd01/ci/master-deploy/be/lib/doris_be
23:54:03    5# 0x000055D07A68027A in /mnt/hdd01/ci/master-deploy/be/lib/doris_be
23:54:03    6# google::LogMessage::SendToLog() in /mnt/hdd01/ci/master-deploy/be/lib/doris_be
23:54:03    7# google::LogMessage::Flush() in /mnt/hdd01/ci/master-deploy/be/lib/doris_be
23:54:03    8# google::LogMessageFatal::~LogMessageFatal() in /mnt/hdd01/ci/master-deploy/be/lib/doris_be
23:54:03    9# doris::ThreadContext::consume_memory(long) const in /mnt/hdd01/ci/master-deploy/be/lib/doris_be
23:54:03   10# Allocator<false, false, false>::release_memory(unsigned long) const at /home/zcp/repo_center/doris_master/doris/be/src/vec/common/allocator.cpp:177
23:54:03   11# Allocator<false, false, false>::free(void*, unsigned long) at /home/zcp/repo_center/doris_master/doris/be/src/vec/common/allocator.h:154
23:54:03   12# doris::vectorized::Arena::Chunk::~Chunk() at /home/zcp/repo_center/doris_master/doris/be/src/vec/common/arena.h:77
23:54:03   13# doris::vectorized::Arena::~Arena() at /home/zcp/repo_center/doris_master/doris/be/src/vec/common/arena.h:142
23:54:03   14# void std::destroy_at<doris::vectorized::Arena>(doris::vectorized::Arena*) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/stl_construct.h:89
23:54:03   15# void std::allocator_traits<std::allocator<doris::vectorized::Arena> >::destroy<doris::vectorized::Arena>(std::allocator<doris::vectorized::Arena>&, doris::vectorized::Arena*) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/alloc_traits.h:533
23:54:03   16# std::_Sp_counted_ptr_inplace<doris::vectorized::Arena, std::allocator<doris::vectorized::Arena>, (__gnu_cxx::_Lock_policy)2>::_M_dispose() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:529
23:54:03   17# std::_Sp_counted_base<(__gnu_cxx::_Lock_policy)2>::_M_release() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:168
23:54:03   18# std::__shared_count<(__gnu_cxx::_Lock_policy)2>::~__shared_count() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:703
23:54:03   19# std::__shared_ptr<doris::vectorized::Arena, (__gnu_cxx::_Lock_policy)2>::~__shared_ptr() at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:1149
23:54:03   20# std::__shared_ptr<doris::vectorized::Arena, (__gnu_cxx::_Lock_policy)2>::operator=(std::__shared_ptr<doris::vectorized::Arena, (__gnu_cxx::_Lock_policy)2>&&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:1245
23:54:03   21# std::shared_ptr<doris::vectorized::Arena>::operator=(std::shared_ptr<doris::vectorized::Arena>&&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr.h:385
23:54:03   22# doris::vectorized::HashJoinNode::_release_mem() at /home/zcp/repo_center/doris_master/doris/be/src/vec/exec/join/vhash_join_node.cpp:1111
23:54:03   23# doris::vectorized::HashJoinNode::release_resource(doris::RuntimeState*) at /home/zcp/repo_center/doris_master/doris/be/src/vec/exec/join/vhash_join_node.cpp:685
23:54:03   24# doris::ExecNode::close(doris::RuntimeState*) at /home/zcp/repo_center/doris_master/doris/be/src/exec/exec_node.cpp:236
23:54:03   25# doris::vectorized::VJoinNodeBase::close(doris::RuntimeState*) at /home/zcp/repo_center/doris_master/doris/be/src/vec/exec/join/vjoin_node_base.cpp:153
23:54:03   26# doris::vectorized::HashJoinNode::close(doris::RuntimeState*) in /mnt/hdd01/ci/master-deploy/be/lib/doris_be
23:54:03   27# doris::pipeline::PipelineFragmentContext::close_if_prepare_failed(doris::Status) at /home/zcp/repo_center/doris_master/doris/be/src/pipeline/pipeline_fragment_context.cpp:796
23:54:03   28# doris::FragmentMgr::exec_plan_fragment(doris::TPipelineFragmentParams const&, std::function<void (doris::RuntimeState*, doris::Status*)> const&)::$_1::operator()(int) const at /home/zcp/repo_center/doris_master/doris/be/src/runtime/fragment_mgr.cpp:934
23:54:03   29# doris::FragmentMgr::exec_plan_fragment(doris::TPipelineFragmentParams const&, std::function<void (doris::RuntimeState*, doris::Status*)> const&)::$_0::operator()() const at /home/zcp/repo_center/doris_master/doris/be/src/runtime/fragment_mgr.cpp:984

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

doris-robot · 2024-04-16T13:25:34Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

xinyiZzz · 2024-04-16T13:25:35Z

run buildall

github-actions · 2024-04-16T13:31:59Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-04-16T13:53:22Z

TeamCity be ut coverage result:
Function Coverage: 35.50% (8908/25092)
Line Coverage: 27.22% (73156/268730)
Region Coverage: 26.35% (37830/143550)
Branch Coverage: 23.13% (19272/83332)
Coverage Report: http://coverage.selectdb-in.cc/coverage/ab68556c969d5955081a24f08d8c09a297e05534_ab68556c969d5955081a24f08d8c09a297e05534/report/index.html

doris-robot · 2024-04-16T14:01:51Z

TPC-H: Total hot run time: 38524 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ab68556c969d5955081a24f08d8c09a297e05534, data reload: false

------ Round 1 ----------------------------------
q1	17494	4308	4218	4218
q2	2013	192	196	192
q3	10542	1195	1149	1149
q4	10346	817	776	776
q5	7585	2707	2642	2642
q6	220	133	134	133
q7	1015	613	599	599
q8	9240	2046	2031	2031
q9	7274	6581	6519	6519
q10	8598	3541	3493	3493
q11	466	229	234	229
q12	446	238	227	227
q13	18848	2930	2939	2930
q14	288	228	231	228
q15	532	488	488	488
q16	542	389	389	389
q17	970	748	687	687
q18	7315	6766	6632	6632
q19	5398	1523	1486	1486
q20	628	330	303	303
q21	3596	2876	2875	2875
q22	366	298	324	298
Total cold run time: 113722 ms
Total hot run time: 38524 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4344	4189	4262	4189
q2	370	265	275	265
q3	3036	2751	2782	2751
q4	1839	1580	1616	1580
q5	5358	5379	5287	5287
q6	214	125	126	125
q7	2281	1886	1865	1865
q8	3229	3373	3353	3353
q9	8599	8591	8635	8591
q10	4096	3929	4033	3929
q11	609	519	497	497
q12	811	634	628	628
q13	16598	3197	3159	3159
q14	334	289	275	275
q15	524	483	523	483
q16	518	452	452	452
q17	1830	1592	1505	1505
q18	8215	8107	7921	7921
q19	1655	1549	1535	1535
q20	2051	1870	1854	1854
q21	5229	5082	5006	5006
q22	590	454	476	454
Total cold run time: 72330 ms
Total hot run time: 55704 ms

doris-robot · 2024-04-16T14:13:26Z

TPC-DS: Total hot run time: 186041 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ab68556c969d5955081a24f08d8c09a297e05534, data reload: false

query1	900	374	363	363
query2	7159	2471	2392	2392
query3	6711	209	208	208
query4	23385	21372	21302	21302
query5	4163	403	416	403
query6	284	189	210	189
query7	4591	302	297	297
query8	225	177	172	172
query9	8637	2380	2364	2364
query10	417	249	244	244
query11	14935	14322	14179	14179
query12	139	85	84	84
query13	1628	364	370	364
query14	9284	7985	7833	7833
query15	276	187	182	182
query16	8181	259	260	259
query17	1946	582	547	547
query18	2105	273	267	267
query19	271	147	149	147
query20	89	85	81	81
query21	196	127	123	123
query22	4947	4770	4778	4770
query23	33853	33267	33387	33267
query24	11299	3053	3001	3001
query25	620	383	392	383
query26	701	164	162	162
query27	2489	377	387	377
query28	5949	2203	2162	2162
query29	869	636	606	606
query30	293	182	178	178
query31	982	747	780	747
query32	96	54	53	53
query33	699	264	256	256
query34	1070	502	497	497
query35	872	730	720	720
query36	1086	926	905	905
query37	110	68	71	68
query38	3435	3311	3306	3306
query39	1627	1591	1575	1575
query40	180	132	134	132
query41	47	47	45	45
query42	105	99	98	98
query43	566	533	557	533
query44	1178	757	757	757
query45	305	282	284	282
query46	1114	778	739	739
query47	2031	1953	1999	1953
query48	391	310	310	310
query49	828	406	392	392
query50	791	411	396	396
query51	6935	6837	6829	6829
query52	101	96	88	88
query53	348	281	286	281
query54	304	221	244	221
query55	75	74	71	71
query56	244	218	229	218
query57	1176	1124	1108	1108
query58	221	199	199	199
query59	3267	3178	3144	3144
query60	256	228	230	228
query61	88	87	86	86
query62	587	449	426	426
query63	300	284	285	284
query64	5010	4095	3910	3910
query65	3102	3022	3025	3022
query66	752	326	322	322
query67	15354	15010	15145	15010
query68	5130	550	553	550
query69	501	316	299	299
query70	1233	1166	1155	1155
query71	1408	1268	1270	1268
query72	6304	2668	2431	2431
query73	726	326	327	326
query74	6695	6330	6479	6330
query75	3456	2621	2588	2588
query76	3341	1019	965	965
query77	380	276	263	263
query78	10831	10043	10149	10043
query79	4504	526	544	526
query80	1852	430	427	427
query81	528	239	241	239
query82	938	101	100	100
query83	285	165	162	162
query84	262	92	85	85
query85	1901	275	264	264
query86	472	310	311	310
query87	3617	3257	3280	3257
query88	5090	2448	2457	2448
query89	492	387	369	369
query90	1921	187	182	182
query91	118	98	95	95
query92	58	46	47	46
query93	5228	525	503	503
query94	1128	187	176	176
query95	389	298	306	298
query96	606	276	268	268
query97	3130	2906	2964	2906
query98	231	228	216	216
query99	1225	829	863	829
Total cold run time: 286155 ms
Total hot run time: 186041 ms

doris-robot · 2024-04-16T14:18:56Z

ClickBench: Total hot run time: 30.95 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ab68556c969d5955081a24f08d8c09a297e05534, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.23	0.04	0.05
query4	1.67	0.07	0.07
query5	0.52	0.48	0.50
query6	1.47	0.71	0.72
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.54	0.47	0.49
query10	0.56	0.56	0.55
query11	0.15	0.11	0.11
query12	0.14	0.12	0.12
query13	0.60	0.58	0.58
query14	0.77	0.77	0.79
query15	0.82	0.81	0.80
query16	0.37	0.36	0.36
query17	1.00	1.04	0.98
query18	0.22	0.26	0.23
query19	1.83	1.77	1.74
query20	0.01	0.01	0.01
query21	15.40	0.65	0.63
query22	4.20	6.45	2.40
query23	18.30	1.36	1.31
query24	1.83	0.25	0.22
query25	0.15	0.08	0.09
query26	0.27	0.18	0.17
query27	0.08	0.07	0.08
query28	13.27	1.00	0.99
query29	12.56	3.26	3.24
query30	0.26	0.08	0.06
query31	2.87	0.38	0.39
query32	3.25	0.47	0.46
query33	2.78	2.86	2.90
query34	17.12	4.41	4.46
query35	4.49	4.55	4.50
query36	0.65	0.47	0.45
query37	0.19	0.15	0.15
query38	0.15	0.15	0.14
query39	0.05	0.03	0.03
query40	0.17	0.14	0.14
query41	0.10	0.05	0.04
query42	0.06	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 109.33 s
Total hot run time: 30.95 s

doris-robot · 2024-04-16T14:22:01Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit ab68556c969d5955081a24f08d8c09a297e05534 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       14.2 seconds inserted 10000000 Rows, about 704K ops/s

xinyiZzz · 2024-04-16T16:38:30Z

run buildall

github-actions · 2024-04-16T16:44:13Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-04-16T16:56:23Z

TeamCity be ut coverage result:
Function Coverage: 35.50% (8907/25092)
Line Coverage: 27.22% (73152/268729)
Region Coverage: 26.35% (37827/143549)
Branch Coverage: 23.13% (19273/83332)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a05813267c12c2ab7f74514a9bdabd4ef698f091_a05813267c12c2ab7f74514a9bdabd4ef698f091/report/index.html

doris-robot · 2024-04-16T17:00:08Z

TPC-H: Total hot run time: 38893 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a05813267c12c2ab7f74514a9bdabd4ef698f091, data reload: false

------ Round 1 ----------------------------------
q1	17634	4342	4267	4267
q2	2019	190	185	185
q3	10646	1241	1254	1241
q4	10712	790	819	790
q5	8110	2764	2664	2664
q6	222	134	135	134
q7	1037	614	614	614
q8	9540	2109	2080	2080
q9	7608	6756	6678	6678
q10	8610	3534	3539	3534
q11	504	231	226	226
q12	525	213	214	213
q13	17767	2947	2972	2947
q14	271	235	236	235
q15	531	501	477	477
q16	530	385	377	377
q17	969	715	705	705
q18	7454	6833	6700	6700
q19	1853	1530	1517	1517
q20	665	310	297	297
q21	3427	2832	2712	2712
q22	364	300	308	300
Total cold run time: 110998 ms
Total hot run time: 38893 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4294	4212	4272	4212
q2	363	263	266	263
q3	2964	2734	2777	2734
q4	1920	1635	1620	1620
q5	5355	5325	5307	5307
q6	210	123	123	123
q7	2248	1879	1907	1879
q8	3260	3322	3327	3322
q9	8592	8559	8554	8554
q10	3938	3713	3696	3696
q11	582	487	475	475
q12	738	600	585	585
q13	15088	2908	2969	2908
q14	291	267	267	267
q15	530	471	457	457
q16	469	422	429	422
q17	1772	1447	1453	1447
q18	7672	7466	7442	7442
q19	1654	1494	1491	1491
q20	1947	1738	1773	1738
q21	4922	4740	4889	4740
q22	536	450	475	450
Total cold run time: 69345 ms
Total hot run time: 54132 ms

doris-robot · 2024-04-16T17:11:51Z

TPC-DS: Total hot run time: 184393 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a05813267c12c2ab7f74514a9bdabd4ef698f091, data reload: false

query1	912	374	362	362
query2	6500	2476	2329	2329
query3	6655	201	207	201
query4	22982	21338	21287	21287
query5	4209	408	400	400
query6	263	173	173	173
query7	4586	296	288	288
query8	225	188	179	179
query9	8497	2365	2358	2358
query10	569	239	252	239
query11	14729	14241	14215	14215
query12	143	91	83	83
query13	1672	371	364	364
query14	9635	7509	7835	7509
query15	259	179	191	179
query16	8183	261	258	258
query17	1936	580	566	566
query18	2112	276	273	273
query19	265	145	149	145
query20	91	81	84	81
query21	196	125	123	123
query22	5098	4860	4866	4860
query23	33763	33215	33196	33196
query24	11909	2963	2925	2925
query25	635	363	375	363
query26	1749	149	150	149
query27	2965	309	317	309
query28	7677	2023	1998	1998
query29	1011	614	584	584
query30	310	170	170	170
query31	1016	729	718	718
query32	93	57	55	55
query33	735	244	236	236
query34	1038	474	480	474
query35	843	709	676	676
query36	1048	912	899	899
query37	173	71	82	71
query38	3366	3186	3215	3186
query39	1603	1512	1511	1511
query40	280	125	133	125
query41	47	41	41	41
query42	101	93	94	93
query43	578	550	553	550
query44	1216	716	732	716
query45	269	264	267	264
query46	1073	692	747	692
query47	1942	1833	1867	1833
query48	367	285	290	285
query49	1149	367	360	360
query50	744	382	381	381
query51	6663	6754	6656	6656
query52	101	88	92	88
query53	342	274	281	274
query54	307	237	258	237
query55	75	73	73	73
query56	246	221	221	221
query57	1201	1085	1096	1085
query58	226	191	193	191
query59	3621	3162	3290	3162
query60	275	234	246	234
query61	92	87	87	87
query62	655	448	450	448
query63	303	272	275	272
query64	6286	3816	3988	3816
query65	3098	3027	3058	3027
query66	1405	358	343	343
query67	15332	15128	14899	14899
query68	6752	541	548	541
query69	565	308	287	287
query70	1265	1143	1078	1078
query71	1429	1267	1260	1260
query72	6665	2637	2418	2418
query73	731	329	363	329
query74	6915	6418	6429	6418
query75	3665	2578	2635	2578
query76	3731	983	971	971
query77	616	261	264	261
query78	10995	10135	10236	10135
query79	5376	511	509	509
query80	1752	422	422	422
query81	526	239	247	239
query82	1604	92	93	92
query83	290	167	171	167
query84	261	82	88	82
query85	1581	275	262	262
query86	528	301	317	301
query87	3469	3273	3272	3272
query88	4909	2400	2417	2400
query89	476	370	357	357
query90	1930	180	182	180
query91	126	96	100	96
query92	59	46	46	46
query93	5481	520	499	499
query94	1279	183	179	179
query95	385	296	294	294
query96	600	264	263	263
query97	3134	2962	2970	2962
query98	238	221	217	217
query99	1264	833	859	833
Total cold run time: 296242 ms
Total hot run time: 184393 ms

doris-robot · 2024-04-16T17:17:23Z

ClickBench: Total hot run time: 29.99 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a05813267c12c2ab7f74514a9bdabd4ef698f091, data reload: false

query1	0.04	0.04	0.03
query2	0.09	0.04	0.04
query3	0.23	0.05	0.05
query4	1.68	0.08	0.09
query5	0.49	0.48	0.50
query6	1.48	0.71	0.72
query7	0.03	0.02	0.01
query8	0.05	0.05	0.04
query9	0.56	0.50	0.49
query10	0.54	0.54	0.54
query11	0.16	0.11	0.12
query12	0.15	0.12	0.12
query13	0.59	0.58	0.58
query14	0.76	0.77	0.81
query15	0.83	0.81	0.80
query16	0.37	0.37	0.40
query17	1.01	1.03	1.04
query18	0.21	0.25	0.24
query19	1.82	1.69	1.75
query20	0.02	0.01	0.02
query21	15.42	0.65	0.64
query22	4.22	7.71	1.70
query23	18.27	1.41	1.22
query24	1.80	0.26	0.19
query25	0.14	0.08	0.09
query26	0.27	0.17	0.17
query27	0.07	0.07	0.08
query28	13.40	0.98	0.99
query29	12.68	3.25	3.18
query30	0.28	0.08	0.07
query31	2.82	0.38	0.38
query32	3.28	0.48	0.46
query33	2.81	2.80	2.83
query34	17.24	4.36	4.49
query35	4.48	4.45	4.44
query36	0.65	0.46	0.46
query37	0.18	0.17	0.16
query38	0.15	0.14	0.14
query39	0.05	0.03	0.03
query40	0.18	0.13	0.14
query41	0.10	0.05	0.05
query42	0.05	0.06	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.69 s
Total hot run time: 29.99 s

doris-robot · 2024-04-16T17:20:31Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a05813267c12c2ab7f74514a9bdabd4ef698f091 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      33 seconds loaded 861443392 Bytes, about 24 MB/s
Insert into select:       13.2 seconds inserted 10000000 Rows, about 757K ops/s

dataroaring

LGTM

github-actions · 2024-04-17T07:50:05Z

PR approved by at least one committer and no changes requested.

github-actions · 2024-04-17T07:50:07Z

PR approved by anyone and no changes requested.

…#33732)

pick #33396 #33862 #33853 #33732 #33841 #33933 #34901 #35014 --------- Co-authored-by: yiguolei <676222867@qq.com> Co-authored-by: yiguolei <yiguolei@gmail.com>

1

ab68556

2

a058132

dataroaring approved these changes Apr 17, 2024

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 17, 2024

github-actions bot added the reviewed label Apr 17, 2024

yiguolei approved these changes Apr 17, 2024

View reviewed changes

yiguolei merged commit 6bbd9df into apache:master Apr 17, 2024

xinyiZzz added a commit to xinyiZzz/incubator-doris that referenced this pull request Sep 13, 2024

[fix](memory) Fix pipelinex submit task attach memory tracker (apache…

3465eda

…#33732)

xinyiZzz mentioned this pull request Sep 13, 2024

[branch-2.1](memory) Allocator support address sanitizers #40836

Merged

xinyiZzz added the dev/2.1.7-merged label Sep 20, 2024

[fix](memory) Fix pipelinex submit task attach memory tracker #33732

[fix](memory) Fix pipelinex submit task attach memory tracker #33732

Uh oh!

Conversation

xinyiZzz commented Apr 16, 2024

Proposed changes

Further comments

Uh oh!

doris-robot commented Apr 16, 2024

Uh oh!

xinyiZzz commented Apr 16, 2024

Uh oh!

github-actions bot commented Apr 16, 2024

Uh oh!

doris-robot commented Apr 16, 2024

Uh oh!

doris-robot commented Apr 16, 2024

Uh oh!

doris-robot commented Apr 16, 2024

Uh oh!

doris-robot commented Apr 16, 2024

Uh oh!

doris-robot commented Apr 16, 2024

Uh oh!

xinyiZzz commented Apr 16, 2024

Uh oh!

github-actions bot commented Apr 16, 2024

Uh oh!

doris-robot commented Apr 16, 2024

Uh oh!

doris-robot commented Apr 16, 2024

Uh oh!

doris-robot commented Apr 16, 2024

Uh oh!

doris-robot commented Apr 16, 2024

Uh oh!

doris-robot commented Apr 16, 2024

Uh oh!

dataroaring left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot commented Apr 17, 2024

Uh oh!

github-actions bot commented Apr 17, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants