Skip to content

Conversation

@xinyiZzz
Copy link
Contributor

@xinyiZzz xinyiZzz commented Apr 18, 2024

Proposed changes

Allocator address sanitizers enable dwarf_location_info_mode=DISABLED stack trace, this will no stack line numbers, maybe cause performance reduce 1x

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@xinyiZzz
Copy link
Contributor Author

run buildall

@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.43% (8913/25157)
Line Coverage: 27.13% (73234/269967)
Region Coverage: 26.26% (37834/144098)
Branch Coverage: 23.05% (19274/83604)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a7e071b34713464238129790378f36fde0d873ad_a7e071b34713464238129790378f36fde0d873ad/report/index.html

DEFINE_mString(get_stack_trace_tool, "libunwind");
DEFINE_mString(dwarf_location_info_mode, "FAST");
DEFINE_mBool(enable_address_sanitizers_with_stack_trace, "false");
DEFINE_mBool(enable_address_sanitizers_with_stack_trace, "true");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not set to true by default

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

only take effect under DEBUG

static std::mutex stacktrace_cache_mutex;

std::string toStringCached(const StackTrace::FramePointers& pointers, size_t offset, size_t size) {
std::string toStringCached(const StackTrace::FramePointers& pointers, size_t offset, size_t size,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do not modify these very low API, it is very likely to import some bugs.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i am 99.99% sure it's fine

@xinyiZzz xinyiZzz force-pushed the 20240417_fix_tracker_asan branch from a7e071b to c06238e Compare April 19, 2024 11:31
@github-actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@xinyiZzz
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.41% (8920/25189)
Line Coverage: 27.11% (73259/270208)
Region Coverage: 26.25% (37855/144194)
Branch Coverage: 23.05% (19274/83606)
Coverage Report: http://coverage.selectdb-in.cc/coverage/c06238ebc554e8f7e321d7d4a9e5ae3f58fb0ad0_c06238ebc554e8f7e321d7d4a9e5ae3f58fb0ad0/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 38403 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c06238ebc554e8f7e321d7d4a9e5ae3f58fb0ad0, data reload: false

------ Round 1 ----------------------------------
q1	17635	4475	4210	4210
q2	2013	188	192	188
q3	10452	1213	1207	1207
q4	10196	815	868	815
q5	7527	2643	2659	2643
q6	216	131	132	131
q7	1009	605	582	582
q8	9241	2049	2028	2028
q9	7456	6529	6505	6505
q10	8544	3512	3520	3512
q11	470	239	228	228
q12	439	210	212	210
q13	18698	2963	2992	2963
q14	269	225	230	225
q15	530	473	468	468
q16	519	392	377	377
q17	953	681	669	669
q18	7453	6805	6683	6683
q19	7607	1506	1483	1483
q20	655	316	300	300
q21	3596	2683	2729	2683
q22	355	293	303	293
Total cold run time: 115833 ms
Total hot run time: 38403 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4313	4188	4214	4188
q2	379	274	267	267
q3	3002	2764	2763	2763
q4	1869	1641	1587	1587
q5	5316	5280	5315	5280
q6	206	123	121	121
q7	2198	1844	1888	1844
q8	3155	3326	3326	3326
q9	8581	8569	8841	8569
q10	4264	3713	3849	3713
q11	602	500	490	490
q12	813	642	629	629
q13	16547	3092	3194	3092
q14	322	273	271	271
q15	528	502	489	489
q16	498	464	435	435
q17	1816	1524	1524	1524
q18	8078	7905	7765	7765
q19	1703	1572	1637	1572
q20	2090	1828	1855	1828
q21	5227	4958	4741	4741
q22	533	449	448	448
Total cold run time: 72040 ms
Total hot run time: 54942 ms

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Apr 20, 2024
@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@wangbo wangbo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@xinyiZzz xinyiZzz merged commit 5876a32 into apache:master Apr 22, 2024
eldenmoon added a commit to eldenmoon/incubator-doris that referenced this pull request Apr 25, 2024
… from default to 2048

since 50 may cause performance issue introduced by apache#33853
eldenmoon added a commit that referenced this pull request Apr 25, 2024
… from default to 2048 (#34105)

since 50 may cause performance issue introduced by #33853
xinyiZzz added a commit to xinyiZzz/incubator-doris that referenced this pull request Sep 13, 2024
…pache#33853)

Allocator address sanitizers enable dwarf_location_info_mode=DISABLED stack trace, this will no stack line numbers, maybe cause performance reduce 1x
yiguolei added a commit that referenced this pull request Sep 14, 2024
pick
#33396
#33862
#33853
#33732
#33841
#33933
#34901
#35014

---------

Co-authored-by: yiguolei <676222867@qq.com>
Co-authored-by: yiguolei <yiguolei@gmail.com>
github-actions bot pushed a commit that referenced this pull request Jan 2, 2025
… from default to 2048 (#34105)

since 50 may cause performance issue introduced by #33853
Gabriel39 pushed a commit to Gabriel39/incubator-doris that referenced this pull request Jan 2, 2025
… from default to 2048 (apache#34105)

since 50 may cause performance issue introduced by apache#33853
Gabriel39 added a commit that referenced this pull request Jan 2, 2025
#46249)

… from default to 2048 (#34105)

since 50 may cause performance issue introduced by #33853

Co-authored-by: lihangyu <15605149486@163.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.7-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants