[Bug] DCHECK failed caused by tls_ctx()->type() == ThreadContext::TaskType::UNKNOWN

[jacktengg]

Search before asking

• I had searched in the issues and found no similar issues.

Version

master-289608cc2

What's Wrong?

load coredumped:

start time: Thu May 12 06:38:30 PM CST 2022
*** Check failure stack trace: ***
    @     0x55a8476f53bd  google::LogMessage::Fail()
    @     0x55a8476f78f9  google::LogMessage::SendToLog()
    @     0x55a8476f4f26  google::LogMessage::Flush()
    @     0x55a8476f7f69  google::LogMessageFatal::~LogMessageFatal()
    @     0x55a841e7f391  doris::SwitchThreadMemTracker<>::SwitchThreadMemTracker()
    @     0x55a841fda939  doris::LoadChannel::cancel()
    @     0x55a841fca4b0  doris::LoadChannelMgr::_start_load_channels_clean()
    @     0x55a841fc92c9  _ZZN5doris14LoadChannelMgr16_start_bg_workerEvENKUlvE_clEv
    @     0x55a841fcc196  _ZSt13__invoke_implIvRZN5doris14LoadChannelMgr16_start_bg_workerEvEUlvE_JEET_St14__invoke_otherOT0_DpOT1_
    @     0x55a841fcc000  _ZSt10__invoke_rIvRZN5doris14LoadChannelMgr16_start_bg_workerEvEUlvE_JEENSt9enable_ifIX16is_invocable_r_vIT_T0_DpT1_EES5_E4typeEOS6_DpOS7_
    @     0x55a841fcbc7a  _ZNSt17_Function_handlerIFvvEZN5doris14LoadChannelMgr16_start_bg_workerEvEUlvE_E9_M_invokeERKSt9_Any_data
    @     0x55a841e11b36  std::function<>::operator()()
    @     0x55a8424a0b00  doris::Thread::supervise_thread()
    @     0x7fcedcfe2450  start_thread
    @     0x7fcedd112d53  clone
    @              (nil)  (unknown)
*** Aborted at 1652406931 (unix time) try "date -d @1652406931" if you are using GNU date ***
*** SIGABRT unkown detail explain (@0x1e8756) received by PID 2000726 (TID 0x7fce7821b640) from PID 2000726; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zhanglei/incubator-doris/be/src/common/signal_handler.h:407
 1# 0x00007FCEDD03C040 in /lib/x86_64-linux-gnu/libc.so.6
 2# raise in /lib/x86_64-linux-gnu/libc.so.6
 3# abort in /lib/x86_64-linux-gnu/libc.so.6
 4# google::ReadFromOffset(int, void*, unsigned long, long) [clone .cold] at src/symbolize.cc:146
 5# 0x000055A8476F53BD at src/logging.cc:1650
 6# google::LogMessage::SendToLog() at src/logging.cc:1607
 7# google::LogMessage::Flush() at src/logging.cc:1477
 8# google::LogMessageFatal::~LogMessageFatal() at src/logging.cc:2227
 9# doris::SwitchThreadMemTracker<false>::SwitchThreadMemTracker(std::shared_ptr<doris::MemTracker> const&, bool) at /home/zhanglei/incubator-doris/be/src/runtime/thread_context.cpp:95
10# doris::LoadChannel::cancel() at /home/zhanglei/incubator-doris/be/src/runtime/load_channel.cpp:141
11# doris::LoadChannelMgr::_start_load_channels_clean() at /home/zhanglei/incubator-doris/be/src/runtime/load_channel_mgr.cpp:250
12# doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}::operator()() const at /home/zhanglei/incubator-doris/be/src/runtime/load_channel_mgr.cpp:202
13# void std::__invoke_impl<void, doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}&>(std::__invoke_other, doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}&) at /usr/include/c++/11/bits/invoke.h:61
14# std::enable_if<is_invocable_r_v<void, doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}&>, void>::type std::__invoke_r<void, doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}&>(doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}&) at /usr/include/c++/11/bits/invoke.h:117
15# std::_Function_handler<void (), doris::LoadChannelMgr::_start_bg_worker()::{lambda()#1}>::_M_invoke(std::_Any_data const&) at /usr/include/c++/11/bits/std_function.h:292
16# std::function<void ()>::operator()() const at /usr/include/c++/11/bits/std_function.h:560
17# doris::Thread::supervise_thread(void*) at /home/zhanglei/incubator-doris/be/src/util/thread.cpp:409
18# start_thread at ./nptl/pthread_create.c:474
19# clone in /lib/x86_64-linux-gnu/libc.so.6

log:

I0513 09:55:27.098309 2001220 snapshot_loader.cpp:353] finished to download snapshots. job: 32603, task id: 33692
I0513 09:55:27.098703 2001220 task_worker_pool.cpp:1344] finished download task, signature: 33692, job id:32603
I0513 09:55:30.596575 2001418 heartbeat_server.cpp:58] get heartbeat from FE.host:172.21.16.2, port:9420, cluster id:556303565, counter:10981
I0513 09:55:31.409724 2001141 load_channel_mgr.cpp:224] cleaning timed out load channels
I0513 09:55:31.409765 2001141 load_channel_mgr.cpp:242] erase timeout load channel: 6a47ab9692546a45-800190cfa6522188
F0513 09:55:31.409852 2001141 thread_context.cpp:95] Check failed: in_task == false || tls_ctx()->type() != ThreadContext::TaskType::UNKNOWN ,tls ctx type=0

What You Expected?

no coredump

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct