[fix](nereids) Fix load failed where not set database in session (#41951) #42080

zxealous · 2024-10-18T07:12:51Z

Proposed changes

Issue Number: close #xxx
cherry-pick #41951

….conf (apache#40718) ## Proposed changes Since [brpc's built-in services](https://brpc.apache.org/zh/docs/builtin-services/buildin_services/) will expose some internal server status, for security reasons, add the parameter `enable_brpc_builtin_services` in `be.conf`. When the parameter is false, this built-in service can be disabled.

…ache#40783) ## Proposed changes Issue Number: close #xxx  <img width="674" alt="image" src="https://github.com/user-attachments/assets/b55cdb48-9108-4d55-9112-7e401cdbba07">

…e#40796) Catch exception when parsing numbers from HTTP header `CONTENT_LENGTH`.

## Proposed changes Issue Number: close #xxx row count skipped in common validation if table report not done for the all tablet row count will be -1 if done can get actual data. So row count can cause timing issue and make testcase unstable. we already have a checkpoint for rowcount with waiting . in common validation we have skiped rowcount.

## Proposed changes move slow case to p1

…xt" (apache#40804) Reverts apache#40569 We need more test to avoid performance issue

…) function (apache#40670) ``` mysql [test]>select count(concat(short, "123","121231","123123",'12312313')) from strings; +-------------------------------------------------------------+ | count(concat(short, '123', '121231', '123123', '12312313')) | +-------------------------------------------------------------+ | 10000000 | +-------------------------------------------------------------+ 1 row in set (0.52 sec) mysql [test]>select count(concat(short, "123","121231","123123",'12312313' , short , short, short)) from strings; +----------------------------------------------------------------------------------+ | count(concat(short, '123', '121231', '123123', '12312313', short, short, short)) | +----------------------------------------------------------------------------------+ | 10000000 | +----------------------------------------------------------------------------------+ 1 row in set (0.98 sec) now mysql [test]>select count(concat(short, "123","121231","123123",'12312313')) from strings; +-------------------------------------------------------------+ | count(concat(short, '123', '121231', '123123', '12312313')) | +-------------------------------------------------------------+ | 10000000 | +-------------------------------------------------------------+ 1 row in set (0.19 sec) mysql [test]>select count(concat(short, "123","121231","123123",'12312313' , short , short, short)) from strings; +----------------------------------------------------------------------------------+ | count(concat(short, '123', '121231', '123123', '12312313', short, short, short)) | +----------------------------------------------------------------------------------+ | 10000000 | +----------------------------------------------------------------------------------+ 1 row in set (0.71 sec) ```

…apache#40867) User admin instead of root to run stats sql.

…t str (apache#40821) ``` mysql [test]>select count(date_format(a, 'yyyyMMdd')) from date_format_tmp; +-----------------------------------+ | count(date_format(a, 'yyyyMMdd')) | +-----------------------------------+ | 16000000 | +-----------------------------------+ 1 row in set (0.53 sec) mysql [test]>select count(date_format(a, 'yyyyMMdd')) from date_format_tmp; +-----------------------------------+ | count(date_format(a, 'yyyyMMdd')) | +-----------------------------------+ | 16000000 | +-----------------------------------+ 1 row in set (0.28 sec) ```

## Proposed changes Issue Number: close #xxx apache#37817 use awaitility in few testcases

…pache#40710) ``` mysql []>select split_by_string('你a好b世c界',''); +-----------------------------------------------------------------------------+ | split_by_string('你a好b世c界', '') | +-----------------------------------------------------------------------------+ | ["�", "�", "�", "a", "�", "�", "�", "b", "�", "�", "�", "c", "�", "�", "�"] | +-----------------------------------------------------------------------------+ 1 row in set (0.03 sec) now mysql []>select split_by_string('你a好b世c界',''); +---------------------------------------------+ | split_by_string('你a好b世c界', '') | +---------------------------------------------+ | ["你", "a", "好", "b", "世", "c", "界"] | +---------------------------------------------+ ```

## Proposed changes ``` terminate called after throwing an instance of 'doris::Exception' {color:red} what(): [E6] Too large string size.{color} 0# doris::Exception::Exception(int, std::basic_string_view<char, std::char_traits<char> > const&) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/unique_ptr.h:173 1# doris::vectorized::read_string_binary(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&, doris::vectorized::BufferReadable&, unsigned long) at /root/doris_branch-2.1/doris/be/src/vec/io/io_helper.h:177 2# doris::vectorized::IAggregateFunctionHelper<doris::vectorized::AggregateFunctionNullUnaryInline<doris::vectorized::AggregateFunctionGroupConcat<doris::vectorized::AggregateFunctionGroupConcatImplStr>, true> >::deserialize_and_merge_from_column_range(char*, doris::vectorized::IColumn const&, unsigned long, unsigned long, doris::vectorized::Arena*) const at /root/doris_branch-2.1/doris/be/src/vec/aggregate_functions/aggregate_function.h:0 3# doris::vectorized::IAggregateFunctionHelper<doris::vectorized::AggregateStateUnion>::add_batch_range(unsigned long, unsigned long, char*, doris::vectorized::IColumn const**, doris::vectorized::Arena*, bool) at /root/doris_branch-2.1/doris/be/src/vec/aggregate_functions/aggregate_function.h:0 4# doris::vectorized::VerticalBlockReader::_update_agg_value(std::vector<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>, std::allocator<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn> > >&, int, int, bool) at /root/doris_branch-2.1/doris/be/src/vec/olap/vertical_block_reader.cpp:326 5# doris::vectorized::VerticalBlockReader::_update_agg_data(std::vector<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>, std::allocator<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn> > >&) at /root/doris_branch-2.1/doris/be/src/vec/olap/vertical_block_reader.cpp:308 6# doris::vectorized::VerticalBlockReader::_agg_key_next_block(doris::vectorized::Block*, bool*) at /root/doris_branch-2.1/doris/be/src/vec/olap/vertical_block_reader.cpp:0 7# doris::vectorized::VerticalBlockReader::next_block_with_aggregation(doris::vectorized::Block*, bool*) at /root/doris_branch-2.1/doris/be/src/common/status.h:491 8# doris::Merger::vertical_compact_one_group(std::shared_ptr<doris::Tablet>, doris::ReaderType, std::shared_ptr<doris::TabletSchema>, bool, std::vector<unsigned int, std::allocator<unsigned int> > const&, doris::vectorized::RowSourcesBuffer*, std::vector<std::shared_ptr<doris::RowsetReader>, std::allocator<std::shared_ptr<doris::RowsetReader> > > const&, doris::RowsetWriter*, long, doris::Merger::Statistics*, std::vector<unsigned int, std::allocator<unsigned int> >, long, doris::CompactionSampleInfo*) at /root/doris_branch-2.1/doris/be/src/olap/merger.cpp:0 9# doris::Merger::vertical_merge_rowsets(std::shared_ptr<doris::Tablet>, doris::ReaderType, std::shared_ptr<doris::TabletSchema>, std::vector<std::shared_ptr<doris::RowsetReader>, std::allocator<std::shared_ptr<doris::RowsetReader> > > const&, doris::RowsetWriter*, long, long, doris::Merger::Statistics*) at /root/doris_branch-2.1/doris/be/src/olap/merger.cpp:445 10# doris::Compaction::do_compaction_impl(long) at /root/doris_branch-2.1/doris/be/src/olap/compaction.cpp:385 11# doris::Compaction::do_compaction(long) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/shared_ptr_base.h:1291 12# doris::CumulativeCompaction::execute_compact_impl() at /root/doris_branch-2.1/doris/be/src/common/status.h:491 13# doris::Compaction::execute_compact() at /root/doris_branch-2.1/doris/be/src/common/status.h:491 14# doris::Tablet::execute_compaction(doris::Compaction&) at /root/doris_branch-2.1/doris/be/src/common/status.h:491 15# std::_Function_handler<void (), doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType, bool)::$_0>::_M_invoke(std::_Any_data const&) at /root/doris_branch-2.1/doris/be/src/olap/olap_server.cpp:1018 16# doris::ThreadPool::dispatch_thread() at /root/doris_branch-2.1/doris/be/src/util/threadpool.cpp:0 17# doris::Thread::supervise_thread(void*) at /var/local/ldb-toolchain/bin/../usr/include/pthread.h:562 18# ? 19# ? *** Query id: 0-0 *** *** is nereids: 0 *** *** tablet id: 38266341 *** *** Aborted at 1726615633 (unix time) try "date -d @1726615633" if you are using GNU date *** *** Current BE git commitID: db06c67 *** *** SIGABRT unknown detail explain (@0x26af02) received by PID 2535170 (TID 2536168 OR 0x7f48c81cd640) from PID 2535170; stack trace: *** 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris_branch-2.1/doris/be/src/common/signal_handler.h:421 1# 0x00007F4AB18F8520 in /lib/x86_64-linux-gnu/libc.so.6 2# pthread_kill at ./nptl/pthread_kill.c:89 3# raise at ../sysdeps/posix/raise.c:27 4# abort at ./stdlib/abort.c:81 5# __gnu_cxx::__verbose_terminate_handler() [clone .cold] at ../../../../libstdc++-v3/libsupc++/vterminate.cc:75 6# __cxxabiv1::__terminate(void (*)()) at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:48 7# 0x000055C401EF7811 in /mnt/disk1/STRESS_ENV/be/lib/doris_be 8# 0x000055C401EF7964 in /mnt/disk1/STRESS_ENV/be/lib/doris_be 9# doris::vectorized::read_string_binary(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&, doris::vectorized::BufferReadable&, unsigned long) at /root/doris_branch-2.1/doris/be/src/vec/io/io_helper.h:180 10# doris::vectorized::IAggregateFunctionHelper<doris::vectorized::AggregateFunctionNullUnaryInline<doris::vectorized::AggregateFunctionGroupConcat<doris::vectorized::AggregateFunctionGroupConcatImplStr>, true> >::deserialize_and_merge_from_column_range(char*, doris::vectorized::IColumn const&, unsigned long, unsigned long, doris::vectorized::Arena*) const in /mnt/disk1/STRESS_ENV/be/lib/doris_be 11# doris::vectorized::IAggregateFunctionHelper<doris::vectorized::AggregateStateUnion>::add_batch_range(unsigned long, unsigned long, char*, doris::vectorized::IColumn const**, doris::vectorized::Arena*, bool) in /mnt/disk1/STRESS_ENV/be/lib/doris_be 12# doris::vectorized::VerticalBlockReader::_update_agg_value(std::vector<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>, std::allocator<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn> > >&, int, int, bool) at /root/doris_branch-2.1/doris/be/src/vec/olap/vertical_block_reader.cpp:326 13# doris::vectorized::VerticalBlockReader::_update_agg_data(std::vector<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn>, std::allocator<COW<doris::vectorized::IColumn>::mutable_ptr<doris::vectorized::IColumn> > >&) at /root/doris_branch-2.1/doris/be/src/vec/olap/vertical_block_reader.cpp:308 14# doris::vectorized::VerticalBlockReader::_agg_key_next_block(doris::vectorized::Block*, bool*) in /mnt/disk1/STRESS_ENV/be/lib/doris_be 15# doris::vectorized::VerticalBlockReader::next_block_with_aggregation(doris::vectorized::Block*, bool*) at /root/doris_branch-2.1/doris/be/src/vec/olap/vertical_block_reader.cpp:58 16# doris::Merger::vertical_compact_one_group(std::shared_ptr<doris::Tablet>, doris::ReaderType, std::shared_ptr<doris::TabletSchema>, bool, std::vector<unsigned int, std::allocator<unsigned int> > const&, doris::vectorized::RowSourcesBuffer*, std::vector<std::shared_ptr<doris::RowsetReader>, std::allocator<std::shared_ptr<doris::RowsetReader> > > const&, doris::RowsetWriter*, long, doris::Merger::Statistics*, std::vector<unsigned int, std::allocator<unsigned int> >, long, doris::CompactionSampleInfo*) in /mnt/disk1/STRESS_ENV/be/lib/doris_be 17# doris::Merger::vertical_merge_rowsets(std::shared_ptr<doris::Tablet>, doris::ReaderType, std::shared_ptr<doris::TabletSchema>, std::vector<std::shared_ptr<doris::RowsetReader>, std::allocator<std::shared_ptr<doris::RowsetReader> > > const&, doris::RowsetWriter*, long, long, doris::Merger::Statistics*) at /root/doris_branch-2.1/doris/be/src/olap/merger.cpp:445 18# doris::Compaction::do_compaction_impl(long) at /root/doris_branch-2.1/doris/be/src/olap/compaction.cpp:385 19# doris::Compaction::do_compaction(long) at /root/doris_branch-2.1/doris/be/src/olap/compaction.cpp:136 20# doris::CumulativeCompaction::execute_compact_impl() at /root/doris_branch-2.1/doris/be/src/olap/cumulative_compaction.cpp:79 21# doris::Compaction::execute_compact() at /root/doris_branch-2.1/doris/be/src/olap/compaction.cpp:118 22# doris::Tablet::execute_compaction(doris::Compaction&) at /root/doris_branch-2.1/doris/be/src/olap/tablet.cpp:2067 23# std::_Function_handler<void (), doris::StorageEngine::_submit_compaction_task(std::shared_ptr<doris::Tablet>, doris::CompactionType, bool)::$_0>::_M_invoke(std::_Any_data const&) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:291 24# doris::ThreadPool::dispatch_thread() in /mnt/disk1/STRESS_ENV/be/lib/doris_be 25# doris::Thread::supervise_thread(void*) at /root/doris_branch-2.1/doris/be/src/util/thread.cpp:499 26# start_thread at ./nptl/pthread_create.c:442 27# 0x00007F4AB19DC850 at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:83 ```

## Proposed changes When a cmd is executed, we can cancel the reference to the `executor` to release the related resources. Otherwise, these resources can only be released when the next cmd is executed.

…pache#40913) ## Proposed changes The default value of `enable_fallback_to_original_planner` in master is `false`, but the default value in 2.1 is `true`. So it needs to be unified to `false` for testing.

…che#40919) This adjustment is based on the analysis that each entry in the params map is roughly 1KB, thus the old limit resulted in a 50KB footprint. With no concurrency issues, expanding the batch size to 1000 should enhance processing efficiency with a reasonable 1MB memory footprint.

…pache#240) (apache#40885) update clucene for apache/doris-thirdparty#240

…ly inserted rows in partial update (apache#40272) ## Proposed changes ### 1. Fix `__DORIS_SEQUENCE_COL__` is not set for newly inserted rows in partial update before: ```sql MySQL root@127.1:d1> CREATE TABLE IF NOT EXISTS t3 ( -> `k` BIGINT NOT NULL, -> `c1` int, -> `c2` datetime default current_timestamp, -> ) UNIQUE KEY(`k`) -> DISTRIBUTED BY HASH(`k`) BUCKETS 1 -> PROPERTIES ( -> "replication_allocation" = "tag.location.default: 1", -> "enable_unique_key_merge_on_write" = "true", -> "function_column.sequence_col" = "c2" -> ); Query OK, 0 rows affected MySQL root@127.1:d1> set enable_insert_strict=false; MySQL root@127.1:d1> set enable_unique_key_partial_update=true; MySQL root@127.1:d1> insert into t3(k,c1) values(99,99); MySQL root@127.1:d1> set show_hidden_columns=true; MySQL root@127.1:d1> select * from t3; +----+----+---------------------+-----------------------+-----------------------+------------------------+ | k | c1 | c2 | __DORIS_DELETE_SIGN__ | __DORIS_VERSION_COL__ | __DORIS_SEQUENCE_COL__ | +----+----+---------------------+-----------------------+-----------------------+------------------------+ | 99 | 99 | 2024-09-02 11:03:09 | 0 | 2 | <null> | +----+----+---------------------+-----------------------+-----------------------+------------------------+ ``` after: ```sql MySQL root@127.1:d1> CREATE TABLE IF NOT EXISTS t3 ( -> `k` BIGINT NOT NULL, -> `c1` int, -> `c2` datetime default current_timestamp, -> ) UNIQUE KEY(`k`) -> DISTRIBUTED BY HASH(`k`) BUCKETS 1 -> PROPERTIES ( -> "replication_allocation" = "tag.location.default: 1", -> "enable_unique_key_merge_on_write" = "true", -> "function_column.sequence_col" = "c2" -> ); Query OK, 0 rows affected MySQL root@127.1:d1> set enable_insert_strict=false; MySQL root@127.1:d1> set enable_unique_key_partial_update=true; MySQL root@127.1:d1> insert into t3(k,c1) values(1,10); MySQL root@127.1:d1> set show_hidden_columns=true; MySQL root@127.1:d1> select * from t3; +---+----+---------------------+-----------------------+-----------------------+------------------------+ | k | c1 | c2 | __DORIS_DELETE_SIGN__ | __DORIS_VERSION_COL__ | __DORIS_SEQUENCE_COL__ | +---+----+---------------------+-----------------------+-----------------------+------------------------+ | 1 | 10 | 2024-09-02 16:49:50 | 0 | 2 | 2024-09-02 16:49:50 | +---+----+---------------------+-----------------------+-----------------------+------------------------+ ``` ### 2. Fix `current_timestamp()` precision loss for newly inserted rows in partial update before: ```sql MySQL root@127.1:d1> CREATE TABLE IF NOT EXISTS t3 ( -> `k` BIGINT NOT NULL, -> `c1` int, -> `c2` datetime(6) default current_timestamp(6), -> ) UNIQUE KEY(`k`) -> DISTRIBUTED BY HASH(`k`) BUCKETS 1 -> PROPERTIES ( -> "replication_allocation" = "tag.location.default: 1", -> "enable_unique_key_merge_on_write" = "true", -> "function_column.sequence_col" = "c2" -> ); Query OK, 0 rows affected MySQL root@127.1:d1> set enable_unique_key_partial_update=true; MySQL root@127.1:d1> set enable_insert_strict=false; MySQL root@127.1:d1> insert into t3(k,c1) values(3,10); MySQL root@127.1:d1> set show_hidden_columns=true; MySQL root@127.1:d1> select * from t3; +---+----+----------------------------+-----------------------+-----------------------+----------------------------+ | k | c1 | c2 | __DORIS_DELETE_SIGN__ | __DORIS_VERSION_COL__ | __DORIS_SEQUENCE_COL__ | +---+----+----------------------------+-----------------------+-----------------------+----------------------------+ | 3 | 10 | 2024-09-02 19:04:55 | 0 | 2 | <null> | +---+----+----------------------------+-----------------------+-----------------------+----------------------------+ ``` after: ```sql MySQL root@127.1:d1> CREATE TABLE IF NOT EXISTS t3 ( -> `k` BIGINT NOT NULL, -> `c1` int, -> `c2` datetime(6) default current_timestamp(6), -> ) UNIQUE KEY(`k`) -> DISTRIBUTED BY HASH(`k`) BUCKETS 1 -> PROPERTIES ( -> "replication_allocation" = "tag.location.default: 1", -> "enable_unique_key_merge_on_write" = "true", -> "function_column.sequence_col" = "c2" -> ); Query OK, 0 rows affected MySQL root@127.1:d1> set enable_unique_key_partial_update=true; MySQL root@127.1:d1> set enable_insert_strict=false; MySQL root@127.1:d1> insert into t3(k,c1) values(3,10); MySQL root@127.1:d1> set show_hidden_columns=true; MySQL root@127.1:d1> select * from t3; +---+----+----------------------------+-----------------------+-----------------------+----------------------------+ | k | c1 | c2 | __DORIS_DELETE_SIGN__ | __DORIS_VERSION_COL__ | __DORIS_SEQUENCE_COL__ | +---+----+----------------------------+-----------------------+-----------------------+----------------------------+ | 3 | 10 | 2024-09-02 19:04:55.464438 | 0 | 2 | 2024-09-02 19:04:55.464438 | +---+----+----------------------------+-----------------------+-----------------------+----------------------------+ ```

…apache#40730)

) select e1 from (select 1) t lateral view explode(**(select sequence(CURRENT_DATE(), date_add(CURRENT_DATE(), interval 2 day)))**) t2 as e1; The **subquery** in explode is supported by this pr

…#40364)

support display previous query id. mysql> select LAST_QUERY_ID(); No connection. Trying to reconnect... Connection id: 0 Current database: *** NONE *** +-----------------+ | last_query_id() | +-----------------+ | Not Available | +-----------------+ 1 row in set (0.08 sec) mysql> select LAST_QUERY_ID(); +-----------------------------------+ | last_query_id() | +-----------------------------------+ | e133f2641e0a411c-b73f1f6c67bedcf9 | +-----------------------------------+ 1 row in set (0.01 sec)

…ith sync mv (apache#40190) doc: apache/doris-website#1103

## Proposed changes 1. remove some unused maps in RuntimeFilterContext 2. let runtime filter use cte as target Issue Number: close #xxx

…pache#39671) ## Proposed changes [[Fix](http)Ignore exceptions when getting system information errors](apache@9f749d5) Fetching system information often requires compatibility adjustments across various operating systems. As a result, some systems may not be fully compatible, potentially causing errors with the interface. These errors are suppressed here because they typically do not affect normal business.

…imit (apache#40961) ## Proposed changes bug is introduced by apache#40542 Co-authored-by: yiguolei <yiguolei@gmail.com>

…che#40953) ## Proposed changes fix problem like this: ``` set enable_common_expr_pushdown=false; create table t(a int, c varchar(1024)) PROPERTIES ("replication_allocation" = "tag.location.default: 1"); insert into t values(1, "a b c d e"); SELECT count() FROM t where c MATCH_PHRASE_EDGE 's'; I20240919 09:31:40.713896 2224044 internal_service.cpp:626] Cancel query 3e48a306704f4691-840d239bf31420aa, reason: [INTERNAL_ERROR]PStatus: (127.0.0.1)[INTERNAL_ERROR]Column match_phrase_edge({"c", "String"}) in block is nullptr, in method bytes. All Columns are c String match_phrase_edge({"c", "String"}) 3# doris::vectorized::Block::allocated_bytes() const at be/src/vec/core/block.cpp:446 4# doris::vectorized::ScannerScheduler::_scanner_scan(std::shared_ptr<doris::vectorized::ScannerContext>, std::shared_ptr<doris::vectorized::ScanTask>) at be/src/vec/exec/scan/scanner_scheduler.cpp:243 ```

## Proposed changes Issue Number: close #xxx  Co-authored-by: stephen <hello-stephen@qq.com>

…he#41170 (apache#41957) cherry pick from apache#41170

…pache#41761 (apache#41832) cherry pick from apache#41761

…#42002) cherry pick from apache#41796

…che#40958) (apache#41934) cherry-pick: (apache#40958) isLeading in cascade context means do we have leading in this scope isLeadingDisableJoinReorder means does leading used we need to copy it after analyze outerside of cte ## Proposed changes Issue Number: close #xxx

…rom_fixed_json (apache#41217) (apache#41963) bp apache#41217

…es. (apache#38432) (apache#41825) bp apache#38432

…xternal table (apache#41575) (apache#41842) pick: apache#41575

) cherry-pick from master apache#39316

…apache#41683 apache#41816) (apache#41923) ## Proposed changes pick prs: apache#41506 apache#41526 apache#41683 apache#41816 --------- Co-authored-by: morningman <morningman@163.com>

…#41743 apache#41845 apache#41857 apache#41902 apache#41601 apache#41667 apache#41751 (apache#42031) pick apache#41292 apache#41589 apache#41628 apache#41743 apache#41845 apache#41857 apache#41902 apache#41601 apache#41667 apache#41751 Co-authored-by: Pxl <pxl290@qq.com>

apache#42009) … (apache#40697) this pr we support array_agg function support param with array map struct type ## Proposed changes Issue Number: close #xxx

…ex speed pick apache#41768

…sing for ip/variant (apache#42026) pick apache#41666

…42024) pick apache#41595

bp apache#41391

…ount when reading ExternalTable (apache#41659) (apache#41962) bp apache#41659 ## Proposed changes Because ExternalTable will initialize the previously uninitialized table when `getCachedRowCount()`, which is unnecessary. So for the uninitialized table, we directly return -1. This will increase the speed of our query `information_schema.tables`.

…che#41951) load failed where not set database in session, should use label's database if not set database in session LOAD LABEL test_db.label_111111 ( DATA INFILE("hdfs://hdfs01:9000/user/") INTO TABLE `test_load_tb`) WITH BROKER "broker" ( "username" = "user", "password" = ""); ERROR 1105 (HY000): errCode = 2, detailMessage = Current database is not set.

doris-robot · 2024-10-18T07:12:59Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

hubgeter and others added 30 commits October 5, 2024 19:46

[chore](enhance) Added order by create_time for show routine load (ap…

e279138

…ache#40783) ## Proposed changes Issue Number: close #xxx  <img width="674" alt="image" src="https://github.com/user-attachments/assets/b55cdb48-9108-4d55-9112-7e401cdbba07">

[fix](stream-load) catch exception when parsing CONTENT_LENGTH (apach…

1b11a35

…e#40796) Catch exception when parsing numbers from HTTP header `CONTENT_LENGTH`.

[chore](github)Update CODEOWNERS (apache#40686)

4bc48d1

[Chore](case) move slow case to p1 (apache#40860)

f869e50

## Proposed changes move slow case to p1

Revert "[fix](scanner) Fix incorrect _max_thread_num in scanner conte…

18588c5

…xt" (apache#40804) Reverts apache#40569 We need more test to avoid performance issue

[improvement](statistics)User admin instead of root to run stats sql. (…

5790c96

…apache#40867) User admin instead of root to run stats sql.

[Enhancement]use awaitility.await() (apache#40112)

b6d1345

## Proposed changes Issue Number: close #xxx apache#37817 use awaitility in few testcases

[chore](variable) remove enable_nereids_planner flag (apache#40743)

aa55101

[Fix]Fix thread num not reset 0 when fetch failed (apache#40855)

834f12a

[improvement](mem)Dereference for executor (apache#40800)

1a1af8c

## Proposed changes When a cmd is executed, we can cancel the reference to the `executor` to release the related resources. Otherwise, these resources can only be released when the next cmd is executed.

[bugfix](test)Set the enable_fallback_to_original_planner behavior (a…

0284724

…pache#40913) ## Proposed changes The default value of `enable_fallback_to_original_planner` in master is `false`, but the default value in 2.1 is `true`. So it needs to be unified to `false` for testing.

[fix](clucene) update clucene: fix CLStream memcpy read 1 extra byte (a…

79c3338

…pache#240) (apache#40885) update clucene for apache/doris-thirdparty#240

[Fix](partial update) Fix partial update failed when merge_type=MERGE (…

5e03140

…apache#40730)

[improve](stack) do not report stack for -230 (apache#40716)

074a240

[enhancement](nereids)support subquery in LogicalGenerator (apache#40663

8583430

) select e1 from (select 1) t lateral view explode(**(select sequence(CURRENT_DATE(), date_add(CURRENT_DATE(), interval 2 day)))**) t2 as e1; The **subquery** in explode is supported by this pr

[Featrue](default value) Support bitmap_empty default value (apache…

0ff5909

…#40364)

[opt](partial update) Forbid partial update on merge-on-write table w…

80226fe

…ith sync mv (apache#40190) doc: apache/doris-website#1103

[opt](nereids) enable runtime filter use cte as target (apache#40815)

0fec418

## Proposed changes 1. remove some unused maps in RuntimeFilterContext 2. let runtime filter use cte as target Issue Number: close #xxx

[bugfix](cache) the cache capacity is wrong when memusage > soft meml…

cc30015

…imit (apache#40961) ## Proposed changes bug is introduced by apache#40542 Co-authored-by: yiguolei <yiguolei@gmail.com>

hello-stephen and others added 18 commits October 17, 2024 10:23

[chore](case) adjust db name (apache#41997)

9d92ae9

## Proposed changes Issue Number: close #xxx  Co-authored-by: stephen <hello-stephen@qq.com>

[opt](blacklist) Backend should not be added to blacklist easily apac…

9103d77

…he#41170 (apache#41957) cherry pick from apache#41170

[opt](profile) Move ExecutedByFrontend to execution summary profile a…

6ae195f

…pache#41761 (apache#41832) cherry pick from apache#41761

[chore](ddl) support force_enable_feature_binlog apache#41796 (apache…

ae15757

…#42002) cherry pick from apache#41796

[fix](serde)fix the bug in DataTypeNullableSerDe.deserialize_column_f…

bf0250a

…rom_fixed_json (apache#41217) (apache#41963) bp apache#41217

[feature](hive)Support reading renamed Parquet Hive and Orc Hive tabl…

8bec0e9

…es. (apache#38432) (apache#41825) bp apache#38432

[enhance](catalog)Allow parallel running of insert overwrite on the e…

ea0fb5e

…xternal table (apache#41575) (apache#41842) pick: apache#41575

[fix](Nereids) fixed the limit offset error (apache#39316) (apache#41967

4ce294f

) cherry-pick from master apache#39316

[cherry-pick](branch-3.0) fix parquet cases (apache#41506 apache#41526 …

e634f0d

…apache#41683 apache#41816) (apache#41923) ## Proposed changes pick prs: apache#41506 apache#41526 apache#41683 apache#41816 --------- Co-authored-by: morningman <morningman@163.com>

[feature](array_agg) support array_agg with param is array/map/struct… (

ce9c0a3

apache#42009) … (apache#40697) this pr we support array_agg function support param with array map struct type ## Proposed changes Issue Number: close #xxx

[improve](ip-function)improve is_ip_address_in_range for inverted ind…

5982b01

…ex speed pick apache#41768

[fix](information-meta) fix information column_type and data_type mis…

92ed832

…sing for ip/variant (apache#42026) pick apache#41666

[fix](array/map) fix resize impl in array/map (apache#41595) (apache#…

174ac08

…42024) pick apache#41595

[feat](job)Implementing Job in Nereids (apache#41391) (apache#41861)

1a61cb4

bp apache#41391

zxealous requested review from BiteTheDDDDt, CalvinKirs, dataroaring, gavinchou, morningman, platoneko, xiaokang and yiguolei as code owners October 18, 2024 07:12

zxealous closed this Oct 18, 2024

zxealous deleted the fix-load-branch-3.0 branch October 18, 2024 07:14

zxealous restored the fix-load-branch-3.0 branch October 18, 2024 07:14

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[fix](nereids) Fix load failed where not set database in session (#41951) #42080

[fix](nereids) Fix load failed where not set database in session (#41951) #42080

Uh oh!

zxealous commented Oct 18, 2024

Uh oh!

doris-robot commented Oct 18, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

[fix](nereids) Fix load failed where not set database in session (#41951) #42080

[fix](nereids) Fix load failed where not set database in session (#41951) #42080

Uh oh!

Conversation

zxealous commented Oct 18, 2024

Proposed changes

Uh oh!

doris-robot commented Oct 18, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants