Skip to content

Writing to Iceberg with partitioning not working #1350

@ianton-ru

Description

@ianton-ru

Describe the bug
A clear and concise description of what the bug is.

To Reproduce

set allow_experimental_insert_into_iceberg=1;

attach table test UUID '0ff90094-cc91-442b-8da4-85bc504640c6' (datetime DateTime, value UInt32) engine=Iceberg(s3_conn, filename='test', format='Parquet') partition by toRelativeDayNum(datetime);

insert into test values ('2021-01-01 21:00:00', 1)

[clickhouse1] 2026.01.27 16:00:00.227298 [ 88 ] <Fatal> BaseDaemon: ########################################
[clickhouse1] 2026.01.27 16:00:00.227358 [ 88 ] <Fatal> BaseDaemon: (version 25.8.14.20001.altinityantalya, build id: 351E9FFE87F02DDDF062C84419448477DE9B9020, git hash: 40516269d1e21d258db6365926ba5fc4f963dfb2) (from thread 783) (query_id: d753d08b-3df1-4192-a144-761f5d2e782f) (query: insert into test values ) Received signal Segmentation fault (11)
[clickhouse1] 2026.01.27 16:00:00.227406 [ 88 ] <Fatal> BaseDaemon: Address: 0x643f195cb078. Access: read. Address not mapped to object.
[clickhouse1] 2026.01.27 16:00:00.227451 [ 88 ] <Fatal> BaseDaemon: Stack trace: 0x00007e3d6382e84e 0x0000643ec8ef6ceb 0x0000643ec846096b 0x0000643ec84644a9 0x0000643ecded84d3 0x0000643ecdddc801 0x0000643ecdddc605 0x0000643ecdddc109 0x0000643ecdb48ce0 0x0000643ecdb3bbd2 0x0000643ecdb3d0c5 0x0000643ec3a69355 0x0000643ec3a6ec66 0x0000643ec3a66d20 0x0000643ec3a6ccfb 0x00007e3d63722ac3 0x00007e3d637b3a74
[clickhouse1] 2026.01.27 16:00:00.227525 [ 88 ] <Fatal> BaseDaemon: 3. ? @ 0x00000000001a084e
[clickhouse1] 2026.01.27 16:00:00.234604 [ 88 ] <Fatal> BaseDaemon: 4.0. inlined from ./contrib/llvm-project/libcxx/include/__string/constexpr_c_functions.h:227: char* std::__constexpr_memmove[abi:ne190107]<char, char const, 0>(char*, char const*, std::__element_count)
[clickhouse1] 2026.01.27 16:00:00.234700 [ 88 ] <Fatal> BaseDaemon: 4.1. inlined from ./contrib/llvm-project/libcxx/include/__string/char_traits.h:148: std::char_traits<char>::copy[abi:ne190107](char*, char const*, unsigned long)
[clickhouse1] 2026.01.27 16:00:00.234713 [ 88 ] <Fatal> BaseDaemon: 4.2. inlined from ./contrib/llvm-project/libcxx/include/string:2343: String::__init(char const*, unsigned long)
[clickhouse1] 2026.01.27 16:00:00.234727 [ 88 ] <Fatal> BaseDaemon: 4.3. inlined from ./contrib/llvm-project/libcxx/include/string:1078: basic_string
[clickhouse1] 2026.01.27 16:00:00.234748 [ 88 ] <Fatal> BaseDaemon: 4.4. inlined from ./src/Core/Field.h:608: void DB::Field::create<char>(T const*, unsigned long)
[clickhouse1] 2026.01.27 16:00:00.234774 [ 88 ] <Fatal> BaseDaemon: 4. ./src/Core/Field.h:760: DB::Field::operator=(std::basic_string_view<char, std::char_traits<char>>) @ 0x0000000017096ceb
[clickhouse1] 2026.01.27 16:00:00.275247 [ 88 ] <Fatal> BaseDaemon: 5. /home/iantonspb/ch-build/./src/Storages/ObjectStorage/DataLakes/Iceberg/IcebergWrites.cpp:1024: DB::ChunkPartitioner::partitionChunk(DB::Chunk const&) @ 0x000000001660096b
[clickhouse1] 2026.01.27 16:00:00.317927 [ 88 ] <Fatal> BaseDaemon: 6. /home/iantonspb/ch-build/./src/Storages/ObjectStorage/DataLakes/Iceberg/IcebergWrites.cpp:1225: DB::IcebergStorageSink::consume(DB::Chunk&) @ 0x00000000166044a9
[clickhouse1] 2026.01.27 16:00:00.321121 [ 88 ] <Fatal> BaseDaemon: 7. /home/iantonspb/ch-build/./src/Processors/Sinks/SinkToStorage.cpp:10: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001c0784d3
[clickhouse1] 2026.01.27 16:00:00.327293 [ 88 ] <Fatal> BaseDaemon: 8.0. inlined from /home/iantonspb/ch-build/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:134: operator()
[clickhouse1] 2026.01.27 16:00:00.327383 [ 88 ] <Fatal> BaseDaemon: 8.1. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:149: decltype(std::declval<DB::ExceptionKeepingTransform::work()::$_1&>()()) std::__invoke[abi:ne190107]<DB::ExceptionKeepingTransform::work()::$_1&>(DB::ExceptionKeepingTransform::work()::$_1&)
[clickhouse1] 2026.01.27 16:00:00.327406 [ 88 ] <Fatal> BaseDaemon: 8.2. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:224: void std::__invoke_void_return_wrapper<void, true>::__call[abi:ne190107]<DB::ExceptionKeepingTransform::work()::$_1&>(DB::ExceptionKeepingTransform::work()::$_1&)
[clickhouse1] 2026.01.27 16:00:00.327411 [ 88 ] <Fatal> BaseDaemon: 8.3. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:210: ?
[clickhouse1] 2026.01.27 16:00:00.327458 [ 88 ] <Fatal> BaseDaemon: 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:610: ? @ 0x000000001bf7c801
[clickhouse1] 2026.01.27 16:00:00.333235 [ 88 ] <Fatal> BaseDaemon: 9.0. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ?
[clickhouse1] 2026.01.27 16:00:00.333289 [ 88 ] <Fatal> BaseDaemon: 9.1. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:989: ?
[clickhouse1] 2026.01.27 16:00:00.333325 [ 88 ] <Fatal> BaseDaemon: 9. /home/iantonspb/ch-build/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:103: DB::runStep(std::function<void ()>, std::shared_ptr<DB::ThreadGroup>&) @ 0x000000001bf7c605
[clickhouse1] 2026.01.27 16:00:00.337080 [ 88 ] <Fatal> BaseDaemon: 10. /home/iantonspb/ch-build/./src/Processors/Transforms/ExceptionKeepingTransform.cpp:134: DB::ExceptionKeepingTransform::work() @ 0x000000001bf7c109
[clickhouse1] 2026.01.27 16:00:00.339698 [ 88 ] <Fatal> BaseDaemon: 11.0. inlined from /home/iantonspb/ch-build/./src/Processors/Executors/ExecutionThreadContext.cpp:53: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*)
[clickhouse1] 2026.01.27 16:00:00.339742 [ 88 ] <Fatal> BaseDaemon: 11. /home/iantonspb/ch-build/./src/Processors/Executors/ExecutionThreadContext.cpp:102: DB::ExecutionThreadContext::executeTask() @ 0x000000001bce8ce0
[clickhouse1] 2026.01.27 16:00:00.348665 [ 88 ] <Fatal> BaseDaemon: 12. /home/iantonspb/ch-build/./src/Processors/Executors/PipelineExecutor.cpp:351: DB::PipelineExecutor::executeStepImpl(unsigned long, DB::IAcquiredSlot*, std::atomic<bool>*) @ 0x000000001bcdbbd2
[clickhouse1] 2026.01.27 16:00:00.358569 [ 88 ] <Fatal> BaseDaemon: 13.0. inlined from /home/iantonspb/ch-build/./src/Processors/Executors/PipelineExecutor.cpp:279: DB::PipelineExecutor::executeSingleThread(unsigned long, DB::IAcquiredSlot*)
[clickhouse1] 2026.01.27 16:00:00.358624 [ 88 ] <Fatal> BaseDaemon: 13.1. inlined from /home/iantonspb/ch-build/./src/Processors/Executors/PipelineExecutor.cpp:565: operator()
[clickhouse1] 2026.01.27 16:00:00.358643 [ 88 ] <Fatal> BaseDaemon: 13.2. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:149: decltype(std::declval<DB::PipelineExecutor::spawnThreads(std::shared_ptr<DB::IAcquiredSlot>)::$_0&>()()) std::__invoke[abi:ne190107]<DB::PipelineExecutor::spawnThreads(std::shared_ptr<DB::IAcquiredSlot>)::$_0&>(DB::PipelineExecutor::spawnThreads(std::shared_ptr<DB::IAcquiredSlot>)::$_0&)
[clickhouse1] 2026.01.27 16:00:00.358686 [ 88 ] <Fatal> BaseDaemon: 13.3. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:224: void std::__invoke_void_return_wrapper<void, true>::__call[abi:ne190107]<DB::PipelineExecutor::spawnThreads(std::shared_ptr<DB::IAcquiredSlot>)::$_0&>(DB::PipelineExecutor::spawnThreads(std::shared_ptr<DB::IAcquiredSlot>)::$_0&)
[clickhouse1] 2026.01.27 16:00:00.358734 [ 88 ] <Fatal> BaseDaemon: 13.4. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:210: ?
[clickhouse1] 2026.01.27 16:00:00.358784 [ 88 ] <Fatal> BaseDaemon: 13. ./contrib/llvm-project/libcxx/include/__functional/function.h:610: ? @ 0x000000001bcdd0c5
[clickhouse1] 2026.01.27 16:00:00.366075 [ 88 ] <Fatal> BaseDaemon: 14.0. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ?
[clickhouse1] 2026.01.27 16:00:00.366123 [ 88 ] <Fatal> BaseDaemon: 14.1. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:989: ?
[clickhouse1] 2026.01.27 16:00:00.366167 [ 88 ] <Fatal> BaseDaemon: 14. /home/iantonspb/ch-build/./src/Common/ThreadPool.cpp:802: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::worker() @ 0x0000000011c09355
[clickhouse1] 2026.01.27 16:00:00.372034 [ 88 ] <Fatal> BaseDaemon: 15.0. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:117: decltype(*std::declval<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&>().*std::declval<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)()>()()) std::__invoke[abi:ne190107]<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&, void>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&)
[clickhouse1] 2026.01.27 16:00:00.372143 [ 88 ] <Fatal> BaseDaemon: 15.1. inlined from ./contrib/llvm-project/libcxx/include/tuple:1354: decltype(auto) std::__apply_tuple_impl[abi:ne190107]<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), std::tuple<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>&, 0ul>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), std::tuple<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>&, std::__tuple_indices<0ul>)
[clickhouse1] 2026.01.27 16:00:00.372184 [ 88 ] <Fatal> BaseDaemon: 15.2. inlined from ./contrib/llvm-project/libcxx/include/tuple:1358: decltype(auto) std::apply[abi:ne190107]<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), std::tuple<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>&>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&)(), std::tuple<ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>&)
[clickhouse1] 2026.01.27 16:00:00.372222 [ 88 ] <Fatal> BaseDaemon: 15. ./src/Common/ThreadPool.h:312: ThreadFromGlobalPoolImpl<false, true>::ThreadFromGlobalPoolImpl<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&&)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&&)::'lambda'()::operator()() @ 0x0000000011c0ec66
[clickhouse1] 2026.01.27 16:00:00.377882 [ 88 ] <Fatal> BaseDaemon: 16.0. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ?
[clickhouse1] 2026.01.27 16:00:00.377976 [ 88 ] <Fatal> BaseDaemon: 16.1. inlined from ./contrib/llvm-project/libcxx/include/__functional/function.h:989: ?
[clickhouse1] 2026.01.27 16:00:00.377988 [ 88 ] <Fatal> BaseDaemon: 16. /home/iantonspb/ch-build/./src/Common/ThreadPool.cpp:812: ThreadPoolImpl<std::thread>::ThreadFromThreadPool::worker() @ 0x0000000011c06d20
[clickhouse1] 2026.01.27 16:00:00.388855 [ 88 ] <Fatal> BaseDaemon: 17.0. inlined from ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:117: decltype(*std::declval<ThreadPoolImpl<std::thread>::ThreadFromThreadPool*>().*std::declval<void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)()>()()) std::__invoke[abi:ne190107]<void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*, void>(void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*&&)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*&&)
[clickhouse1] 2026.01.27 16:00:00.388923 [ 88 ] <Fatal> BaseDaemon: 17.1. inlined from ./contrib/llvm-project/libcxx/include/__thread/thread.h:192: void std::__thread_execute[abi:ne190107]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*, 2ul>(std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*>&, std::__tuple_indices<2ul>)
[clickhouse1] 2026.01.27 16:00:00.388942 [ 88 ] <Fatal> BaseDaemon: 17. ./contrib/llvm-project/libcxx/include/__thread/thread.h:201: void* std::__thread_proxy[abi:ne190107]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*>>(void*) @ 0x0000000011c0ccfb
[clickhouse1] 2026.01.27 16:00:00.389009 [ 88 ] <Fatal> BaseDaemon: 18. ? @ 0x0000000000094ac3
[clickhouse1] 2026.01.27 16:00:00.389061 [ 88 ] <Fatal> BaseDaemon: 19. ? @ 0x0000000000125a74
[clickhouse1] 2026.01.27 16:00:00.389101 [ 88 ] <Fatal> BaseDaemon: Integrity check of the executable skipped because the reference checksum could not be read.
[clickhouse1] 2026.01.27 16:00:01.945388 [ 88 ] <Fatal> BaseDaemon: Changed settings: allow_experimental_insert_into_iceberg = true

Expected behavior
Writes work

Additional context
The same in latest upstream master branch

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions