Skip to content

[Bug] IcebergScanNode throws exception "Split size must be > 0: 0" #44573

@wenwj0

Description

@wenwj0

Search before asking

  • I had searched in the issues and found no similar issues.

Version

Doris 2.1.6

What's Wrong?

After I upgrade doris from 2.1.5 to 2.1.6, I occasionally encountered an exception when querying iceberg table.

image

The exception may be thrown in org.apache.iceberg.util.TableScanUtil

public static CloseableIterable<FileScanTask> splitFiles(CloseableIterable<FileScanTask> tasks, long splitSize) {
        Preconditions.checkArgument(splitSize > 0L, "Split size must be > 0: %s", splitSize);
        Iterable<FileScanTask> splitTasks = FluentIterable.from(tasks).transformAndConcat((input) -> {
            return input.split(splitSize);
        });
        return CloseableIterable.combine(splitTasks, tasks);
    }

What You Expected?

Expect no exeception

How to Reproduce?

QuerySQL is

SELECT * FROM 
doris_hive_xxx.xxx.ods_xxx_event_iceberg_day 
LIMIT 10;

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions