Skip to content

feat(incremental): Make from and to in incremental scan optional#9

Merged
gbrgr merged 6 commits intomainfrom
feature/gb/from-to-optional
Nov 14, 2025
Merged

feat(incremental): Make from and to in incremental scan optional#9
gbrgr merged 6 commits intomainfrom
feature/gb/from-to-optional

Conversation

@gbrgr
Copy link
Copy Markdown
Collaborator

@gbrgr gbrgr commented Nov 13, 2025

Which issue does this PR close?

Closes RAI-44111

What changes are included in this PR?

Makes the from and to snapshot arguments in incremental scanning optional. When from is omitted, we scan from the root snapshot, while when to is omitted, we scan to the latest snapshot.

Are these changes tested?

I modified the existing incremental tests to omit from and to whenever appropriate.

@gbrgr gbrgr marked this pull request as ready for review November 13, 2025 09:52
@gbrgr gbrgr requested a review from vustef November 14, 2025 08:20
Copy link
Copy Markdown
Collaborator

@vustef vustef left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Gerald, just one comment. Also since it's an API change, we have to update iceberg_rust_ffi and RustyIceberg.jl

Comment thread crates/iceberg/src/scan/incremental/mod.rs Outdated
@gbrgr gbrgr enabled auto-merge (squash) November 14, 2025 11:59
@gbrgr gbrgr disabled auto-merge November 14, 2025 11:59
@gbrgr gbrgr enabled auto-merge (squash) November 14, 2025 12:21
@gbrgr gbrgr disabled auto-merge November 14, 2025 13:07
@gbrgr gbrgr merged commit 0de5b03 into main Nov 14, 2025
18 checks passed
@gbrgr gbrgr deleted the feature/gb/from-to-optional branch November 14, 2025 13:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants