Skip to content

feat: conflict resolution for DataReplacement#3631

Merged
wjones127 merged 4 commits intolance-format:mainfrom
wjones127:feat/data-replacement-conflict-res
Nov 15, 2025
Merged

feat: conflict resolution for DataReplacement#3631
wjones127 merged 4 commits intolance-format:mainfrom
wjones127:feat/data-replacement-conflict-res

Conversation

@wjones127
Copy link
Copy Markdown
Contributor

@wjones127 wjones127 commented Apr 1, 2025

Closes #3686

@github-actions github-actions Bot added the enhancement New feature or request label Apr 1, 2025
@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Apr 1, 2025

Codecov Report

❌ Patch coverage is 89.02439% with 18 lines in your changes missing coverage. Please review.
✅ Project coverage is 82.28%. Comparing base (ae0dcc4) to head (c8c048b).
⚠️ Report is 23 commits behind head on main.

Files with missing lines Patch % Lines
rust/lance/src/io/commit/conflict_resolver.rs 88.95% 12 Missing and 6 partials ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #3631      +/-   ##
==========================================
+ Coverage   81.98%   82.28%   +0.29%     
==========================================
  Files         341      344       +3     
  Lines      141199   144918    +3719     
  Branches   141199   144918    +3719     
==========================================
+ Hits       115758   119240    +3482     
- Misses      21628    21753     +125     
- Partials     3813     3925     +112     
Flag Coverage Δ
unittests 82.28% <89.02%> (+0.29%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@wjones127 wjones127 marked this pull request as ready for review April 2, 2025 23:20
Comment thread rust/lance/src/dataset/transaction.rs Outdated
@eddyxu eddyxu requested a review from jmhsieh April 14, 2025 15:57
Comment thread rust/lance/src/dataset/transaction.rs Outdated
Copy link
Copy Markdown
Contributor

@chebbyChefNEQ chebbyChefNEQ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just two comments on even finer conflict detection. Every thing else look great!

wjones127 and others added 2 commits November 10, 2025 16:40
Closes lance-format#3686

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
…x conflicts

Previously, conflict detection between DataReplacement and CreateIndex only
checked if the fields overlapped. Now also checks if the indexed fragment
bitmap contains the fragment ID being replaced, providing more granular
conflict detection.

When an index has no fragment_bitmap (None), we conservatively assume
conflict to maintain safety.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
@wjones127 wjones127 force-pushed the feat/data-replacement-conflict-res branch from 03b05ab to 55b80f9 Compare November 11, 2025 00:41
@github-actions github-actions Bot removed the Stale label Nov 11, 2025
Copy link
Copy Markdown
Contributor

@jackye1995 jackye1995 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good to me

@wjones127 wjones127 merged commit d2039d7 into lance-format:main Nov 15, 2025
39 of 42 checks passed
@wjones127 wjones127 deleted the feat/data-replacement-conflict-res branch November 15, 2025 17:56
jackye1995 pushed a commit to jackye1995/lance that referenced this pull request Jan 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants