Skip to content

Auto-conflict resolution for compact and reindex #5143

@wjones127

Description

@wjones127

If one process re-indexes while another compacts, and then re-indexing commits first, users can get errors like:

Invalid compaction plan refers to index df68f95c-e005-4c61-ad9d-0e74710c355d which does not exist

This comes from

https://github.com/lancedb/lance/blob/c4f6cfc51c0703eaf5648bdae9b3618dc903ff30/rust/lance/src/dataset/transaction.rs#L2552-L2563

There may be other places where we get conflicts.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions