Skip to content
This repository was archived by the owner on Jun 14, 2024. It is now read-only.
This repository was archived by the owner on Jun 14, 2024. It is now read-only.

Add RefreshIncrementalAction class to support index creation on newly appended data  #110

@apoorvedave1

Description

@apoorvedave1

Describe the issue

Implement incremental indexing support for append-only data. Implementation outline:

  • identify newly added data files
  • create new index version on these files
  • update metadata to reflect the latest snapshot of index to include old files and new files

New Api: refresh(mode = quick)

To Reproduce

na

Expected behavior

na

Environment

na

Metadata

Metadata

Assignees

Labels

advanced issueThis is the tag for advanced issues which involve major design changes or introductionenhancementNew feature or request

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions