-
Notifications
You must be signed in to change notification settings - Fork 11
Expose embedding indexes of Dataset #408
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
I'm not a big fan of the |
|
@pfmark Good point, renamed! |
| status: IndexStatus | ||
| index_type: IndexType | ||
| index_level: IndexLevel | ||
| embedding_type: str |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Would it make sense to create an enum for this one as well? I was hesitant because it contains valid values like EfficientNetB7 but also arbitrary ones like unknown
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we can try w/o it for now
jean-lucas
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm
CHANGELOG.md
Outdated
|
|
||
| ### Added | ||
| - Allow direct embedding vector upload together with dataset items. `DatasetItem` now has an additional parameter called `embedding_info` which can be used to directly upload embeddings when a dataset is uploaded. | ||
| - Added `dataset.search_indexes` property, which exposes information about every search index which belongs to the dataset. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is it embedding_indexes now or search_indexes?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should also be embedding_indexes
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice catch, thanks!
| @dataclass | ||
| class EmbeddingIndex: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nice 👍
| status: IndexStatus | ||
| index_type: IndexType | ||
| index_level: IndexLevel | ||
| embedding_type: str |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we can try w/o it for now
No description provided.