feat(oss-opensearch): Add KNN derived source configuration option#632
Conversation
7327025 to
0cd4a11
Compare
|
/assign @alwayslove2013 |
|
Hi @alwayslove2013 I've opened a foundational PR #635, which introduces a new version-aware system for OpenSearch settings. I'm converting this PR to a draft as it depends on the foundational system in #635. Once that merges, I'll update this branch with the new design and mark it as ready for review. |
c816df3 to
a431b05
Compare
a431b05 to
288c72d
Compare
288c72d to
9bdeda5
Compare
|
@alwayslove2013 Can you help reviewing this? |
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: Akhil-Pathivada, alwayslove2013 The full list of commands accepted by this bot can be found here. DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
Problem
OpenSearch 3.x+ enables
knn.derived_source.enabledby default, which allows OpenSearch to derive vectors from the vector values file instead of storing them in the_sourcefield. However, users need a way to control this behavior for their specific use cases:_sourcefor specific requirementsSolution
Added a new configurable option
knn_derived_source_enabledallowing users to:Changes
knn_derived_source_enabled: str | None = Nonefield toOSSOpenSearchIndexConfig_create_index()- only added when explicitly setCaseConfigParamTypeBenefits
Files Changed
vectordb_bench/backend/clients/oss_opensearch/config.pyvectordb_bench/models.pyvectordb_bench/backend/clients/oss_opensearch/oss_opensearch.pyvectordb_bench/frontend/config/dbCaseConfigs.pyScreenshots