[waterfall-pr-chain] feat(filter): metadata based filtering. #48
Merged
Intrinsical-AI merged 1 commit intorefactor/test-suitefrom Mar 14, 2026
Merged
Conversation
…etadata.<key> plus legacy fields. Updated Elastic/OpenSearch + Solr to exact resolve filtering
Intrinsical-AI
added a commit
that referenced
this pull request
Mar 14, 2026
…l endpoints (#47) * refactor(test-suite): update, expand, polish. Better conceptual splitting, polished fixtures/conftests. Added tests for critical endpoints * [waterfall-pr-chain] feat(filter): metadata based filtering. (#48) feat(filter): metadata based filtering. Expander contract to accept metadata.<key> plus legacy fields. Updated Elastic/OpenSearch + Solr to exact resolve filtering
6 tasks
Intrinsical-AI
added a commit
that referenced
this pull request
Mar 14, 2026
…ync#44 (#45) * feat(rag): add elasticsearch persistence backend * feat(rag): wire elasticsearch backend through runtime and api * test(rag): cover elasticsearch backend wiring and storage semantics * docs(rag): document elasticsearch backend configuration and behavior * feat(persistence): add scope and snapshot_id columns to document stores Add nullable scope and snapshot_id fields to the SQL Document table and Elasticsearch index mappings, enabling external producers to tag documents with an origin scope and version snapshot. * feat(domain): promote scope and snapshot_id to first-class mutation fields Extend UpsertDocBuilderPort, MutationUpsertInput, and normalization/serialization to carry scope and snapshot_id. Add CanonicalImportSummary result type for reporting insert/update/delete statistics after a canonical import. * feat(use-cases): pass scope and snapshot_id through atomic and saga executors Wire the new fields from MutationUpsertInput into the upsert builder calls in both the atomic and saga mutation execution paths. * feat(persistence): persist scope/snapshot_id and implement list_external_ids_by_scope() Update SQL and Elasticsearch repositories to read/write scope and snapshot_id in upsert, change detection, and domain mapping. Add list_external_ids_by_scope() to both stores to support stale-doc deletion in canonical imports. * feat(http): add POST /api/docs/import-canonical endpoint Introduce CanonicalImportRequest/Response schemas with scope, snapshot_id, replace_scope flag, and duplicate external_id validation. Add the endpoint behind the multi-store write lock. Extend existing mutate endpoint schemas to accept scope/snapshot_id on individual upsert items. * feat(cli): add rag-import-canonical command for declarative scope sync Implement execute_import_canonical_sync() use case: batched upsert (256 docs) with optional replace_scope hard-deletion of stale documents not present in the current snapshot. Wire as rag-import-canonical CLI entry point and register in the CLI group. * docs: add canonical import examples to README and USAGE guide Document the new import-canonical HTTP endpoint and CLI command with curl and CLI invocation examples. Note scope/snapshot synchronization semantics and replace_scope behavior. * (mutate): commit pending file to last batch - missing * fix(lint-format): formatted files * feat(retrieval): add structured retrieval requests and dual-mode planning * feat(search): add remote search backends for opensearch and solr * feat(api): expose retrieval filters and dual mode through HTTP and settings * chore(quality): fix mypy target and vector index fallback * refactor(test-suite): update, expand, polish. Added tests for critical endpoints (#47) * refactor(test-suite): update, expand, polish. Better conceptual splitting, polished fixtures/conftests. Added tests for critical endpoints * [waterfall-pr-chain] feat(filter): metadata based filtering. (#48) feat(filter): metadata based filtering. Expander contract to accept metadata.<key> plus legacy fields. Updated Elastic/OpenSearch + Solr to exact resolve filtering
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
…etadata. plus legacy fields. Updated Elastic/OpenSearch + Solr to exact resolve filtering