[v17] MB-27666: Nested Fields

[CascadingRadium]

• Zapx now handles nested documents by creating and storing an edge list indicating document relationships.
• Exposed new APIs:
  • Ancestors that allows the caller to fetch the ancestry chain of the requested document.
  • CountRoot which returns the number of root documents in the segment (excluding nested documents)
• The total number of documents in the segment will include the nested documents as well.

Requires:

• [v17] MB-27666: Nested Fields bleve_index_api#70
• [v17] MB-27666: Nested Fields scorch_segment_api#63

[Copilot]

Pull Request Overview

This PR adds support for nested fields within the Zapx indexing API, enabling indexing and querying of hierarchical data structures. The implementation includes functionality to handle nested document relationships through parent-child edges and provides efficient caching mechanisms.

Key changes include:

• Added nested document indexing with parent-child relationship tracking through edge lists
• Implemented nested index cache system for efficient ancestry and descendant lookups
• Modified document counting to distinguish between root documents and nested sub-documents

Reviewed Changes

Copilot reviewed 10 out of 10 changed files in this pull request and generated 4 comments.

Show a summary per file

File	Description
segment.go	Core segment functionality with nested index cache integration and document relationship methods
nested_cache.go	New caching system for nested document relationships with ancestry/descendant tracking
new.go	Document flattening logic and edge list serialization for nested structures
merge.go	Merge operations extended to handle nested document edge lists and sub-document drops
read.go	Added method to calculate edge list offset in segment data
dict.go	Dictionary operations updated to include sub-documents in exclusion handling
faiss_vector_posting.go	Vector index operations updated to handle sub-document exclusions
build.go	Segment base initialization updated to include nested index cache
section_inverted_text_index.go	Reset functionality updated to clear field addresses map
section_synonym_index.go	Reset functionality updated to clear thesaurus addresses map

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[Copilot]

Pull Request Overview

Copilot reviewed 10 out of 10 changed files in this pull request and generated 2 comments.

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[Copilot]

Pull Request Overview

Copilot reviewed 10 out of 10 changed files in this pull request and generated 5 comments.

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[Copilot]

Pull Request Overview

Copilot reviewed 10 out of 10 changed files in this pull request and generated 6 comments.

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[Copilot]

Pull Request Overview

Copilot reviewed 10 out of 10 changed files in this pull request and generated 1 comment.

Comments suppressed due to low confidence (1)

merge.go:1

• The word 'descendent' should be spelled 'descendant' to match the correct spelling used elsewhere in the codebase.

//  Copyright (c) 2017 Couchbase, Inc.

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[Copilot]

Pull Request Overview

Copilot reviewed 10 out of 10 changed files in this pull request and generated 1 comment.

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[abhinavdangeti]

Per plan, let's target this to the unstable-v17 branch.