[Feature] Support Full-Text Search with Lucene++

[lxy-9602]

Search before asking

• I searched in the issues and found nothing similar.

Motivation

Feature Request: Enable Full-Text Search Using Lucene++

Implement a full-text search system for English/Chinese text, powered by Lucene++, supporting:

• Term queries
• Boolean queries (AND, OR)
• Phrase queries (exact phrase matching)
• Prefix queries (prefix matching)
• Wildcard queries(support */?)
• Score-based result
• LIMIT results by relevance score (top-K retrieval)

Are you willing to submit a PR?

• I'm willing to submit a PR!

[SGZW]

why not tantivy?

[lxy-9602]

why not tantivy?

We chose Lucene++ (CLucene) for the initial implementation primarily because Tantivy is a Rust-based library, and integrating it into our C++ codebase would require additional FFI complexity.

Additionally, while Tantivy is highly efficient, its plugin system (e.g., custom filesystem layers) can be challenging to extend or customize in our current environment.

Our goal is to quickly enable full-text search capabilities with minimal integration overhead. In the future, we may migrate to a more optimized solution using our in-house IndexLib for high-performance indexing and retrieval. This makes Lucene++ an ideal short-term bridge toward that long-term architecture.