Skip to content

update docs for kafka lookup extension to specify correct extension loading requirements #16929

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
georgew5656 wants to merge 6 commits into from
+11 −1
Closed

update docs for kafka lookup extension to specify correct extension loading requirements #16929

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
09c0898
update docs for kafka lookup extension to specify correct extension o…
georgew5656 Aug 20, 2024
cfa23fa
fix first line
georgew5656 Aug 20, 2024
2ccaf61
test with extension dependencies
georgew5656 Aug 22, 2024
d9f969b
Revert "test with extension dependencies"
georgew5656 Aug 22, 2024
ec3ee1b
Update docs/querying/kafka-extraction-namespace.md
georgew5656 Aug 22, 2024
8fdb7d7
Update docs/querying/lookups-cached-global.md
georgew5656 Aug 22, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 6 additions & 1 deletion docs/querying/kafka-extraction-namespace.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,12 @@ title: "Apache Kafka Lookups"
~ under the License.
-->

To use this Apache Druid extension, [include](../configuration/extensions.md#loading-extensions) `druid-lookups-cached-global` and `druid-kafka-extraction-namespace` in the extensions load list.
To use this Apache Druid extension, [include](../configuration/extensions.md#loading-extensions) `druid-kafka-extraction-namespace` in the extensions load list.

The `druid-kafka-extraction-namespace` extension includes all the functionality of `druid-lookups-cached-global`.
Do not load both extensions, but choose the extension that best suits your needs:
- `druid-kafka-extraction-namespace` if you need Kafka lookup functionality
- `druid-lookups-cached-global` if you only want global cached lookup functionality

If you need updates to populate as promptly as possible, it is possible to plug into a Kafka topic whose key is the old value and message is the desired new value (both in UTF-8) as a LookupExtractorFactory.

Expand Down
5 changes: 5 additions & 0 deletions docs/querying/lookups-cached-global.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,11 @@ title: "Globally Cached Lookups"

To use this Apache Druid extension, [include](../configuration/extensions.md#loading-extensions) `druid-lookups-cached-global` in the extensions load list.

The `druid-kafka-extraction-namespace` extension includes all the functionality of `druid-lookups-cached-global`.
Do not load both extensions, but choose the extension that best suits your needs:
- `druid-lookups-cached-global` if you only want global cached lookup functionality
- `druid-kafka-extraction-namespace` if you need Kafka lookup functionality

## Configuration
:::info
Static configuration is no longer supported. Lookups can be configured through
Expand Down