SOLR-17960 Remove deprecated TikaLanguageIdentifierUpdateProcessor #3787
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
github-actions
bot
added
documentation
janhoy
commented
Oct 17, 2025
| {solr-javadocs}/modules/langid/org/apache/solr/update/processor/LangDetectLanguageIdentifierUpdateProcessorFactory.html[LangDetectLanguageIdentifierUpdateProcessorFactory]::: Identifies the language of a set of input fields using http://code.google.com/p/language-detection. | ||
|
|
||
| {solr-javadocs}/modules/langid/org/apache/solr/update/processor/TikaLanguageIdentifierUpdateProcessorFactory.html[TikaLanguageIdentifierUpdateProcessorFactory]::: Identifies the language of a set of input fields using Tika's LanguageIdentifier. | ||
| {solr-javadocs}/modules/langid/org/apache/solr/update/processor/OpenNLPLangDetectUpdateProcessorFactory.html[OpenNLPLangDetectUpdateProcessorFactory]::: Identifies the language of a set of input fields using OpenNLP's language detection model. |
Contributor
Author
There was a problem hiding this comment.
Turned out the ref guide did not list the OpenNLP identifier...
janhoy
changed the title
Contributor
There was a problem hiding this comment.
Pull Request Overview
Removes the deprecated TikaLanguageIdentifierUpdateProcessor which was deprecated in version 9.10. Users are directed to use LangDetectLanguageIdentifierUpdateProcessor or OpenNLPLangDetectUpdateProcessor as alternatives for language detection functionality.
- Removes all TikaLanguageIdentifierUpdateProcessor related classes and test files
- Updates documentation to remove references to Tika language detection
- Updates configuration examples to use LangDetectLanguageIdentifierUpdateProcessor instead
Reviewed Changes
Copilot reviewed 13 out of 13 changed files in this pull request and generated 2 comments.
Show a summary per file
| File | Description |
|---|---|
| major-changes-in-solr-10.adoc | Adds upgrade note about TikaLanguageIdentifierUpdateProcessor removal |
| language-detection.adoc | Removes Tika implementation from documentation and examples |
| update-request-processors.adoc | Replaces Tika processor reference with OpenNLP processor |
| solrconfig.xml | Updates sample configuration to use LangDetect instead of Tika |
| TikaLanguageIdentifierUpdateProcessorFactoryTest.java | Removes test file for deprecated processor |
| LanguageIdentifierUpdateProcessorFactoryTestCase.java | Removes Tika processor chain test setup |
| solrconfig-languageidentifier.xml | Removes Tika processor configuration from test config |
| TikaLanguageIdentifierUpdateProcessorFactory.java | Removes deprecated factory class |
| TikaLanguageIdentifierUpdateProcessor.java | Removes deprecated processor class |
| gradle.lockfile | Removes Tika dependency from lockfile |
| build.gradle | Removes Tika core dependency |
| README.md | Removes Tika dependency documentation |
| CHANGES.txt | Adds changelog entry for removal |
Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.
solr/solr-ref-guide/modules/upgrade-notes/pages/major-changes-in-solr-10.adoc
Outdated
Show resolved
Hide resolved
…in-solr-10.adoc Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
cpoerschke
approved these changes
Oct 17, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
https://issues.apache.org/jira/browse/SOLR-17960
This will be merged to
main,branch_10xandbranch_10_0.