Skip to content

docs: add deprecation for hadoop and java11#18286

Merged
317brian merged 10 commits intoapache:masterfrom
317brian:hadoop-depr
Aug 8, 2025
Merged

docs: add deprecation for hadoop and java11#18286
317brian merged 10 commits intoapache:masterfrom
317brian:hadoop-depr

Conversation

@317brian
Copy link
Copy Markdown
Contributor

@317brian 317brian commented Jul 18, 2025

Adds deprecation notices to all the mentions of hadoop ingestion or removes references of it where appropriate. Same with Java 11

For example: https://druid-p94x03kw2-317brians-projects.vercel.app/docs/latest/ingestion/hadoop

image

This PR has:

  • been self-reviewed.
  • added documentation for new or modified features or behaviors.
  • a release note entry in the PR description.
  • added Javadocs for most classes and all non-trivial methods. Linked related entities via Javadoc links.
  • added or updated version, license, or notice information in licenses.yaml
  • added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold for code coverage is met.
  • added integration tests.
  • been tested in a test Druid cluster.

Comment thread docs/operations/java.md Outdated
Comment thread docs/ingestion/hadoop.md Outdated
Comment thread docs/ingestion/data-formats.md Outdated
Comment thread docs/tutorials/tutorial-kerberos-hadoop.md Outdated
Comment thread docs/tutorials/tutorial-batch-hadoop.md Outdated
Comment thread docs/operations/other-hadoop.md Outdated
@317brian 317brian changed the title hadoop and java11 docs: add deprecation for hadoop and java11 Jul 21, 2025
Comment thread docs/tutorials/tutorial-kerberos-hadoop.md Outdated
Comment thread docs/tutorials/tutorial-batch-hadoop.md Outdated
Comment thread docs/operations/other-hadoop.md Outdated
Comment thread docs/ingestion/hadoop.md Outdated
Comment thread docs/ingestion/data-formats.md Outdated
@317brian 317brian requested a review from cryptoe July 23, 2025 21:18
Comment thread docs/ingestion/data-formats.md Outdated
Comment thread docs/ingestion/data-formats.md
Comment thread docs/ingestion/data-formats.md Outdated
Comment thread docs/ingestion/hadoop.md Outdated

:::caution[Deprecated]

Hadoop-based ingestion deprecated. Use [SQL-based ingestion](../multi-stage-query/index.md) instead of MapReduce or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) instead of YARN.
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same as above

Comment thread docs/operations/other-hadoop.md Outdated

:::caution[Deprecated]

Hadoop-based ingestion deprecated. Use [SQL-based ingestion](../multi-stage-query/index.md) instead of MapReduce or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) instead of YARN.
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same as above

Comment thread docs/tutorials/cluster.md Outdated
Comment thread docs/tutorials/index.md Outdated
Comment thread docs/tutorials/tutorial-kerberos-hadoop.md Outdated
Comment thread docs/tutorials/tutorial-batch-hadoop.md Outdated
Comment thread docs/ingestion/hadoop.md Outdated
Comment thread docs/operations/other-hadoop.md Outdated
Comment thread docs/tutorials/tutorial-kerberos-hadoop.md Outdated
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
@capistrant capistrant added this to the 34.0.0 milestone Aug 7, 2025
Copy link
Copy Markdown
Contributor

@capistrant capistrant left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the wording for the hadoop deprecations could be adjusted. Not a total blocker, but I think the current proposed wording is potentially confusing

Comment thread docs/ingestion/hadoop.md Outdated
Co-authored-by: Lucas Capistrant <capistrant@users.noreply.github.com>
Comment thread docs/ingestion/data-formats.md Outdated
Comment thread docs/operations/other-hadoop.md Outdated
Comment thread docs/tutorials/tutorial-batch-hadoop.md Outdated
Comment thread docs/tutorials/tutorial-kerberos-hadoop.md Outdated
Comment thread docs/operations/other-hadoop.md Outdated
Comment thread docs/ingestion/hadoop.md Outdated
Comment thread docs/ingestion/data-formats.md Outdated
Comment thread docs/tutorials/tutorial-batch-hadoop.md Outdated
Comment thread docs/tutorials/tutorial-kerberos-hadoop.md Outdated
@317brian 317brian requested a review from capistrant August 8, 2025 17:27
@317brian 317brian merged commit 8d9632f into apache:master Aug 8, 2025
7 checks passed
capistrant added a commit to capistrant/incubator-druid that referenced this pull request Aug 8, 2025
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Co-authored-by: Lucas Capistrant <capistrant@users.noreply.github.com>
@317brian 317brian deleted the hadoop-depr branch August 11, 2025 18:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants