From 3f92b87842d663b9d4c1f90909cd6299cfc78209 Mon Sep 17 00:00:00 2001 From: 317brian <53799971+317brian@users.noreply.github.com> Date: Mon, 15 Sep 2025 10:30:44 -0700 Subject: [PATCH 1/3] docs: update hadoop ingestion deprecation to d37 --- docs/ingestion/data-formats.md | 40 ++++++++++++++++++++-- docs/ingestion/hadoop.md | 7 ++-- docs/operations/other-hadoop.md | 7 ++-- docs/release-info/release-notes.md | 12 +++++++ docs/release-info/upgrade-notes.md | 8 +++++ docs/tutorials/tutorial-batch-hadoop.md | 7 ++-- docs/tutorials/tutorial-kerberos-hadoop.md | 6 ++-- 7 files changed, 77 insertions(+), 10 deletions(-) diff --git a/docs/ingestion/data-formats.md b/docs/ingestion/data-formats.md index a595b1c6ded7..10dbcb34b071 100644 --- a/docs/ingestion/data-formats.md +++ b/docs/ingestion/data-formats.md @@ -964,12 +964,15 @@ Each line can be further parsed using [`parseSpec`](#parsespec). :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) +Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) + +You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). ::: + :::info You need to include [`druid-avro-extensions`](../development/extensions-core/avro.md) as an extension to use the Avro Hadoop Parser. @@ -1031,6 +1034,17 @@ For example, using Avro Hadoop parser with custom reader's schema file: ### ORC Hadoop Parser +:::caution[Deprecated] + +Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. + +We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) + +You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). + +::: + + :::info You need to include the [`druid-orc-extensions`](../development/extensions-core/orc.md) as an extension to use the ORC Hadoop Parser. ::: @@ -1276,6 +1290,17 @@ setting `"mapreduce.job.user.classpath.first": "true"`, then this will not be an ### Parquet Hadoop Parser +:::caution[Deprecated] + +Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. + +We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) + +You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). + +::: + + :::info You need to include the [`druid-parquet-extensions`](../development/extensions-core/parquet.md) as an extension to use the Parquet Hadoop Parser. ::: @@ -1420,6 +1445,17 @@ However, the Parquet Avro Hadoop Parser was the original basis for supporting th ### Parquet Avro Hadoop Parser +:::caution[Deprecated] + +Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. + +We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) + +You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). + +::: + + :::info Consider using the [Parquet Hadoop Parser](#parquet-hadoop-parser) over this parser to ingest Parquet files. See [Parquet Hadoop Parser vs Parquet Avro Hadoop Parser](#parquet-hadoop-parser-vs-parquet-avro-hadoop-parser) diff --git a/docs/ingestion/hadoop.md b/docs/ingestion/hadoop.md index 3dd738f78910..af416c877375 100644 --- a/docs/ingestion/hadoop.md +++ b/docs/ingestion/hadoop.md @@ -25,13 +25,16 @@ sidebar_label: "Hadoop-based" :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) +Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) + +You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). ::: + Apache Hadoop-based batch ingestion in Apache Druid is supported via a Hadoop-ingestion task. These tasks can be posted to a running instance of a Druid [Overlord](../design/overlord.md). Please refer to our [Hadoop-based vs. native batch comparison table](index.md#batch) for comparisons between Hadoop-based, native batch (simple), and native batch (parallel) ingestion. diff --git a/docs/operations/other-hadoop.md b/docs/operations/other-hadoop.md index a82b331de4bb..7d13a406c1ea 100644 --- a/docs/operations/other-hadoop.md +++ b/docs/operations/other-hadoop.md @@ -25,12 +25,15 @@ title: "Working with different versions of Apache Hadoop" :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) +Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) + +You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). ::: + Apache Druid can interact with Hadoop in two ways: 1. [Use HDFS for deep storage](../development/extensions-core/hdfs.md) using the druid-hdfs-storage extension. diff --git a/docs/release-info/release-notes.md b/docs/release-info/release-notes.md index 0dcfdbd7385e..3cc8e274953a 100644 --- a/docs/release-info/release-notes.md +++ b/docs/release-info/release-notes.md @@ -59,10 +59,14 @@ This section contains important information about new and existing features. ### Java 11 support +**Update**: Support for Java 11 is scheduled to end with Druid 37.0.0. + Java 11 support has been deprecated since Druid 32.0, and official support will be removed as early as Druid 35.0.0 ### Hadoop-based ingestion +**Update**: Support for Hadoop-based ingestion is scheduled to end with Druid 37.0.0. + Hadoop-based ingestion has been deprecated since Druid 32.0 and will be removed as early as Druid 35.0.0. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md). @@ -377,8 +381,16 @@ Additionally, MSQ task engine metrics now include the following dimensions: ### Upgrade notes +#### Java 11 support + +**Update**: Support for Java 11 is scheduled to end with Druid 37.0.0. + +Java 11 support has been deprecated since Druid 32.0, and official support will be removed as early as Druid 35.0.0 + #### Hadoop-based ingestion +**Update**: Support for Hadoop-based ingestion is scheduled to end with Druid 37.0.0. + Hadoop-based ingestion has been deprecated since Druid 32.0 and will be removed as early as Druid 35.0.0. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md). diff --git a/docs/release-info/upgrade-notes.md b/docs/release-info/upgrade-notes.md index 6aad866df5b2..6fe7a8cbf0c7 100644 --- a/docs/release-info/upgrade-notes.md +++ b/docs/release-info/upgrade-notes.md @@ -42,8 +42,16 @@ If you're already using this feature, you don't need to take any action. ### Upgrade notes +#### Java 11 support + +**Update**: Support for Java 11 is scheduled to end with Druid 37.0.0. + +Java 11 support has been deprecated since Druid 32.0, and official support will be removed as early as Druid 35.0.0 + #### Hadoop-based ingestion +**Update**: Support for Hadoop-based ingestion is scheduled to end with Druid 37.0.0. + Hadoop-based ingestion has been deprecated since Druid 32.0 and will be removed as early as Druid 35.0.0. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md). diff --git a/docs/tutorials/tutorial-batch-hadoop.md b/docs/tutorials/tutorial-batch-hadoop.md index c75fc7d35e89..8288dd0b2530 100644 --- a/docs/tutorials/tutorial-batch-hadoop.md +++ b/docs/tutorials/tutorial-batch-hadoop.md @@ -25,12 +25,15 @@ sidebar_label: Load from Apache Hadoop :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) +Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) + +You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). ::: + This tutorial shows you how to load data files into Apache Druid using a remote Hadoop cluster. For this tutorial, we'll assume that you've already completed the previous diff --git a/docs/tutorials/tutorial-kerberos-hadoop.md b/docs/tutorials/tutorial-kerberos-hadoop.md index cace9b8794f4..5a1f9a602fb3 100644 --- a/docs/tutorials/tutorial-kerberos-hadoop.md +++ b/docs/tutorials/tutorial-kerberos-hadoop.md @@ -25,9 +25,11 @@ sidebar_label: Kerberized HDFS deep storage :::caution[Deprecated] -Hadoop-based ingestion is deprecated. We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) +Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239) +We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) + +You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). ::: From 5ca1f9841e9fa00ef62868f0dd365fde3a6695ef Mon Sep 17 00:00:00 2001 From: brian Date: Mon, 29 Sep 2025 09:17:19 -0700 Subject: [PATCH 2/3] change depr announcements to link oltu to upgrade notes --- docs/ingestion/data-formats.md | 24 ++++------------------ docs/tutorials/tutorial-batch-hadoop.md | 6 +----- docs/tutorials/tutorial-kerberos-hadoop.md | 6 +----- 3 files changed, 6 insertions(+), 30 deletions(-) diff --git a/docs/ingestion/data-formats.md b/docs/ingestion/data-formats.md index 10dbcb34b071..5c9bd3e75196 100644 --- a/docs/ingestion/data-formats.md +++ b/docs/ingestion/data-formats.md @@ -964,11 +964,7 @@ Each line can be further parsed using [`parseSpec`](#parsespec). :::caution[Deprecated] -Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. - -We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) ::: @@ -1036,11 +1032,7 @@ For example, using Avro Hadoop parser with custom reader's schema file: :::caution[Deprecated] -Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. - -We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) ::: @@ -1292,11 +1284,7 @@ setting `"mapreduce.job.user.classpath.first": "true"`, then this will not be an :::caution[Deprecated] -Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. - -We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) ::: @@ -1447,11 +1435,7 @@ However, the Parquet Avro Hadoop Parser was the original basis for supporting th :::caution[Deprecated] -Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. - -We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) ::: diff --git a/docs/tutorials/tutorial-batch-hadoop.md b/docs/tutorials/tutorial-batch-hadoop.md index 8288dd0b2530..5cd396efe296 100644 --- a/docs/tutorials/tutorial-batch-hadoop.md +++ b/docs/tutorials/tutorial-batch-hadoop.md @@ -25,11 +25,7 @@ sidebar_label: Load from Apache Hadoop :::caution[Deprecated] -Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. - -We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) ::: diff --git a/docs/tutorials/tutorial-kerberos-hadoop.md b/docs/tutorials/tutorial-kerberos-hadoop.md index 5a1f9a602fb3..535af37c018c 100644 --- a/docs/tutorials/tutorial-kerberos-hadoop.md +++ b/docs/tutorials/tutorial-kerberos-hadoop.md @@ -25,11 +25,7 @@ sidebar_label: Kerberized HDFS deep storage :::caution[Deprecated] -Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. - -We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) ::: From 0c4840ca4569fd7ead514c5a08e5337df05d1f5a Mon Sep 17 00:00:00 2001 From: brian Date: Tue, 30 Sep 2025 13:21:37 -0700 Subject: [PATCH 3/3] updates --- docs/ingestion/data-formats.md | 8 ++++---- docs/ingestion/hadoop.md | 7 +------ docs/operations/other-hadoop.md | 6 +----- 3 files changed, 6 insertions(+), 15 deletions(-) diff --git a/docs/ingestion/data-formats.md b/docs/ingestion/data-formats.md index 5c9bd3e75196..db3cd1f0f0da 100644 --- a/docs/ingestion/data-formats.md +++ b/docs/ingestion/data-formats.md @@ -964,7 +964,7 @@ Each line can be further parsed using [`parseSpec`](#parsespec). :::caution[Deprecated] -Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). ::: @@ -1032,7 +1032,7 @@ For example, using Avro Hadoop parser with custom reader's schema file: :::caution[Deprecated] -Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). ::: @@ -1284,7 +1284,7 @@ setting `"mapreduce.job.user.classpath.first": "true"`, then this will not be an :::caution[Deprecated] -Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). ::: @@ -1435,7 +1435,7 @@ However, the Parquet Avro Hadoop Parser was the original basis for supporting th :::caution[Deprecated] -Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). ::: diff --git a/docs/ingestion/hadoop.md b/docs/ingestion/hadoop.md index af416c877375..1a8574198c87 100644 --- a/docs/ingestion/hadoop.md +++ b/docs/ingestion/hadoop.md @@ -25,16 +25,11 @@ sidebar_label: "Hadoop-based" :::caution[Deprecated] -Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. - -We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion). ::: - Apache Hadoop-based batch ingestion in Apache Druid is supported via a Hadoop-ingestion task. These tasks can be posted to a running instance of a Druid [Overlord](../design/overlord.md). Please refer to our [Hadoop-based vs. native batch comparison table](index.md#batch) for comparisons between Hadoop-based, native batch (simple), and native batch (parallel) ingestion. diff --git a/docs/operations/other-hadoop.md b/docs/operations/other-hadoop.md index 7d13a406c1ea..51c1bd6f20ad 100644 --- a/docs/operations/other-hadoop.md +++ b/docs/operations/other-hadoop.md @@ -25,11 +25,7 @@ title: "Working with different versions of Apache Hadoop" :::caution[Deprecated] -Hadoop-based ingestion is deprecated and scheduled to be removed with Druid 37.0.0. - -We recommend one of Druid's other supported ingestion methods, such as [SQL-based ingestion](../multi-stage-query/index.md) or [MiddleManager-less ingestion using Kubernetes](../development/extensions-core/k8s-jobs.md) - -You must now explicitly opt-in to using the deprecated `index_hadoop` task type. To opt-in, set `druid.indexer.task.allowHadoopTaskExecution` to `true` in your `common.runtime.properties` file. For more information, see [#18239](https://github.com/apache/druid/pull/18239). +Hadoop-based ingestion is deprecated. For more information, see the [upgrade notes](../release-info/upgrade-notes.md#hadoop-based-ingestion) :::