Skip to content

Fix upgrade compatibility issue from older versions to 3.4#13130

Merged
mumrah merged 3 commits intoapache:trunkfrom
akhileshchg:KAFKA-14637
Jan 19, 2023
Merged

Fix upgrade compatibility issue from older versions to 3.4#13130
mumrah merged 3 commits intoapache:trunkfrom
akhileshchg:KAFKA-14637

Conversation

@akhileshchg
Copy link
Copy Markdown
Contributor

3.4 introduced a change that requires cluster.id to be present in meta.properties if the file is available. This information is not persisted by the brokers in old versions (< 0.10). So on upgrade, the requirement check fails and halts the broker start-up. Fixed the requirement to ensure cluster.id is not required in zk mode on upgrade.

3.4 introduced a change that requires cluster.id to be present in
meta.properties if the file is available. This information is not persisted by
the brokers in old versions (< 0.10). So on upgrade, the requirement check
fails and halts the broker start up. Fix the requirement to ensure cluster.id
is not required in zk mode on upgrade.
Comment thread core/src/main/scala/kafka/server/BrokerMetadataCheckpoint.scala Outdated
@akhileshchg akhileshchg marked this pull request as ready for review January 19, 2023 03:44
Copy link
Copy Markdown
Contributor

@cmccabe cmccabe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Copy Markdown
Member

@mumrah mumrah left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @akhileshchg, LGTM. If you have it, can you paste the system test output to this PR?

@mumrah mumrah merged commit 7a22c0c into apache:trunk Jan 19, 2023
mumrah pushed a commit that referenced this pull request Jan 19, 2023
#13130)

3.4 introduced a change that requires cluster.id to be present in meta.properties if the file is available. This information is not persisted by the brokers in old versions (< 0.10). So on upgrade, the requirement check fails and halts the broker start up. This patch fixes the requirement to ensure that cluster.id is not required in zk mode on upgrade.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Colin P. McCabe <cmccabe@apache.org>, David Arthur <mumrah@gmail.com>
guozhangwang pushed a commit to guozhangwang/kafka that referenced this pull request Jan 25, 2023
apache#13130)

3.4 introduced a change that requires cluster.id to be present in meta.properties if the file is available. This information is not persisted by the brokers in old versions (< 0.10). So on upgrade, the requirement check fails and halts the broker start up. This patch fixes the requirement to ensure that cluster.id is not required in zk mode on upgrade.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Colin P. McCabe <cmccabe@apache.org>, David Arthur <mumrah@gmail.com>
TaiJuWu pushed a commit to TaiJuWu/kafka that referenced this pull request Jan 4, 2025
apache#13130)

3.4 introduced a change that requires cluster.id to be present in meta.properties if the file is available. This information is not persisted by the brokers in old versions (< 0.10). So on upgrade, the requirement check fails and halts the broker start up. This patch fixes the requirement to ensure that cluster.id is not required in zk mode on upgrade.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Colin P. McCabe <cmccabe@apache.org>, David Arthur <mumrah@gmail.com>
chia7712 pushed a commit that referenced this pull request Jan 15, 2025
Due to an issue with handling folders in Kafka version 3.3.2 (see #13130), this end-to-end test requires using a single folder for upgrade/downgrade scenarios involving 3.3.2.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Chia-Ping Tsai <chia7712@gmail.com>
chia7712 pushed a commit to chia7712/kafka that referenced this pull request Jan 15, 2025
Due to an issue with handling folders in Kafka version 3.3.2 (see apache#13130), this end-to-end test requires using a single folder for upgrade/downgrade scenarios involving 3.3.2.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Chia-Ping Tsai <chia7712@gmail.com>
chia7712 pushed a commit that referenced this pull request Jan 15, 2025
Due to an issue with handling folders in Kafka version 3.3.2 (see #13130), this end-to-end test requires using a single folder for upgrade/downgrade scenarios involving 3.3.2.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Chia-Ping Tsai <chia7712@gmail.com>
pranavt84 pushed a commit to pranavt84/kafka that referenced this pull request Jan 27, 2025
Due to an issue with handling folders in Kafka version 3.3.2 (see apache#13130), this end-to-end test requires using a single folder for upgrade/downgrade scenarios involving 3.3.2.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Chia-Ping Tsai <chia7712@gmail.com>
manoj-mathivanan pushed a commit to manoj-mathivanan/kafka that referenced this pull request Feb 19, 2025
Due to an issue with handling folders in Kafka version 3.3.2 (see apache#13130), this end-to-end test requires using a single folder for upgrade/downgrade scenarios involving 3.3.2.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Chia-Ping Tsai <chia7712@gmail.com>
jeqo pushed a commit to aiven/inkless that referenced this pull request Feb 27, 2025
Due to an issue with handling folders in Kafka version 3.3.2 (see apache/kafka#13130), this end-to-end test requires using a single folder for upgrade/downgrade scenarios involving 3.3.2.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Chia-Ping Tsai <chia7712@gmail.com>
jeqo pushed a commit to aiven/inkless that referenced this pull request Feb 28, 2025
Due to an issue with handling folders in Kafka version 3.3.2 (see apache/kafka#13130), this end-to-end test requires using a single folder for upgrade/downgrade scenarios involving 3.3.2.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Chia-Ping Tsai <chia7712@gmail.com>
apoorvmittal10 pushed a commit to apoorvmittal10/kafka that referenced this pull request Oct 17, 2025
Due to an issue with handling folders in Kafka version 3.3.2 (see apache#13130), this end-to-end test requires using a single folder for upgrade/downgrade scenarios involving 3.3.2.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Chia-Ping Tsai <chia7712@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants