Skip to content

KAFKA-14505; [4/N] Wire transaction verification#15142

Merged
dajac merged 8 commits intoapache:trunkfrom
dajac:KAFKA-14505-4
Jan 11, 2024
Merged

KAFKA-14505; [4/N] Wire transaction verification#15142
dajac merged 8 commits intoapache:trunkfrom
dajac:KAFKA-14505-4

Conversation

@dajac
Copy link
Copy Markdown
Member

@dajac dajac commented Jan 8, 2024

This patch wires the transaction verification in the new group coordinator. It basically calls the verification path before scheduling the write operation. If the verification fails, the error is returned to the caller.

Note that the patch uses appendForGroup. I suppose that we will move away from using it when #15087 is merged.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@dajac dajac added the KIP-848 The Next Generation of the Consumer Rebalance Protocol label Jan 8, 2024
@dajac dajac requested a review from jolshan January 8, 2024 12:47
@jolshan
Copy link
Copy Markdown
Member

jolshan commented Jan 8, 2024

Yup -- sorry was hoping to do all the clean ups before you got to this -- but shouldn't be too hard to update.

Comment thread core/src/main/scala/kafka/server/ReplicaManager.scala
@dajac
Copy link
Copy Markdown
Member Author

dajac commented Jan 10, 2024

@jolshan Thanks for your comments. I have addressed all of them expect the one about the thread re-scheduling. I propose to tackle this separately in order to keep this patch simple. I have also enabled the transaction system tests and ran them successfully. The results are here.

Comment thread core/src/main/scala/kafka/coordinator/group/CoordinatorPartitionWriter.scala Outdated
Copy link
Copy Markdown
Member

@jolshan jolshan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure if you meant to push the change to link the interface docs, but once that is complete LGTM.

@dajac dajac merged commit a8203f9 into apache:trunk Jan 11, 2024
@dajac dajac deleted the KAFKA-14505-4 branch January 11, 2024 12:59
showuon pushed a commit to showuon/kafka that referenced this pull request Jan 22, 2024
This patch wires the transaction verification in the new group coordinator. It basically calls the verification path before scheduling the write operation. If the verification fails, the error is returned to the caller.

Note that the patch uses `appendForGroup`. I suppose that we will move away from using it when apache#15087 is merged.

Reviewers: Justine Olshan <jolshan@confluent.io>
yyu1993 pushed a commit to yyu1993/kafka that referenced this pull request Feb 15, 2024
This patch wires the transaction verification in the new group coordinator. It basically calls the verification path before scheduling the write operation. If the verification fails, the error is returned to the caller.

Note that the patch uses `appendForGroup`. I suppose that we will move away from using it when apache#15087 is merged.

Reviewers: Justine Olshan <jolshan@confluent.io>
clolov pushed a commit to clolov/kafka that referenced this pull request Apr 5, 2024
This patch wires the transaction verification in the new group coordinator. It basically calls the verification path before scheduling the write operation. If the verification fails, the error is returned to the caller.

Note that the patch uses `appendForGroup`. I suppose that we will move away from using it when apache#15087 is merged.

Reviewers: Justine Olshan <jolshan@confluent.io>
Phuc-Hong-Tran pushed a commit to Phuc-Hong-Tran/kafka that referenced this pull request Jun 6, 2024
This patch wires the transaction verification in the new group coordinator. It basically calls the verification path before scheduling the write operation. If the verification fails, the error is returned to the caller.

Note that the patch uses `appendForGroup`. I suppose that we will move away from using it when apache#15087 is merged.

Reviewers: Justine Olshan <jolshan@confluent.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

KIP-848 The Next Generation of the Consumer Rebalance Protocol

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants