Skip to content

Add BrokerMetadataListener and related classes#10090

Closed
mumrah wants to merge 2 commits intoapache:trunkfrom
mumrah:upstream-broker-quota-processor
Closed

Add BrokerMetadataListener and related classes#10090
mumrah wants to merge 2 commits intoapache:trunkfrom
mumrah:upstream-broker-quota-processor

Conversation

@mumrah
Copy link
Copy Markdown
Member

@mumrah mumrah commented Feb 9, 2021

This adds BrokerMetadataListener which is responsible for processing metadata records received by the broker when running in Raft mode.

Note that several files in this PR are also included in #10106 which will get merged to trunk first.

@mumrah mumrah added the kraft label Feb 9, 2021
@mumrah mumrah marked this pull request as draft February 9, 2021 20:07
Comment thread core/src/main/scala/kafka/server/metadata/BrokerMetadataListener.scala Outdated
Comment thread core/src/main/scala/kafka/server/metadata/BrokerMetadataListener.scala Outdated
Comment on lines 100 to 104
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perhaps not to resolve now, but I think error conditions like this might need more thought. Should the broker die? If so, how would the broker ever come back up if it can't get past a particular batch? But what is the impact of not processing the remaining messages in a batch, and is that always acceptable or just sometimes acceptable? Do we need metrics to track these error events? It seems an error log message might not be sufficient?

@mumrah mumrah force-pushed the upstream-broker-quota-processor branch from 9811dcb to 16302f8 Compare February 10, 2021 23:18
@mumrah mumrah marked this pull request as ready for review February 10, 2021 23:20
@mumrah mumrah changed the title Upstream BrokerMetadataListener and related classes Add BrokerMetadataListener and related classes for Raft server Feb 10, 2021
@mumrah mumrah changed the title Add BrokerMetadataListener and related classes for Raft server Add BrokerMetadataListener and related classes Feb 10, 2021
@mumrah mumrah closed this Feb 11, 2021
@mumrah mumrah deleted the upstream-broker-quota-processor branch February 11, 2021 20:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants