Skip to content

Refactor BatchMutationCall to optimize task batching and execution flow#230

Merged
popduke merged 1 commit intoapache:mainfrom
popduke:feat-improve-mutationcall-batching
Mar 5, 2026
Merged

Refactor BatchMutationCall to optimize task batching and execution flow#230
popduke merged 1 commit intoapache:mainfrom
popduke:feat-improve-mutationcall-batching

Conversation

@popduke
Copy link
Contributor

@popduke popduke commented Mar 3, 2026

For #229

Copy link
Contributor

@Gujiawei-Edinburgh Gujiawei-Edinburgh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These changes reduce batch fragmentation. Will this impact first-request latency? I would like to know the expected performance / resource gain during peak traffic periods?

@popduke
Copy link
Contributor Author

popduke commented Mar 5, 2026

These changes reduce batch fragmentation. Will this impact first-request latency? I would like to know the expected performance / resource gain during peak traffic periods?

The impaction to first request latency will be unnoticeable, however it will improve tail latency noticeably.

@popduke popduke merged commit a7f85e5 into apache:main Mar 5, 2026
6 checks passed
@popduke popduke deleted the feat-improve-mutationcall-batching branch March 5, 2026 01:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants