Skip to content

feat: invalidate the kv-cache after inflight weight udpate#1455

Merged
parthchadha merged 2 commits intopchadha/inflight-updatefrom
youngeunk/inflight-update
Nov 2, 2025
Merged

feat: invalidate the kv-cache after inflight weight udpate#1455
parthchadha merged 2 commits intopchadha/inflight-updatefrom
youngeunk/inflight-update

Conversation

@youngeunkwon0405
Copy link
Copy Markdown
Contributor

@youngeunkwon0405 youngeunkwon0405 commented Oct 31, 2025

What does this PR do ?

The AReal (https://arxiv.org/pdf/2505.24298) implementation. Recomputing KV cache after the inflight weight update.

Issues

List issues that this PR closes (syntax):

Usage

  • You can potentially add a usage example below
# Add a code snippet demonstrating how to use this

Before your PR is "Ready for review"

Pre checks:

  • Make sure you read and followed Contributor guidelines
  • Did you write any new necessary tests?
  • Did you run the unit tests and functional tests locally? Visit our Testing Guide for how to run tests
  • Did you add or update any necessary documentation? Visit our Document Development Guide for how to write, build and test the docs.

Additional Information

  • ...

@youngeunkwon0405 youngeunkwon0405 self-assigned this Oct 31, 2025
@youngeunkwon0405 youngeunkwon0405 requested review from a team as code owners October 31, 2025 22:37
@github-actions github-actions Bot added the Documentation Improvements or additions to documentation label Oct 31, 2025
@youngeunkwon0405 youngeunkwon0405 added the CI:L1 Run doctests, unit tests, and functional tests label Oct 31, 2025
@youngeunkwon0405 youngeunkwon0405 force-pushed the youngeunk/inflight-update branch from b84bf76 to 92af62c Compare October 31, 2025 22:48
Signed-off-by: Youngeun Kwon <youngeunk@nvidia.com>
Signed-off-by: Youngeun Kwon <youngeunk@nvidia.com>
@parthchadha parthchadha merged commit 50f5c2f into pchadha/inflight-update Nov 2, 2025
13 checks passed
@parthchadha parthchadha deleted the youngeunk/inflight-update branch November 2, 2025 18:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI:L1 Run doctests, unit tests, and functional tests Documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants