Skip to content

[docs] cb memory management#45587

Merged
stevhliu merged 3 commits intohuggingface:mainfrom
stevhliu:cb-memory
Apr 28, 2026
Merged

[docs] cb memory management#45587
stevhliu merged 3 commits intohuggingface:mainfrom
stevhliu:cb-memory

Conversation

@stevhliu
Copy link
Copy Markdown
Member

follows up on the comment here to document the memory side of the system

@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@stevhliu stevhliu requested a review from remi-or April 22, 2026 22:40
Comment thread docs/source/en/continuous_batching_architecture.md Outdated
Comment thread docs/source/en/continuous_batching_architecture.md Outdated
Comment thread docs/source/en/continuous_batching_architecture.md Outdated
Copy link
Copy Markdown
Collaborator

@remi-or remi-or left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Just a few nits to address.

@stevhliu stevhliu added this pull request to the merge queue Apr 28, 2026
Merged via the queue into huggingface:main with commit a29e967 Apr 28, 2026
16 checks passed
@stevhliu stevhliu deleted the cb-memory branch April 28, 2026 17:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants