Skip to content

Generate: add tests for caches with pad_to_multiple_of #29462

Merged
gante merged 1 commit intohuggingface:mainfrom
gante:new_generation_tests
Mar 6, 2024
Merged

Generate: add tests for caches with pad_to_multiple_of #29462
gante merged 1 commit intohuggingface:mainfrom
gante:new_generation_tests

Conversation

@gante
Copy link
Copy Markdown
Contributor

@gante gante commented Mar 5, 2024

What does this PR do?

Adds tests for padding with pad_to_multiple_of (i.e. extra left-padding), on the different cache types.

These tests were pulled from #29221, and should help us retain the correctness as we expand the capabilities of generate/Cache in other PRs (#29180, #29374).

@gante gante requested a review from ArthurZucker March 5, 2024 15:20
@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Copy link
Copy Markdown
Collaborator

@ArthurZucker ArthurZucker left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding more tests!

@gante gante merged commit 41f7b7a into huggingface:main Mar 6, 2024
@gante gante deleted the new_generation_tests branch March 6, 2024 10:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants