Skip to content

[Moshi] disable automatic compilation#35986

Closed
gante wants to merge 2 commits intohuggingface:mainfrom
gante:moshi_not_compileable
Closed

[Moshi] disable automatic compilation#35986
gante wants to merge 2 commits intohuggingface:mainfrom
gante:moshi_not_compileable

Conversation

@gante
Copy link
Copy Markdown
Contributor

@gante gante commented Jan 31, 2025

What does this PR do?

Fixes moshi + generation, which is making our ci quite red.

#34544 expanded automatic compilation when any compileable cache is used

Moshi uses sliding window cache by default, which is a compileable cache. However, Moshi doesn't support compilation. This PR ensures all caches are tagged as non-compileable for Moshi at generation time, to prevent automatic compilation from happening.

@gante gante requested review from eustlb and ydshieh January 31, 2025 12:01
@gante
Copy link
Copy Markdown
Contributor Author

gante commented Jan 31, 2025

Sorry, I'm closing this -- I've found a much better solution 😅

@gante gante closed this Jan 31, 2025
@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants