Skip to content

Fix dtype quantizer#42882

Merged
SunMarc merged 15 commits intomainfrom
fix-dtype-quantizer
Dec 17, 2025
Merged

Fix dtype quantizer#42882
SunMarc merged 15 commits intomainfrom
fix-dtype-quantizer

Conversation

@SunMarc
Copy link
Copy Markdown
Member

@SunMarc SunMarc commented Dec 15, 2025

What does this PR do?

This PR fixes code related to quantizer since dtype=auto default created some minor issues in our CI. We clean a bit of code related to dtype and fixes the tests as some of ours tests depends on the dtype of the model, which before where always on torch.float32 if not specified.

@SunMarc SunMarc requested a review from MekkCyber December 15, 2025 17:49
@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Comment thread src/transformers/modeling_utils.py
@SunMarc SunMarc requested a review from Cyrilvallez December 15, 2025 18:31
Copy link
Copy Markdown
Contributor

@MekkCyber MekkCyber left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Amazing ! Thanks for cleaning the dtype mess 🔥

Comment thread src/transformers/quantizers/base.py Outdated
Comment thread src/transformers/quantizers/quantizer_aqlm.py Outdated
Comment thread src/transformers/quantizers/quantizer_auto_round.py Outdated
Comment thread src/transformers/quantizers/quantizer_torchao.py
Comment thread src/transformers/modeling_utils.py
Comment thread src/transformers/modeling_utils.py Outdated
SunMarc and others added 5 commits December 16, 2025 12:35
@github-actions
Copy link
Copy Markdown
Contributor

[For maintainers] Suggested jobs to run (before merge)

run-slow: diffllama, falcon, falcon_mamba, gpt_neo, gptj, kyutai_speech_to_text, mimi, moshi, nemotron, fbgemm_fp8, finegrained_fp8, gptq, higgs

@SunMarc SunMarc requested a review from MekkCyber December 16, 2025 12:44
Copy link
Copy Markdown
Contributor

@MekkCyber MekkCyber left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Incredible, thanks a lot!

@SunMarc SunMarc merged commit b05d2c4 into main Dec 17, 2025
26 checks passed
@SunMarc SunMarc deleted the fix-dtype-quantizer branch December 17, 2025 15:51
SangbumChoi pushed a commit to SangbumChoi/transformers that referenced this pull request Jan 23, 2026
* fix dtype quantizer

* fix

* rm print

* fix

* style

* fix

* revert

* bitnet

* fix

* gogo

* Update src/transformers/modeling_utils.py

Co-authored-by: Mohamed Mekkouri <93391238+MekkCyber@users.noreply.github.com>

* warn instead

* fix

* fix

---------

Co-authored-by: Mohamed Mekkouri <93391238+MekkCyber@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants