Skip to content

llama-quant : remove these checks as some arches do not have these tensors#21544

Closed
ownia wants to merge 1 commit intoggml-org:masterfrom
ownia:fix/quantize_tensor_check
Closed

llama-quant : remove these checks as some arches do not have these tensors#21544
ownia wants to merge 1 commit intoggml-org:masterfrom
ownia:fix/quantize_tensor_check

Conversation

@ownia
Copy link
Copy Markdown
Contributor

@ownia ownia commented Apr 7, 2026

Overview

Extend #21219.

Additional information

Requirements

…nsors

Signed-off-by: Weizhao Ouyang <o451686892@gmail.com>
@ggml-gh-bot
Copy link
Copy Markdown

ggml-gh-bot Bot commented Apr 7, 2026

Hi @ownia, thanks for your contribution!

Per our contribution guidelines, the automated PR checker found the following issue(s) that need your attention:

  • Multiple open PRs from a new contributor: We limit new contributors (those without a previously merged PR) to 1 open PR at a time. You currently have 2 open PRs.

Please note that maintainers reserve the right to make final decisions on PRs. If you believe there is a mistake, please comment below.

Comment thread src/llama-quant.cpp
//

static bool tensor_allows_quantization(const llama_model_quantize_params * params, llm_arch arch, const ggml_tensor * tensor) {
static bool tensor_allows_quantization(const llama_model_quantize_params * params, [[maybe_unused]] llm_arch arch, const ggml_tensor * tensor) {
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wouldn't it make more sense to just remove the argument?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes it makes sense. However, I've just noticed that you submitted the PR #21531, perhaps we could drop my PR if yours can be merged?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would also be fine with closing this PR if mine is merged.

@ownia ownia closed this Apr 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants