Skip to content

quant : manual overrides of tensor types take precedence#18952

Merged
ggerganov merged 1 commit intomasterfrom
gg/quant-manual-overrides
Jan 22, 2026
Merged

quant : manual overrides of tensor types take precedence#18952
ggerganov merged 1 commit intomasterfrom
gg/quant-manual-overrides

Conversation

@ggerganov
Copy link
Copy Markdown
Member

cont #12511, #13033

When user provides a tensor type with the --tensor-type CLI argument, it takes precedence over the automatic logic. The shape-compatibility check is moved after the new tensor type is determined, so now it covers both the manual and automatic paths.

@ggerganov
Copy link
Copy Markdown
Member Author

cc @EAddario

@ggerganov ggerganov merged commit 0e4ebeb into master Jan 22, 2026
78 checks passed
ronaldmannak pushed a commit to PicoMLX/llama.cpp that referenced this pull request Jan 24, 2026
shaofeiqi pushed a commit to qualcomm/llama.cpp that referenced this pull request Feb 6, 2026
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant