mtmd: add Gemma 4 audio conformer encoder support#21421

Merged

ngxson merged 19 commits intoggml-org:masterfrom

stephencox-ict:gemma4-audio-pr

Apr 12, 2026

Commits on Apr 9, 2026

mtmd: add Gemma 4 audio conformer encoder support

stephencox
and
claude
committed
gemma4: fix audio encoder and LM precision issues

stephencox
and
claude
committed
mtmd: use double-precision math for audio preprocessing constants

stephencox
and
claude
committed
Revert "mtmd: use double-precision math for audio preprocessing constants"
stephencox
committed
gguf-py: restore gemma3n mappings in tensor_mapping.py and fix swapped conv norms
stephencox
committed
address ngxson review: fix tensor mapping in C++, remove dup comment, derive softcap

stephencox
and
claude
committed
address review: remove cross-load, keep per-layer scale, derive softcap

stephencox
and
claude
committed
address review: auto-detect swapped conv norms, remove dup comment

stephencox
and
claude
committed
address review: simplify conv norm swap, move scaling to PR #21625

stephencox
and
claude
committed
mtmd: fix CUDA/Vulkan conformer encoder by making sigmoid input contiguous

stephencox
and
claude
committed
revert tensor_mapping.py, gemma4-iswa.cpp and llama-model.cpp changes

stephencox
and
claude
committed
gemma4: restore BF16-rounded scales and per-layer multimodal scaling

stephencox
and
claude
committed

Commits on Apr 10, 2026

mtmd: fix conv norm swap comment in gemma4 audio conformer

stephencox
and
claude
committed

Commits on Apr 11, 2026