Skip to content

Conversation

@mudler
Copy link
Owner

@mudler mudler commented Oct 31, 2025

Description

This pull request adds support for the Qwen3-VL-30B-A3B-Instruct multimodal model to the gallery and updates the chat message template for improved tool interaction handling. The main changes include registering the new model in the gallery/index.yaml and refining the prompt formatting in gallery/qwen3.yaml to correctly wrap tool responses and function calls.

Model Addition:

  • Added a new entry for the Qwen3-VL-30B-A3B-Instruct model in gallery/index.yaml, including metadata, tags, description, download URLs, and file checksums.

Prompt Template Improvements:

  • Updated the chat_message template in gallery/qwen3.yaml to:
    • Render the role as "user" for tool responses and wrap tool outputs with <tool_response> tags.
    • Wrap function call JSON output with <tool_call> tags for clearer separation of tool invocation and response.

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@netlify
Copy link

netlify bot commented Oct 31, 2025

Deploy Preview for localai ready!

Name Link
🔨 Latest commit ddf5c17
🔍 Latest deploy log https://app.netlify.com/projects/localai/deploys/6904f3bbeeb6610009f28587
😎 Deploy Preview https://deploy-preview-6960--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@mudler mudler merged commit a6ef245 into master Oct 31, 2025
23 of 26 checks passed
@mudler mudler deleted the models/qwen3-vl-30b-a3b-instruct branch October 31, 2025 17:37
@github-actions
Copy link

yamllint Failed

Show Output
::group::gallery/index.yaml
::error file=gallery/index.yaml,line=22,col=1::22:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=24,col=1::24:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=26,col=1::26:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=28,col=1::28:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=30,col=1::30:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=32,col=1::32:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=34,col=1::34:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=36,col=1::36:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=38,col=1::38:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=40,col=1::40:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=42,col=1::42:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=44,col=1::44:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=46,col=1::46:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=48,col=1::48:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=50,col=1::50:1 [trailing-spaces] trailing spaces
::error file=gallery/index.yaml,line=52,col=1::52:1 [trailing-spaces] trailing spaces
::warning file=gallery/index.yaml,line=3193,col=6::3193:6 [comments] missing starting space in comment
::warning file=gallery/index.yaml,line=3211,col=6::3211:6 [comments] missing starting space in comment
::warning file=gallery/index.yaml,line=3229,col=6::3229:6 [comments] missing starting space in comment
::warning file=gallery/index.yaml,line=6847,col=32::6847:32 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=8842,col=59::8842:59 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=10735,col=70::10735:70 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=13258,col=61::13258:61 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=13323,col=64::13323:64 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=13934,col=59::13934:59 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=14355,col=64::14355:64 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=15474,col=70::15474:70 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=15826,col=59::15826:59 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=15871,col=63::15871:63 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=15888,col=62::15888:62 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=18170,col=59::18170:59 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=18381,col=61::18381:61 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=18401,col=62::18401:62 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=18456,col=28::18456:28 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=19331,col=59::19331:59 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=19637,col=62::19637:62 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=19692,col=63::19692:63 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=19814,col=63::19814:63 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=20029,col=73::20029:73 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=20365,col=62::20365:62 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=20496,col=61::20496:61 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=20625,col=21::20625:21 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=20977,col=65::20977:65 [comments] too few spaces before comment: expected 2
::warning file=gallery/index.yaml,line=21203,col=56::21203:56 [comments] too few spaces before comment: expected 2
::endgroup::

Workflow: Yamllint GitHub Actions, Action: __karancode_yamllint-github-action, Lint: gallery

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants