Skip to content

Conversation

@shanjiaz
Copy link
Collaborator

@shanjiaz shanjiaz commented Dec 18, 2025

vl model support:

  • Extract text_config from multimodal model configs in vocab mapping, training, and model initialization
  • Added kwargs to support vision language parameters like deepstack_input_embeds in custom worker for Qwen3-VL's multimodal processing
  • Use vLLM's native get_language_model() method to access the text model in vision-language architectures
  • Detect base model structure for vision-language models

Util changes:

  • Add suffix pattern matching for weight keys (e.g., "embed_tokens.weight" matches "model.embed_tokens.weight")

  • Support single-file safetensors models (no index.json) by building virtual weight maps

  • Run e2e test for a qwen 3 vl model

Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
@github-actions
Copy link

github-actions bot commented Dec 18, 2025

📦 Build Artifacts Available
The build artifacts (`.whl` and `.tar.gz`) have been successfully generated and are available for download: https://github.com/vllm-project/speculators/actions/runs/20759905084/artifacts/5041230401.
They will be retained for up to 30 days.
Commit: 9c5031d

Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
@github-actions
Copy link

Summary

Status Count
🔍 Total 158
✅ Successful 155
⏳ Timeouts 0
🔀 Redirected 2
👻 Excluded 0
❓ Unknown 0
🚫 Errors 1
⛔ Unsupported 0

Errors per input

Errors in docs/developer/code-of-conduct.md

Redirects per input

Redirects in CONTRIBUTING.md

Redirects in docs/developer/contributing.md

shanjiaz and others added 7 commits December 18, 2025 22:16
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
fynnsu
fynnsu previously approved these changes Jan 5, 2026
Copy link
Collaborator

@fynnsu fynnsu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good!

shanjiaz and others added 2 commits January 5, 2026 13:15
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
@shanjiaz shanjiaz marked this pull request as ready for review January 5, 2026 18:17
Copy link
Collaborator

@rahul-tuli rahul-tuli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! great job

@shanjiaz shanjiaz merged commit 8374278 into main Jan 7, 2026
14 checks passed
@shanjiaz shanjiaz deleted the support-qwen3-vl branch January 7, 2026 16:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants