Skip to content

fix: handle missing out_hidden_size for LLaVA models in EPD encode worker#6765

Merged
saturley-hall merged 1 commit into
release/1.0.0from
kprashanth/DIS-1529-vllm-epd-llava
Mar 2, 2026
Merged

fix: handle missing out_hidden_size for LLaVA models in EPD encode worker#6765
saturley-hall merged 1 commit into
release/1.0.0from
kprashanth/DIS-1529-vllm-epd-llava

Conversation

@KrishnanPrash
Copy link
Copy Markdown
Contributor

@KrishnanPrash KrishnanPrash commented Mar 2, 2026

Overview:

Cherrypick for #6759

@KrishnanPrash KrishnanPrash requested a review from a team as a code owner March 2, 2026 19:56
@KrishnanPrash KrishnanPrash requested a review from a team March 2, 2026 19:56
@KrishnanPrash KrishnanPrash requested review from a team as code owners March 2, 2026 19:56
@copy-pr-bot
Copy link
Copy Markdown

copy-pr-bot Bot commented Mar 2, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@github-actions github-actions Bot added the fix label Mar 2, 2026
@github-actions github-actions Bot added documentation Improvements or additions to documentation backend::vllm Relates to the vllm backend deployment::k8s Relates to dynamo deployment in kubernetes backend::sglang Relates to the sglang backend backend::trtllm Relates to the trtllm backend planner frontend `python -m dynamo.frontend` and `dynamo-run in=http|text|grpc` multimodal router Relates to routing, KV-aware routing, etc. container actions labels Mar 2, 2026
@KrishnanPrash KrishnanPrash changed the base branch from main to release/1.0.0 March 2, 2026 19:56
@KrishnanPrash
fix: handle missing out_hidden_size for LLaVA models in EPD encode …
0f87349 
…worker (#6759)

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
@KrishnanPrash KrishnanPrash force-pushed the kprashanth/DIS-1529-vllm-epd-llava branch from a6b1cd8 to 0f87349 Compare March 2, 2026 20:01
@KrishnanPrash KrishnanPrash removed documentation Improvements or additions to documentation size/XS backend::vllm Relates to the vllm backend deployment::k8s Relates to dynamo deployment in kubernetes fix backend::sglang Relates to the sglang backend backend::trtllm Relates to the trtllm backend labels Mar 2, 2026
@KrishnanPrash KrishnanPrash removed planner frontend `python -m dynamo.frontend` and `dynamo-run in=http|text|grpc` router Relates to routing, KV-aware routing, etc. container actions labels Mar 2, 2026
@saturley-hall saturley-hall merged commit 4aa6b8d into release/1.0.0 Mar 2, 2026
57 checks passed
@saturley-hall saturley-hall deleted the kprashanth/DIS-1529-vllm-epd-llava branch March 2, 2026 22:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

multimodal

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@KrishnanPrash @saturley-hall