Skip to content

Pull requests: vllm-project/production-stack

New pull request New
59 Open 479 Closed
59 Open 479 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Feat]: Add support for chatTemplates
#779 opened Jan 4, 2026 by mahmoudk1000 Loading…
3 tasks done
7
[Feat] Add nodeSelectorTerms for vllmRunTimes
#778 opened Jan 3, 2026 by mahmoudk1000 Loading…
3 tasks done
3
[Feat][Router] Add disaggregated prefill orchestrated routing
#777 opened Dec 31, 2025 by yahavb Loading…
2 of 6 tasks
1
8
feat(router): use aiohttp session for health checks
#776 opened Dec 28, 2025 by nejch Loading…
3 tasks done
4
feat(router): add initial support for anthropic messages endpoint
#775 opened Dec 25, 2025 by nejch Loading…
3 tasks done
6
[Feat] Production Stack Router: Add OpenTelemetry tracing support with W3C context propagation
#772 opened Dec 20, 2025 by HanFa Loading…
3 tasks done
1
6
[Build][Router] Update vllm to v0.13.0
#770 opened Dec 16, 2025 by shernshiou Loading…
3 tasks done
9
Fix score payload typo and add regression test
#769 opened Dec 16, 2025 by keyuchen21 Loading…
3
feat: pass engineLabels to workerGroup
#753 opened Nov 6, 2025 by JustinDuy Loading…
1 of 3 tasks
3
[Bugfix] Allow single-label hostnames in URL validation
#737 opened Oct 16, 2025 by osaimi Loading…
4
[Bugfix] Added NULL check for session_key in KvawareRouter
#736 opened Oct 15, 2025 by vjayarag Loading…
3 tasks
4
fix: Exclude content-length from response headers in route_general_transcriptions
#733 opened Oct 13, 2025 by fidoriel Loading…
11
[Feat][Router] Add HashTrie LRU to prevent OOM
#711 opened Sep 22, 2025 by can-sun Loading…
3 tasks done
1
21
[Bugfix][Router] use model_type instead of model_label
#705 opened Sep 19, 2025 by max-wittig Loading…
2 of 3 tasks
6
feat: allow for configuration of number of uvicorn workers
#689 opened Sep 9, 2025 by TheCodeWrangler Loading…
8 tasks done
9
[Bugfix] cache server yaml err
#677 opened Sep 4, 2025 by yyzxw Loading…
3 tasks done
1
3
[Misc] Add Makefile to run full pipeline with a single command
#675 opened Sep 3, 2025 by ikaadil Loading…
12
[Router][Feat][Bugfix] Add Swagger UI (OpenAPI) support with Pydantic request models + fix rewrite Content-Length + test
#672 opened Sep 2, 2025 by JaredforReal Loading…
1
9
[Feat][Router] Add TTFT Routing
#670 opened Sep 1, 2025 by chickeyton • Draft
3 tasks
1
48
[Feat][PD] lastest PD support from LMCache with NIXL
#669 opened Aug 28, 2025 by kobe0938 Loading…
3 tasks
17
[Bug][Router] ZombieIP: router routes to model pod that doesn't exist anymore
#666 opened Aug 26, 2025 by jonoillar Loading…
3 tasks
1
25
[CI] Fix bug for PD CI when router is running before vllm instance running
#663 opened Aug 26, 2025 by zerofishnoodles Loading…
3 tasks done
1
[Build] use uv with cache mount for faster docker builds
#657 opened Aug 23, 2025 by Hexoplon Loading…
3 tasks done
3
[Feat][Router] add ability to specify params to drop
#650 opened Aug 20, 2025 by max-wittig Loading…
3 tasks done
6
[Feat][Router] Add simple request migration for vLLM failure
#643 opened Aug 12, 2025 by lucas-tucker Loading…
14
ProTip! Follow long discussions with comments:>50.