Skip to content

[AMD] Use upstream SGLang images on mi300, mi325 and mi355 for dsr1fp8#307

Merged
rkarhila-amd merged 4 commits intoSemiAnalysisAI:rkarhila/update_images_for_dsr1fp8_MI300_MI325_MI355from
rkarhila-amd:update_images_for_dsr1fp8_MI300_MI325_MI355
Dec 10, 2025
Merged

[AMD] Use upstream SGLang images on mi300, mi325 and mi355 for dsr1fp8#307
rkarhila-amd merged 4 commits intoSemiAnalysisAI:rkarhila/update_images_for_dsr1fp8_MI300_MI325_MI355from
rkarhila-amd:update_images_for_dsr1fp8_MI300_MI325_MI355

Conversation

@rkarhila-amd
Copy link
Copy Markdown
Collaborator

  1. Use upstream SGLang image "lmsysorg/sglang:v0.5.5.post3-rocm700-mi30x" for MI300X
  2. Use upstream SGLang Image "lmsysorg/sglang:v0.5.5.post3-rocm700-mi30x" for MI325X
  3. Use upstream SGLang Image "lmsysorg/sglang:v0.5.5.post3-rocm700-mi35x" for MI355X
  4. MI355X launch scripts updated,

This PR addresses:
https://github.com/InferenceMAX/InferenceMAX/issues/292
https://github.com/InferenceMAX/InferenceMAX/issues/291
and
https://github.com/InferenceMAX/InferenceMAX/pull/295

@rkarhila-amd rkarhila-amd changed the base branch from main to rkarhila/update_images_for_dsr1fp8_MI300_MI325_MI355 December 10, 2025 10:33
@rkarhila-amd rkarhila-amd merged commit 20ca1bc into SemiAnalysisAI:rkarhila/update_images_for_dsr1fp8_MI300_MI325_MI355 Dec 10, 2025
@ppanchal-1
Copy link
Copy Markdown

can we close this ?

cquil11 added a commit that referenced this pull request Jan 5, 2026
… (#332)

* Use upstream SGLang images on mi300, mi325 and mi355 for dsr1fp8 (#307)

* Switching dsr1 fp8 to lmsys images for MI355, MI325 and MI300

---------

Co-authored-by: Chun Fang <chun.fang@amd.com>

* add changes to perf changelog

* update perf changelog

* update perf changelog pt 2

* update perf changelog pt 3

* remove deleted links in .yaml

* fix AMD's perf-changelog.yaml

Updated the pull request link for dsr1fp8 in the changelog.

---------

Co-authored-by: Chun Fang <chun.fang@amd.com>
Co-authored-by: Cameron Quilici <cjquilici@gmail.com>
Co-authored-by: functionstackx <47992694+functionstackx@users.noreply.github.com>
@cquil11 cquil11 added the AMD label Apr 8, 2026
@cquil11 cquil11 changed the title Use upstream SGLang images on mi300, mi325 and mi355 for dsr1fp8 [AMD] Use upstream SGLang images on mi300, mi325 and mi355 for dsr1fp8 Apr 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

Development

Successfully merging this pull request may close these issues.

4 participants