Skip to content

ROCm SGLang: make env vars default #290

@cquil11

Description

@cquil11

Certain environment variables are set in https://github.com/InferenceMAX/InferenceMAX/pull/247.

Since these give optimal performance, these should simply be set by default.

Metadata

Metadata

Assignees

Labels

Type

Projects

Status

Todo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions