Skip to content

vLLM 0.5.1 update#9798

Merged
oyilmaz-nvidia merged 2 commits intomainfrom
cherry-pick-main-2c4f2f989a58b83ecd14448c37afc10b3eb0b8b5
Jul 19, 2024
Merged

vLLM 0.5.1 update#9798
oyilmaz-nvidia merged 2 commits intomainfrom
cherry-pick-main-2c4f2f989a58b83ecd14448c37afc10b3eb0b8b5

Conversation

@github-actions
Copy link
Contributor

What does this PR do ?

Fixes some minor things to make the vLLM integration work with version 0.5.1

Collection: NLP

* Updated the vLLM integration for version 0.5.1.

Signed-off-by: Alexey Panteleev <alpanteleev@nvidia.com>

* Updated the vllm version in requirements_vllm.txt.

Signed-off-by: Alexey Panteleev <alpanteleev@nvidia.com>

* Apply isort and black reformatting

Signed-off-by: apanteleev <apanteleev@users.noreply.github.com>

---------

Signed-off-by: Alexey Panteleev <alpanteleev@nvidia.com>
Signed-off-by: apanteleev <apanteleev@users.noreply.github.com>
Co-authored-by: apanteleev <apanteleev@users.noreply.github.com>
Co-authored-by: Onur Yilmaz <35306097+oyilmaz-nvidia@users.noreply.github.com>
@oyilmaz-nvidia oyilmaz-nvidia merged commit d6e0c15 into main Jul 19, 2024
@oyilmaz-nvidia oyilmaz-nvidia deleted the cherry-pick-main-2c4f2f989a58b83ecd14448c37afc10b3eb0b8b5 branch July 19, 2024 19:22
tonyjie pushed a commit to tonyjie/NeMo that referenced this pull request Jul 24, 2024
* Updated the vLLM integration for version 0.5.1.



* Updated the vllm version in requirements_vllm.txt.



* Apply isort and black reformatting



---------

Signed-off-by: Alexey Panteleev <alpanteleev@nvidia.com>
Signed-off-by: apanteleev <apanteleev@users.noreply.github.com>
Co-authored-by: Alexey Panteleev <alpanteleev@nvidia.com>
Co-authored-by: apanteleev <apanteleev@users.noreply.github.com>
Co-authored-by: Onur Yilmaz <35306097+oyilmaz-nvidia@users.noreply.github.com>
akoumpa pushed a commit that referenced this pull request Jul 25, 2024
* Updated the vLLM integration for version 0.5.1.

* Updated the vllm version in requirements_vllm.txt.

* Apply isort and black reformatting

---------

Signed-off-by: Alexey Panteleev <alpanteleev@nvidia.com>
Signed-off-by: apanteleev <apanteleev@users.noreply.github.com>
Co-authored-by: Alexey Panteleev <alpanteleev@nvidia.com>
Co-authored-by: apanteleev <apanteleev@users.noreply.github.com>
Co-authored-by: Onur Yilmaz <35306097+oyilmaz-nvidia@users.noreply.github.com>
Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
monica-sekoyan pushed a commit that referenced this pull request Oct 14, 2024
* Updated the vLLM integration for version 0.5.1.



* Updated the vllm version in requirements_vllm.txt.



* Apply isort and black reformatting



---------

Signed-off-by: Alexey Panteleev <alpanteleev@nvidia.com>
Signed-off-by: apanteleev <apanteleev@users.noreply.github.com>
Co-authored-by: Alexey Panteleev <alpanteleev@nvidia.com>
Co-authored-by: apanteleev <apanteleev@users.noreply.github.com>
Co-authored-by: Onur Yilmaz <35306097+oyilmaz-nvidia@users.noreply.github.com>
hainan-xv pushed a commit to hainan-xv/NeMo that referenced this pull request Nov 5, 2024
* Updated the vLLM integration for version 0.5.1.



* Updated the vllm version in requirements_vllm.txt.



* Apply isort and black reformatting



---------

Signed-off-by: Alexey Panteleev <alpanteleev@nvidia.com>
Signed-off-by: apanteleev <apanteleev@users.noreply.github.com>
Co-authored-by: Alexey Panteleev <alpanteleev@nvidia.com>
Co-authored-by: apanteleev <apanteleev@users.noreply.github.com>
Co-authored-by: Onur Yilmaz <35306097+oyilmaz-nvidia@users.noreply.github.com>
Signed-off-by: Hainan Xu <hainanx@nvidia.com>
XuesongYang pushed a commit to paarthneekhara/NeMo that referenced this pull request Jan 18, 2025
* Updated the vLLM integration for version 0.5.1.



* Updated the vllm version in requirements_vllm.txt.



* Apply isort and black reformatting



---------

Signed-off-by: Alexey Panteleev <alpanteleev@nvidia.com>
Signed-off-by: apanteleev <apanteleev@users.noreply.github.com>
Co-authored-by: Alexey Panteleev <alpanteleev@nvidia.com>
Co-authored-by: apanteleev <apanteleev@users.noreply.github.com>
Co-authored-by: Onur Yilmaz <35306097+oyilmaz-nvidia@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments