Pinned Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. vllm-omni vllm-omni Public

   Forked from vllm-project/vllm-omni

   A framework for efficient model inference with omni-modality models

   Python

3. llm-d llm-d Public

   Forked from llm-d/llm-d

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell