Popular repositories Loading

1. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

2. torchair torchair Public

   Forked from Ascend/torchair

   Python

3. pytorch pytorch Public

   Forked from Ascend/pytorch

   Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch

   Python

4. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

5. bench360 bench360 Public

   Forked from slinusc/bench360

   Bench360 is a modular benchmarking suite for local LLM deployments. It offers a full-stack, extensible pipeline to evaluate the latency, throughput, quality, and cost of LLM inference on consumer a…

   Python

6. xllm xllm Public

   Forked from jd-opensource/xllm

   A high-performance inference engine for LLMs, optimized for diverse AI accelerators.

   C++