Popular repositories Loading

1. multi_turn_LLM_Inference multi_turn_LLM_Inference Public

   Shell 1

2. attention-is-all-you-need-pytorch attention-is-all-you-need-pytorch Public

   Forked from jadore801120/attention-is-all-you-need-pytorch

   A PyTorch implementation of the Transformer model in "Attention is All You Need".

   Python

3. server server Public

   Forked from triton-inference-server/server

   The Triton Inference Server provides an optimized cloud and edge inferencing solution.

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

5. specinfer-ae specinfer-ae Public

   Forked from goliaro/specinfer-ae

   Shell

6. PowerInfer PowerInfer Public

   Forked from Tiiny-AI/PowerInfer

   High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

   C++