Pinned Loading

1. neuralmagic/deepsparse neuralmagic/deepsparse Public archive

   Sparsity-aware deep learning inference runtime for CPUs

   Python 3.2k 191

2. neuralmagic/sparseml neuralmagic/sparseml Public archive

   Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

   Python 2.1k 156

3. vllm-project/llm-compressor vllm-project/llm-compressor Public

   Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

   Python 3.2k 490

4. vllm-project/compressed-tensors vllm-project/compressed-tensors Public

   A safetensors extension to efficiently store sparse quantized tensors on disk

   Python 274 83