Pinned Loading

1. vllm-project/llm-compressor vllm-project/llm-compressor Public

   Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

   Python 1.7k 178

2. neuralmagic/compressed-tensors neuralmagic/compressed-tensors Public

   A safetensors extension to efficiently store sparse quantized tensors on disk

   Python 137 17

3. neuralmagic/deepsparse neuralmagic/deepsparse Public archive

   Sparsity-aware deep learning inference runtime for CPUs

   Python 3.2k 189

4. neuralmagic/sparseml neuralmagic/sparseml Public archive

   Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

   Python 2.1k 157

5. neuralmagic/sparsezoo neuralmagic/sparsezoo Public archive

   Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes

   Python 392 28

6. neuralmagic/sparsify neuralmagic/sparsify Public archive

   ML model optimization product to accelerate inference.

   Python 326 30