Pinned Loading

1. vllm-project/llm-compressor vllm-project/llm-compressor Public

   State-of-the-art LLM compression, built for production inference with vLLM

   Python 3.9k 681

2. vllm-project/compressed-tensors vllm-project/compressed-tensors Public

   A safetensors extension to efficiently store sparse quantized tensors on disk

   Python 329 129

3. neuralmagic/deepsparse neuralmagic/deepsparse Public archive

   Sparsity-aware deep learning inference runtime for CPUs

   Python 3.2k 192

4. neuralmagic/sparseml neuralmagic/sparseml Public archive

   Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

   Python 2.1k 157

5. neuralmagic/sparsezoo neuralmagic/sparsezoo Public archive

   Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes

   Python 388 27

6. neuralmagic/sparsify neuralmagic/sparsify Public archive

   ML model optimization product to accelerate inference.

   Python 325 32