Skip to content
@neuralmagic

Neural Magic

Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM

Pinned Loading

  1. nm-vllm-certs nm-vllm-certs Public

    General Information, model certifications, and benchmarks for nm-vllm enterprise distributions

    11 1

  2. deepsparse deepsparse Public archive

    Sparsity-aware deep learning inference runtime for CPUs

    Python 3.2k 187

  3. sparseml sparseml Public archive

    Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

    Python 2.1k 157

  4. docs docs Public archive

    Top-level directory for documentation and general content

    MDX 121 7

  5. sparsezoo sparsezoo Public archive

    Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes

    Python 389 28

  6. guidellm guidellm Public

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    Python 330 41

Repositories

Showing 10 of 73 repositories

Top languages

Loading…

Most used topics

Loading…