Neural Magic
Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM
Pinned Loading
Repositories
Showing 10 of 73 repositories
- compressed-tensors Public
A safetensors extension to efficiently store sparse quantized tensors on disk
neuralmagic/compressed-tensors’s past year of commit activity - speculators Public
neuralmagic/speculators’s past year of commit activity - model-validation-configs Public
neuralmagic/model-validation-configs’s past year of commit activity - transformers Public archive Forked from huggingface/transformers
🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
neuralmagic/transformers’s past year of commit activity
Top languages
Loading…
Most used topics
Loading…