@neuralmagic
Guthub

neuralmagic

Twitter logo Share LinkedIn logo Share Facebook logo Share

Top repositories

1

deepsparse

Sparsity-aware deep learning inference runtime for CPUs
Python
2,951
star
2

sparseml

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
Python
2,029
star
3

sparsezoo

Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes
Python
361
star
4

sparsify

ML model optimization product to accelerate inference.
Python
316
star
5

docs

Top-level directory for documentation and general content
MDX
120
star
6

AutoFP8

Python
114
star
7

examples

Notebooks using the Neural Magic libraries πŸ““
Jupyter Notebook
39
star
8

compressed-tensors

A safetensors extension to efficiently store sparse quantized tensors on disk
Python
20
star
9

mlperf_inference_results_v2.1

Python
5
star
10

optimum-deepsparse

Python
4
star
11

helm-charts

Helm charts for deploying NM VLLM
Python
4
star
12

nm-vllm-certs

General Information, model certifications, and benchmarks for nm-vllm enterprise distributions
3
star
13

guidellm

Python
3
star
14

band_of_the_hawk

Hackathon 2022
2
star