neuralmagic/optimum-deepsparse neuralmagic/optimum-deepsparse

  • Stars
    star
    4
  • Rank 3,304,323 (Top 66 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created over 1 year ago
  • Updated 10 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
neuralmagic/optimum-deepsparse
github

neuralmagic

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

More Repositories

1

deepsparse

Sparsity-aware deep learning inference runtime for CPUs
Python
2,951
star
2

sparseml

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
Python
2,029
star
3

sparsezoo

Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes
Python
361
star
4

sparsify

ML model optimization product to accelerate inference.
Python
316
star
5

docs

Top-level directory for documentation and general content
MDX
120
star
6

AutoFP8

Python
114
star
7

examples

Notebooks using the Neural Magic libraries 📓
Jupyter Notebook
39
star
8

compressed-tensors

A safetensors extension to efficiently store sparse quantized tensors on disk
Python
20
star
9

mlperf_inference_results_v2.1

Python
5
star
10

helm-charts

Helm charts for deploying NM VLLM
Python
4
star
11

nm-vllm-certs

General Information, model certifications, and benchmarks for nm-vllm enterprise distributions
3
star
12

guidellm

Python
3
star
13

band_of_the_hawk

Hackathon 2022
2
star