neuralmagic/nm-vllm-certs neuralmagic/nm-vllm-certs

  • Stars
    star
    3
  • Rank 3,951,355 (Top 78 %)
  • Language
  • Created 3 months ago
  • Updated about 1 month ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
neuralmagic/nm-vllm-certs
github

neuralmagic

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

General Information, model certifications, and benchmarks for nm-vllm enterprise distributions

More Repositories

1

deepsparse

Sparsity-aware deep learning inference runtime for CPUs
Python
2,951
star
2

sparseml

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
Python
2,029
star
3

sparsezoo

Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes
Python
361
star
4

sparsify

ML model optimization product to accelerate inference.
Python
316
star
5

docs

Top-level directory for documentation and general content
MDX
120
star
6

AutoFP8

Python
114
star
7

examples

Notebooks using the Neural Magic libraries πŸ““
Jupyter Notebook
39
star
8

compressed-tensors

A safetensors extension to efficiently store sparse quantized tensors on disk
Python
20
star
9

mlperf_inference_results_v2.1

Python
5
star
10

optimum-deepsparse

Python
4
star
11

helm-charts

Helm charts for deploying NM VLLM
Python
4
star
12

guidellm

Python
3
star
13

band_of_the_hawk

Hackathon 2022
2
star