tonyzhao-jt/LLM-PQ tonyzhao-jt/LLM-PQ

  • Stars
    star
    25
  • Rank 957,573 (Top 19 %)
  • Language
    Jupyter Notebook
  • Created over 1 year ago
  • Updated 9 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
tonyzhao-jt/LLM-PQ
github

tonyzhao-jt

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"

More Repositories

1

Cat

Cat game
JavaScript
3
star
2

DLRM-TEST

Python
1
star
3

QLLM

Quantization Supported Large Language Model Implementation
Python
1
star
4

CloudArcade

Official Repo for "CloudArcade: A Blockchain Empowered Cloud Gaming System"
JavaScript
1
star