ClubieDong/QAQ-KVCacheQuantization ClubieDong/QAQ-KVCacheQuantization

  • Stars
    star
    42
  • Rank 653,484 (Top 13 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created 10 months ago
  • Updated 6 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
ClubieDong/QAQ-KVCacheQuantization
github

ClubieDong

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

QAQ: Quality Adaptive Quantization for LLM KV Cache

More Repositories

1

PointCloud

Point cloud generation using mm-wave radar, classification using PointNet/PointNet++, etc.
Python
8
star
2

ClickOnTime

定时点击工具
C#
5
star
3

Nuaaant

校园互助平台 软件工程原理与应用课程设计
Java
4
star
4

my-xv6

A modified xv6 supporting thread, semaphore, copy-on-write fork, etc.
C
3
star
5

PasswordManager

C#
3
star
6

BoardGameAI

Multiple AIs (MCTS, etc.) for multiple games (Gobang, etc.)
C++
3
star
7

EducationalManagementSystem

软件开发方法实验课程设计
C#
2
star
8

AsciiFilm

A terminal-based designer to make films of Ascii-Art
C++
2
star
9

C-Compiler

An LLVM based C-like language compiler
C++
2
star
10

MIPS-CPU

5-stage pipelined 32-bit MIPS CPU, supporting 57 kinds of instructions and 7 kinds of exceptions.
Verilog
2
star