tspeterkim/paged-attention-minimal tspeterkim/paged-attention-minimal

  • Stars
    star
    13
  • Rank 1,503,499 (Top 30 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created 3 months ago
  • Updated 2 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
tspeterkim/paged-attention-minimal
github

tspeterkim

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

a minimal cache manager for PagedAttention, on top of llama3.

More Repositories

1

flash-attention-minimal

Flash Attention in ~100 lines of CUDA (forward pass only)
Cuda
496
star
2

insta-chat

DIY Instagram Chat Automation with Google Sheets
HTML
231
star
3

mixed-precision-from-scratch

Mixed precision training from scratch with Tensors and CUDA
Python
15
star
4

attentive-reader

TensorFlow-based implementation of Stanford's Attentive Reader for the CNN/DailyMail datatset
Python
8
star
5

cuda-1brc

My CUDA solution to the 1BRC
Cuda
7
star
6

lucene-wikipedia

Lucene-based Multi-sentence context retriever for open-domain QA setting
Java
2
star
7

tweet-emoji-predictor

Tweet Emoji Predictor - SemEval 2018 Task 2
Jupyter Notebook
2
star
8

dotfiles

all hail vim
Vim Script
1
star
9

Hello-World

My First Repo
1
star
10

Free-For-Sale

PHP
1
star
11

Movie-Rating-System

The Ultimate Movie Ratings App
JavaScript
1
star
12

carla-driver

Autonomous Driving Agent for CARLA
Jupyter Notebook
1
star
13

positioning

RNN based prediction of wearer's position given sensor data from Android Wear
Python
1
star
14

gpt

Jupyter Notebook
1
star
15

peterkim95.github.io

Me
HTML
1
star
16

PDB-Evaluator

A Python-based inference system for Probabilistic Databases
Python
1
star
17

style-transferer

Lightweight style transferer built with SqueezeNet
Python
1
star
18

Hemorrhage-Predictor-from-MRIs

Accurate Hemorrhage Predictor using MRIs
Python
1
star
19

Spread-The-Word

The source code for Spread The Word.
PHP
1
star