okuvshynov/llama_duo okuvshynov/llama_duo

  • Stars
    star
    36
  • Rank 735,472 (Top 15 %)
  • Language
    C++
  • License
    MIT License
  • Created 6 months ago
  • Updated 4 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
okuvshynov/llama_duo
github

okuvshynov

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

asynchronous/distributed speculative evaluation for llama3

More Repositories

1

slowllama

Finetune llama2-70b and codellama on MacBook Air without quantization
Python
445
star
2

b63

Micro-benchmarking library for C and C++ with PMU counters tracking
C
55
star
3

cubestat

Horizon chart for CPU/GPU/Neural Engine utilization monitoring on Apple M1/M2 and nVidia GPUs on Linux
Python
24
star
4

flamereport

FlameGraph visualization for terminal
Python
9
star
5

fewlines

Create histograms, time series charts and dashboards in command-line output and log files.
Python
9
star
6

qna

AI pretends to be paper/textbook author, you can ask it questions about the paper as a whole, specific parts of it right in the PDF viewing app (e.g. Apple Preview) using annotations and see the replies there.
Python
5
star
7

hcl

Horizon chart tool for terminal.
Rust
3
star
8

vimqq

local LLM chat for vim with dynamic warmup, forks and multi-model support
Vim Script
2
star
9

thor

mini-horizon charts for tmux status bar
Python
1
star
10

rlscout

In progress attempt to use Deep RL to solve some game
Python
1
star
11

sloth

Python
1
star
12

experiments

C++
1
star
13

scrambled

Python
1
star