• Stars
    star
    3
  • Rank 3,963,521 (Top 79 %)
  • Language
    C++
  • Created 7 months ago
  • Updated 7 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A lightweight llama2 inference framework. It can inference llama2-7b with 166+ tokens/s on signle 4090.

More Repositories

1

walkdir-rs

Rust library for walking directories recursively.
Rust
26
star
2

qrcode-rust

High-quality QR Code generator library in Rust.
Rust
20
star
3

rust-opencl

OpenCL bindings for Rust.
Rust
14
star
4

bulletproofs-rs

A pure-Rust implementation of Bulletproofs using Ristretto.
Rust
13
star
5

llama-rag-wsl-cuda

Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B.
Jupyter Notebook
12
star
6

tutor-rs

Rust is the language of choice for those looking for high performance, memory safety and all the tools needed to write error free code with ease. In this tutorial I created a full course on programming with Rust.
Rust
8
star
7

llava

Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3).
Python
8
star
8

serial-monitor-rs

A cross-plattform serial monitor/plotter written entirely in rust.
Rust
8
star
9

rust-opengl-lessons

Collection of example code for learning OpenGL in Rust.
Rust
8
star
10

llm-regex

Uses an LLM to generate descriptions and regular expressions for data selections.
HTML
8
star
11

mscsim-win-lnx

Simple flight simulator.
C++
7
star
12

syslog-rs

Send syslog messages from Rust.
Rust
7
star
13

starfox-like

A space shooter like Star Fox.
C++
7
star
14

starfox

A StarFox-like game written in C++.
C++
7
star
15

doom-rs

A Doom Renderer written in Rust.
Rust
7
star
16

sonic-8-bit

Smallscale 3 level remake of the iconic game, Sonic the Hedgehog. In 8-bit.
Java
7
star
17

chatbot-sonic-js

WhatsApp Chatbot in JS
JavaScript
7
star
18

phi3-llm

Phi-3 LLM by Microsoft.
Jupyter Notebook
7
star
19

fire_chat_rust

An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Wasm) frontend packaged with Tauri.
Rust
7
star
20

telebot-rs

Rust Library for creating a Telegram Bot.
Rust
7
star
21

esp-embedded-hal-rs

embedded-hal implementation for Rust on ESP32 and ESP-IDF.
Rust
6
star
22

ender-3d-printer

The Creality3D Ender-3, a fully Open Source 3D printer perfect for new users on a budget.
6
star
23

docker-flask

Dockerizing Flask with Postgres, Gunicorn, and Nginx.
Python
6
star
24

snakeos-rs

Bootable x86 snake game in Rust.
Rust
6
star
25

rust-openai

Rust library for OpenAI.
Rust
6
star
26

NomadBSD

Livesystem based on FreeBSD.
C
6
star
27

graphql-rs

GraphQL in Rust.
Rust
6
star
28

rust-dotnet

Rust for C#/.NET Devs.
JavaScript
6
star
29

btc-blockchain-apps

A full stack for bitcoin and blockchain-based applications
JavaScript
6
star
30

outrun-js

OutRun game written in JavaScript.
JavaScript
5
star
31

flightgear-opensource

FlightGear - Open source flight sim.
CMake
5
star
32

local-agi

Local AGI with LocalAI.
Python
5
star
33

aibot_go_vs_rust

Go vs Rust AI bot voice conversation.
Rust
5
star
34

win-rust

Rust for Windows
Rust
5
star
35

meru-rs

Multiple game consoles emulator written in Rust.
Rust
5
star
36

eagle-win-rs

Rust Rootkit - Windows Kernel Rookit in Rust.
Rust
5
star
37

rust-os

OS microkernel written in Rust.
Rust
5
star
38

chat_llama_rust

A fullstack Rust + React chat app using open-source Llama language models.
Rust
5
star
39

freegeniusai

About FreeGenius AI, an advanced AI assistant that can talk and take multi-step actions. Supports numerous open-source LLMs via Llama.cpp or Ollama or Groq Cloud API, with optional integration with AutoGen agents, OpenAI API, Google Gemini Pro and unlimited plugins.
Python
5
star
40

llm-playground

Curated collection of notebooks and scripts for learning about and experimenting with LLMs, fine-tuning, and RAG.
Jupyter Notebook
5
star
41

irc-srv-elixir

IRC server in Elixir.
Elixir
5
star
42

etufor

Consultar informações diretamente da api da ETUFOR.
HTML
5
star
43

rasp-metal-rs

A library for running bare metal Rust on a Raspberry Pi.
Rust
5
star
44

snake-rust

Snake game in Rust.
JavaScript
4
star
45

sudoku-rs

Sudoku game written in Rust with Piston.
Rust
4
star
46

llm_lib_rust

Rust library for integrating local LLMs (with llama.cpp) and external LLM APIs.
Rust
4
star
47

opensonic_gms

Fan game engine of Sonic SMS Remake. (Game Maker Studio)
Game Maker Language
4
star
48

llamapum-rs

Common language and mathematics processing algorithms in Rust.
HTML
4
star
49

btc-bot

A bitcoin trading bot.
JavaScript
4
star
50

shellcode-win-rs

Windows shellcode development in Rust.
Rust
4
star
51

android-gpu-inspector

Android GPU Inspector
C++
4
star
52

sneex-elixir

Super Nintendo Emulator in Elixir.
Elixir
4
star
53

cobol-examples

Simple Cobol Programs.
COBOL
4
star
54

mistral_client_rust

Rust client for Mistral AI API.
Rust
4
star
55

auto_llm_rust

auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing procedural macros.
Rust
4
star
56

sandbox-win-rs

Sandboxed, Rust-based, Windows Defender Client.
Rust
4
star
57

pong-rs

Pong game written in Rust.
Rust
4
star
58

belmont-elixir

Elixir NES Emulator.
Elixir
4
star
59

llm_chess

Putting two LLMs to play chess.
Python
4
star
60

elastic-rs

An Elasticsearch REST API client for Rust.
Rust
4
star
61

exile-elixir

An Elixir IRC logger.
Elixir
4
star
62

examples-rs

Examples from tutorial and other documentations of Rust.
Rust
4
star
63

sonic_sfml

Remake of the original "Sonic" game using SFML.
C++
4
star
64

btc-lib

A library for working with Bitcoin.
Java
4
star
65

2048-rs

2048 game in Rust with an SDL2 ui.
Rust
4
star
66

win-services-rust

Windows services in Rust.
Rust
4
star
67

oxpilot_rust

Your AI Copilot in Rust.
Rust
4
star
68

galette-rs

A GAL assembler, largely galasm-compatible and written in Rust.
Rust
3
star
69

zsnes-asm-c-cpp

A maintained fork of ZSNES, a Super Nintendo emulator. The original project needs patches to build and is not maintained anymore.
Assembly
3
star
70

ndk-rs

Rust bindings to the Android NDK.
Rust
3
star
71

z80-elixir

Z80 disassembler and emulator written in Elixir.
Elixir
3
star
72

rustless-rs

REST-like API micro-framework for Rust.
Rust
3
star
73

llm-book-analyse

Considering how to analyse book collections, Large Language Model style.
Python
3
star
74

snake-rs

A snake game made with Rust.
Rust
3
star
75

assembly-2024

Assembly 2024 4k intro
C++
3
star
76

podman-ai-lab-recipes

Examples for building and running LLM services and applications locally with Podman.
Python
3
star
77

benchgame-rs

The Computer Language Benchmarks Game: Rust implementations.
Rust
3
star
78

nex-elixir

I try to write an NES emulator in Elixir.
Elixir
3
star
79

s2gg-asm

A remake of the "Sonic the Hedgehog 2" build shown on SEGA SHINSAKU SOFT VOL. 23.
Batchfile
3
star
80

ohai-bot-elixir

An IRC bot written in Elixir.
Elixir
3
star
81

llama2-rs

A fast llama2 decoder in Rust.
Rust
3
star
82

llama-rs

A simple ChatGPT clone in Rust on both the frontend and backend. Uses open source language models and TailwindCSS.
Rust
3
star
83

llama-dfdx-rs

LLaMa 7b with CUDA acceleration implemented in Rust. Minimal GPU memory needed.
Rust
3
star
84

jvm-asm-rs

Generate Java Virtual Machine .class files from Rust.
Rust
3
star
85

wslib-delphi-rs

Delphi websocket library wrapped by Rust.
Rust
3
star
86

llm_jaxlm

A study playground for components of LLM in JAX.
Python
3
star
87

clipper-rs

🎬 A simple screen capture to gif recording program. Written in Rust.
Rust
3
star
88

demo-starter-kit

Demoscene starter kit
C
3
star
89

r-typeform

An R interface to the 'typeform' API.
R
3
star
90

static-analyzer-rs

A static analyzer for Delphi, written in Rust.
Rust
3
star
91

btc-pylib

Bitcoin made easy.
Python
3
star
92

sonic-3-remake

A remake of the game Sonic 2 made with C++ and SDL. With an added level editor.
Makefile
3
star
93

rllama-rs

Rust + OpenCL + AVX2 implementation of LLaMA inference code.
Rust
3
star
94

irc-elixir

IRC client adapter for Elixir projects.
Elixir
3
star
95

brain-js

Simple feed-forward neural network in JavaScript.
JavaScript
3
star
96

sql-injection

SQL Injection
3
star
97

ios-android-rs

Example project for building a library for iOS + Android in Rust.
Shell
3
star
98

raspi-oled-rs

raspi-oled demo in Rust.
Rust
3
star
99

cma_llm

Conceptual Modeling LLM Assistant.
TypeScript
3
star
100

sonic2-sdl

A remake of the game Sonic 2 made with C++ and SDL. With an added level editor.
C++
3
star