interestingLSY/swiftLLM interestingLSY/swiftLLM

  • Stars
    star
    84
  • Rank 387,182 (Top 8 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created 5 months ago
  • Updated 3 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
interestingLSY/swiftLLM
github

interestingLSY

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).

More Repositories

1

hpcgame.minesweeper

C++
12
star
2

intOJ

A Online Judge System For The ACM-ICPC/OI Contest
JavaScript
8
star
3

MyBlog

JavaScript
4
star
4

intServer

A high performance minecraft server, in C++20
C++
4
star
5

DDL-Firewall

C++
3
star
6

sysy-compiler

A compiler for the SYSY language (a subset of C). My homework for the course "compiler principles"
C++
2
star
7

NeuroFrame

A tiny framework for AI training and inference. My homework for the course "programming in AI".
C++
2
star
8

NoobPool

NoobPool 菜鸟矿池
1
star
9

intoj-judger-rebuild

Python
1
star
10

IntPool

JavaScript
1
star
11

24-2048

HTML
1
star
12

CUDA-From-Correctness-To-Performance-Code

Codes & examples for "CUDA - From Correctness to Performance"
C++
1
star