ninehills/llm-inference-benchmark ninehills/llm-inference-benchmark

  • Stars
    star
    322
  • Rank 129,614 (Top 3 %)
  • Language
    Python
  • License
    MIT License
  • Created 9 months ago
  • Updated about 2 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
ninehills/llm-inference-benchmark
github

ninehills

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

LLM Inference benchmark

More Repositories

1

blog

Python
747
star
2

chatglm-openai-api

Provide OpenAI style API for ChatGLM-6B and Chinese Embeddings Model
Python
520
star
3

llm-playground

Prompt 工程师利器，可同时比较多个 Prompts 在多个 LLM 模型上的效果
Python
95
star
4

langchain-wenxin

langchain baidu wenxinworkshop wrapper
Python
68
star
5

langeval

Evaluation for AI apps and agent
Python
35
star
6

serialtool

基于QT的串口调试助手
C++
34
star
7

LLM-Fusion-API

Python
32
star
8

Chat-GPT-Enhance

Empower ChatGPT with the ability to perform mathematical calculations, web scraping, PDF analysis, and more.
Python
21
star
9

qt-opencv

qt + opencv example
C++
20
star
10

huami-cli

Flower Password CLI Version
Python
13
star
11

parallel-ssh-mod

parallel-ssh modify version, support --passwd/--identify/... options
Python
7
star
12

p2pfile

p2pfile - Simple P2P file distribution CLI
Go
6
star
13

HuamiDroid

花密的Android客户端，采用PhoneGap框架
JavaScript
6
star
14

bitnami-redis-arm64-docker-build

Build bitnami redis docker image on arm64
Shell
5
star
15

userscript

一些我创建或修改的userscript脚本
JavaScript
4
star
16

pycat

a cross-platform gateway login client in Nankai University
Python
3
star
17

cog-image

Custom cog gpu image
Python
3
star
18

leetcode

Java
2
star
19

Toolbox

Personal Toolbox
Shell
1
star
20

docker-shadowsocks-libev-client

Build a docker image for shadowsocks-libev client with simple-obfs, based on Alpine Linux.
1
star
21

Eden

A Python Distributed Task System
Python
1
star
22

huami

huami clone
JavaScript
1
star