npuichigo/openai_trtllm npuichigo/openai_trtllm

  • Stars
    star
    145
  • Rank 252,661 (Top 6 %)
  • Language
    Rust
  • License
    MIT License
  • Created 11 months ago
  • Updated about 2 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
npuichigo/openai_trtllm
github

npuichigo

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

OpenAI compatible API for TensorRT LLM triton backend

More Repositories

1

waveglow

A PyTorch implementation of the WaveGlow: A Flow-based Generative Network for Speech Synthesis
Python
204
star
2

agrpc

Async GRPC with C++20 coroutine support
C++
76
star
3

voicenet

Speech synthesis platform based on tensorflow and sonnet
Makefile
61
star
4

pytorch_lmdb_dataset

pytorch lmdb dataset with protobuf
Python
52
star
5

grpc_gateway_demo

Audio streaming transfer demo with google.api.HttpBody and grpc gateway for speech synthesis
CMake
20
star
6

ttsflow

tensorflow speech synthesis c++ inference for voicenet
C++
16
star
7

exec-rs

C++ p2300 proposal in Rust
Rust
16
star
8

blazing-fast-io-tutorial

Blazing fast data loading with HuggingFace Dataset and Ray Data
15
star
9

extract_features_using_world

using world vocoder to extract features and make data for training neural networks
Python
11
star
10

tarzan

High-level API for tar-based dataset
Python
10
star
11

grpc_with_envoy

gRPC-JSON transcoder with envoy and google.api.HttpBody
CMake
9
star
12

snake

Data loading with combined async Rust stream and Python
Rust
5
star
13

crpc

C++20 coroutine based rpc
C++
5
star
14

webrtc

C++
3
star
15

execution-rs

Rust
2
star
16

code-base

bazel code base with gflags glog and gtest
1
star
17

LightCoroutine

(maybe modified) cppcoro playground
C++
1
star
18

istio-stack

Istio+OTel+Tempo+Loki+Promethues
Python
1
star