Explore @bentoml Open Source projects

BentoML (@bentoml)

bentoml

Stars
17,121
Global Org. Rank 1,295 (Top 0.5 %)
Registered about 5 years ago
Most used languages

Python
71.4 %

Jupyter Notebook
8.9 %

Go
8.9 %

TypeScript
3.6 %

Rust
1.8 %

Mustache 1.8 %

Starlark 1.8 %

HCL 1.8 %
Location 🇺🇸 United States
Country Total Rank 836
Country Ranking

Python
69

Starlark 96

Mustache 108

TypeScript
669

HCL 1,237

Jupyter Notebook
1,970

Go
3,837

Rust
4,883

OpenLLM

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

BentoML

The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!

Yatai

Model Deployment at Scale on Kubernetes 🦄️

OneDiffusion

OneDiffusion: Run any Stable Diffusion models and fine-tuned weights with ease

stable-diffusion-server

Deploy Your Own Stable Diffusion Service

bentoctl

Fast model deployment on any cloud 🚀

gallery

BentoML Example Projects 🎨

OCR-as-a-Service

Turn any OCR models into online inference API endpoint 🚀 🌖

transformers-nlp-service

Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more

CLIP-API-service

CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search

Jupyter Notebook

BentoVLLM

Self-host LLMs with vLLM and BentoML

simple_di

Simple dependency injection framework for Python

yatai-deployment

🚀 Launching Bento in a Kubernetes cluster

Fraud-Detection-Model-Serving

Online model serving with Fraud Detection model trained with XGBoost on IEEE-CIS dataset

Jupyter Notebook

aws-sagemaker-deploy

Fast model deployment on AWS Sagemaker

yatai-image-builder

🐳 Build OCI images for Bentos in k8s

sentence-embedding-bento

Sentence Embedding as a Service

Jupyter Notebook

google-cloud-run-deploy

Fast model deployment on Google Cloud Run

aws-lambda-deploy

Fast model deployment on AWS Lambda

aws-ec2-deploy

Fast model deployment on AWS EC2

IF-multi-GPUs-demo

rag-tutorials

a series of tutorials implementing rag service with BentoML and LlamaIndex

diffusers-examples

API serving for your diffusers models

BentoSVD

Pneumonia-Detection-Demo

Pneumonia Detection - Healthcare Imaging Application built with BentoML and fine-tuned Vision Transformer (ViT) model

yatai-chart

Helm Chart for installing Yatai on Kubernetes ⎈

benchmark

BentoML Performance Benchmark 🆚

Jupyter Notebook

plugins

the swish knife to all things bentoml.

bentoctl-operator-template

heroku-deploy

Deploy BentoML bundled models to Heroku

BentoLMDeploy

Self-host LLMs with LMDeploy and BentoML

bentoml-core

BentoControlNet

BentoWhisperX

google-compute-engine-deploy

BentoCLIP

building a CLIP application using BentoML

BentoRAG

Tutorial: Build RAG Apps with Custom Models Served with BentoML

quickstart

BentoML Quickstart Example

deploy-bento-action

A GitHub Action to deploy bento to cloud

azure-functions-deploy

Fast model deployment on Azure Functions

azure-container-instances-deploy

Fast model deployment on Azure container instances

containerize-push-action

docker's build-and-push-action equivalent for bentoml

BentoSentenceTransformers

how to build a sentence embedding application using BentoML

BentoTRTLLM

bentoml-arize-fraud-detection-workshop

Jupyter Notebook

BentoSDXLTurbo

how to build an image generation application using BentoML

yatai-schemas

bentoctl-workshops

llm-bench

bentocloud-homepage-news

yatai-common

BentoBLIP

how to build an image captioning application on top of a BLIP model with BentoML

BentoYolo

BentoML service of YOLO v8

.github

BentoBark

BentoMLCLLM

BentoTGI

openllm-benchmark