There are no reviews yet. Be the first to send feedback to the community and the maintainers!
OpenLLM
Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.BentoML
The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!Yatai
Model Deployment at Scale on Kubernetes π¦οΈBentoDiffusion
BentoDiffusion: A collection of diffusion models served with BentoMLstable-diffusion-server
Deploy Your Own Stable Diffusion Servicebentoctl
Fast model deployment on any cloud πgallery
BentoML Example Projects π¨BentoVLLM
Self-host LLMs with vLLM and BentoMLOCR-as-a-Service
Turn any OCR models into online inference API endpoint π πCLIP-API-service
CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image searchtransformers-nlp-service
Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and morellm-bench
rag-tutorials
a series of tutorials implementing rag service with BentoML and LlamaIndexsimple_di
Simple dependency injection framework for PythonBentoChatTTS
Fraud-Detection-Model-Serving
Online model serving with Fraud Detection model trained with XGBoost on IEEE-CIS datasetyatai-deployment
π Launching Bento in a Kubernetes clustergoogle-cloud-run-deploy
Fast model deployment on Google Cloud Runaws-sagemaker-deploy
Fast model deployment on AWS Sagemakeraws-lambda-deploy
Fast model deployment on AWS Lambdaaws-ec2-deploy
Fast model deployment on AWS EC2BentoLMDeploy
Self-host LLMs with LMDeploy and BentoMLyatai-image-builder
π³ Build OCI images for Bentos in k8ssentence-embedding-bento
Sentence Embedding as a ServiceIF-multi-GPUs-demo
openllm-models
BentoSVD
BentoWhisperX
diffusers-examples
API serving for your diffusers modelsBentoCLIP
building a CLIP application using BentoMLPneumonia-Detection-Demo
Pneumonia Detection - Healthcare Imaging Application built with BentoML and fine-tuned Vision Transformer (ViT) modelbenchmark
BentoML Performance Benchmark πBentoTRTLLM
plugins
the swish knife to all things bentoml.bentoctl-operator-template
heroku-deploy
Deploy BentoML bundled models to Herokuquickstart
BentoML Quickstart ExampleBentoSentenceTransformers
how to build a sentence embedding application using BentoMLBentoYolo
BentoML service of YOLO v8google-compute-engine-deploy
bentoml-core
BentoControlNet
BentoBark
BentoRAG
Tutorial: Build RAG Apps with Custom Models Served with BentoMLBentoXTTS
how to build an text-to-speech application using BentoMLcontainerize-push-action
docker's build-and-push-action equivalent for bentomlBentoBLIP
how to build an image captioning application on top of a BLIP model with BentoMLdeploy-bento-action
A GitHub Action to deploy bento to cloudazure-functions-deploy
Fast model deployment on Azure Functionsazure-container-instances-deploy
Fast model deployment on Azure container instancesBentoFunctionCalling
llm-router
LLM Router DemoBentoResnet
bentoml-arize-fraud-detection-workshop
BentoSDXLTurbo
how to build an image generation application using BentoMLBentoSearch
Search with LLMBentoInfinity
BentoMLCLLM
yatai-schemas
bentoctl-workshops
bentocloud-homepage-news
yatai-common
BentoMoirai
.github
β¨π±π¦οΈbentoml-unsloth
BentoML Unsloth integrationBentoShield
LLMGateway
BentoTGI
openllm-benchmark
Love Open Source and this site? Check out how you can help us