BentoML Gallery project has been deprecated. All samples under the gallery projects have been moved under BentoML/examples directory.
There are no reviews yet. Be the first to send feedback to the community and the maintainers!
BentoML Gallery project has been deprecated. All samples under the gallery projects have been moved under BentoML/examples directory.
OpenLLM
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.BentoML
The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!Yatai
Model Deployment at Scale on Kubernetes 🦄️OneDiffusion
OneDiffusion: Run any Stable Diffusion models and fine-tuned weights with easestable-diffusion-server
Deploy Your Own Stable Diffusion Servicebentoctl
Fast model deployment on any cloud 🚀OCR-as-a-Service
Turn any OCR models into online inference API endpoint 🚀 🌖transformers-nlp-service
Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and moreCLIP-API-service
CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image searchBentoVLLM
Self-host LLMs with vLLM and BentoMLsimple_di
Simple dependency injection framework for Pythonyatai-deployment
🚀 Launching Bento in a Kubernetes clusterFraud-Detection-Model-Serving
Online model serving with Fraud Detection model trained with XGBoost on IEEE-CIS datasetaws-sagemaker-deploy
Fast model deployment on AWS Sagemakeryatai-image-builder
🐳 Build OCI images for Bentos in k8ssentence-embedding-bento
Sentence Embedding as a Servicegoogle-cloud-run-deploy
Fast model deployment on Google Cloud Runaws-lambda-deploy
Fast model deployment on AWS Lambdaaws-ec2-deploy
Fast model deployment on AWS EC2IF-multi-GPUs-demo
rag-tutorials
a series of tutorials implementing rag service with BentoML and LlamaIndexdiffusers-examples
API serving for your diffusers modelsBentoSVD
Pneumonia-Detection-Demo
Pneumonia Detection - Healthcare Imaging Application built with BentoML and fine-tuned Vision Transformer (ViT) modelyatai-chart
Helm Chart for installing Yatai on Kubernetes ⎈benchmark
BentoML Performance Benchmark 🆚plugins
the swish knife to all things bentoml.bentoctl-operator-template
heroku-deploy
Deploy BentoML bundled models to HerokuBentoLMDeploy
Self-host LLMs with LMDeploy and BentoMLbentoml-core
BentoControlNet
BentoWhisperX
google-compute-engine-deploy
BentoCLIP
building a CLIP application using BentoMLBentoRAG
Tutorial: Build RAG Apps with Custom Models Served with BentoMLquickstart
BentoML Quickstart Exampledeploy-bento-action
A GitHub Action to deploy bento to cloudazure-functions-deploy
Fast model deployment on Azure Functionsazure-container-instances-deploy
Fast model deployment on Azure container instancescontainerize-push-action
docker's build-and-push-action equivalent for bentomlBentoSentenceTransformers
how to build a sentence embedding application using BentoMLBentoTRTLLM
bentoml-arize-fraud-detection-workshop
BentoSDXLTurbo
how to build an image generation application using BentoMLyatai-schemas
bentoctl-workshops
llm-bench
bentocloud-homepage-news
yatai-common
BentoBLIP
how to build an image captioning application on top of a BLIP model with BentoMLBentoYolo
BentoML service of YOLO v8.github
✨🍱🦄️BentoBark
BentoMLCLLM
BentoTGI
openllm-benchmark
Love Open Source and this site? Check out how you can help us