There are no reviews yet. Be the first to send feedback to the community and the maintainers!
OpenLLM
Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.BentoML
The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!Yatai
Model Deployment at Scale on Kubernetes 🦄️BentoDiffusion
BentoDiffusion: A collection of diffusion models served with BentoMLstable-diffusion-server
Deploy Your Own Stable Diffusion Servicebentoctl
Fast model deployment on any cloud 🚀gallery
BentoML Example Projects 🎨BentoVLLM
Self-host LLMs with vLLM and BentoMLOCR-as-a-Service
Turn any OCR models into online inference API endpoint 🚀 🌖CLIP-API-service
CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image searchtransformers-nlp-service
Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and morellm-bench
simple_di
Simple dependency injection framework for PythonBentoChatTTS
rag-tutorials
a series of tutorials implementing rag service with BentoML and LlamaIndexyatai-deployment
🚀 Launching Bento in a Kubernetes clusterFraud-Detection-Model-Serving
Online model serving with Fraud Detection model trained with XGBoost on IEEE-CIS datasetgoogle-cloud-run-deploy
Fast model deployment on Google Cloud Runaws-sagemaker-deploy
Fast model deployment on AWS Sagemakeryatai-image-builder
🐳 Build OCI images for Bentos in k8ssentence-embedding-bento
Sentence Embedding as a Serviceaws-lambda-deploy
Fast model deployment on AWS Lambdaaws-ec2-deploy
Fast model deployment on AWS EC2BentoLMDeploy
Self-host LLMs with LMDeploy and BentoMLIF-multi-GPUs-demo
BentoSVD
diffusers-examples
API serving for your diffusers modelsopenllm-models
Pneumonia-Detection-Demo
Pneumonia Detection - Healthcare Imaging Application built with BentoML and fine-tuned Vision Transformer (ViT) modelBentoWhisperX
yatai-chart
Helm Chart for installing Yatai on Kubernetes ⎈benchmark
BentoML Performance Benchmark 🆚BentoCLIP
building a CLIP application using BentoMLplugins
the swish knife to all things bentoml.bentoctl-operator-template
heroku-deploy
Deploy BentoML bundled models to HerokuBentoSentenceTransformers
how to build a sentence embedding application using BentoMLbentoml-core
quickstart
BentoML Quickstart ExampleBentoControlNet
BentoYolo
BentoML service of YOLO v8google-compute-engine-deploy
BentoRAG
Tutorial: Build RAG Apps with Custom Models Served with BentoMLcontainerize-push-action
docker's build-and-push-action equivalent for bentomlBentoTRTLLM
BentoBLIP
how to build an image captioning application on top of a BLIP model with BentoMLdeploy-bento-action
A GitHub Action to deploy bento to cloudazure-functions-deploy
Fast model deployment on Azure FunctionsBentoBark
azure-container-instances-deploy
Fast model deployment on Azure container instancesBentoResnet
bentoml-arize-fraud-detection-workshop
BentoSDXLTurbo
how to build an image generation application using BentoMLyatai-schemas
bentoctl-workshops
bentocloud-homepage-news
yatai-common
BentoMoirai
.github
✨🍱🦄️BentoMLCLLM
BentoTGI
openllm-benchmark
Love Open Source and this site? Check out how you can help us