There are no reviews yet. Be the first to send feedback to the community and the maintainers!
OpenLLM
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.BentoML
The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!Yatai
Model Deployment at Scale on Kubernetes 🦄️OneDiffusion
OneDiffusion: Run any Stable Diffusion models and fine-tuned weights with easestable-diffusion-server
Deploy Your Own Stable Diffusion Servicebentoctl
Fast model deployment on any cloud 🚀gallery
BentoML Example Projects 🎨transformers-nlp-service
Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and moreCLIP-API-service
CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image searchBentoVLLM
Self-host LLMs with vLLM and BentoMLsimple_di
Simple dependency injection framework for Pythonyatai-deployment
🚀 Launching Bento in a Kubernetes clusterFraud-Detection-Model-Serving
Online model serving with Fraud Detection model trained with XGBoost on IEEE-CIS datasetaws-sagemaker-deploy
Fast model deployment on AWS Sagemakeryatai-image-builder
🐳 Build OCI images for Bentos in k8ssentence-embedding-bento
Sentence Embedding as a Servicegoogle-cloud-run-deploy
Fast model deployment on Google Cloud Runaws-lambda-deploy
Fast model deployment on AWS Lambdaaws-ec2-deploy
Fast model deployment on AWS EC2IF-multi-GPUs-demo
rag-tutorials
a series of tutorials implementing rag service with BentoML and LlamaIndexdiffusers-examples
API serving for your diffusers modelsBentoSVD
Pneumonia-Detection-Demo
Pneumonia Detection - Healthcare Imaging Application built with BentoML and fine-tuned Vision Transformer (ViT) modelyatai-chart
Helm Chart for installing Yatai on Kubernetes ⎈benchmark
BentoML Performance Benchmark 🆚plugins
the swish knife to all things bentoml.bentoctl-operator-template
heroku-deploy
Deploy BentoML bundled models to HerokuBentoLMDeploy
Self-host LLMs with LMDeploy and BentoMLbentoml-core
BentoControlNet
BentoWhisperX
google-compute-engine-deploy
BentoCLIP
building a CLIP application using BentoMLBentoRAG
Tutorial: Build RAG Apps with Custom Models Served with BentoMLquickstart
BentoML Quickstart Exampledeploy-bento-action
A GitHub Action to deploy bento to cloudazure-functions-deploy
Fast model deployment on Azure Functionsazure-container-instances-deploy
Fast model deployment on Azure container instancescontainerize-push-action
docker's build-and-push-action equivalent for bentomlBentoSentenceTransformers
how to build a sentence embedding application using BentoMLBentoTRTLLM
bentoml-arize-fraud-detection-workshop
BentoSDXLTurbo
how to build an image generation application using BentoMLyatai-schemas
bentoctl-workshops
llm-bench
bentocloud-homepage-news
yatai-common
BentoBLIP
how to build an image captioning application on top of a BLIP model with BentoMLBentoYolo
BentoML service of YOLO v8.github
✨🍱🦄️BentoBark
BentoMLCLLM
BentoTGI
openllm-benchmark
Love Open Source and this site? Check out how you can help us