AI-in-a-Box
Embarking on an Azure AI/ML journey can appear challenging for certain organizations and engineers, often leading to roadblocks in their initial scenarios. To address this challenge, providing a user-friendly and intuitive template becomes crucial. Such a template should serve as a guiding example, illustrating the complete AI/ML/LLM lifecycle, showcasing the integration of MLOps practices, detailing the setup of training pipelines, offering insights into the processes of model training, deployment, access control, and integration with other services. This ensures a smoother and more comprehensible transition into the world of Azure AI and ML.
AI-in-a-Box aims to provide an "Azure AI/ML Easy Button" for common scenarios within Azure ML, Edge AI, Cog Services and Azure OpenAI. Something that shows you how the pieces fit together in easy to deploy templates. Using the patterns available here, engineers will be able to quickly setup an Azure ML/AI Edge/Cog Services and/or Azure Open AI environment which optionally includes data ingestion, model training and creation, scaling patterns and edge deployments. So, if you’re seeking to shed some light into the realm of Azure ML/AI and Open AI, you’ve come to the right spot.
Available Guidance
| Topic | Description |
|---|---|
| Responsible AI | This provides essential guidance on the responsible use of AI and LLM technologies. |
| Security for Generative AI Applications | This document provides specific security guidance for Generative AI (GenAI) applications. |
| Scaling OpenAI Applications | This document contains best practices for scaling OpenAI applications within Azure. |
Available Patterns
| Pattern | Description | Supported Use Cases and Features |
|---|---|---|
| Azure ML Operationalization in-a-box | Boilerplate Data Science project from model development to deployment and monitoring | |
| Edge AI in-a-box | Edge AI from model creation to deployment on Edge Device(s) | |
| Doc Intelligence in-a-box | This accelerator enables companies to automate PDF form processing, modernize operations, save time, and cut costs as part of their digital transformation journey. | |
| Video Analysis-Azure Open AI in-a-box | Extracts information about videos by ingesting them into an Azure Computer Vision Video Retrieval index and sending the index to Azure GPT-4 Turbo with Vision along with the prompt and system message. | |
| Cognitive Services Landing Zone in-a-box | Minimal enterprise-ready networking and AI Services setup to support most Cognitive Services scenarios in a secure environment | |
| Semantic Kernel Bot in-a-box | Extendable solution accelerator for advanced Azure OpenAI Bots | |
| NLP to SQL in-a-box | Unleash the power of a cutting-edge speech-enabled SQL query system with Azure Open AI, Semantic Kernel, and Azure Speech Services. Simply speak your data requests in natural language, and let the magic happen. | |
| Assistants API in-a-box | Harnessing the simplicity of the Assistants API, developers can seamlessly integrate assistants with diverse functionalities, from executing code to retrieving data, empowering users with versatile and dynamic digital assistants tailored to their needs. | |
| Assistants API Bot in-a-box | This sample provides a step-by-step guide on how to deploy a virtual assistant leveraging the Azure OpenAI Assistants API. It covers the infrastructure deployment, configuration on the AI Studio and Azure Portal, and end-to-end testing examples. |
Key Contacts & Contributors
If you have any questions or would like to contribute please reach out to: [email protected]
| Contact | GitHub ID | |
|---|---|---|
| Alex Morales | @msalemor | [email protected] |
| Andre Dewes | @andredewes | [email protected] |
| Andrés Padilla | @AndresPad | [email protected] |
| Chris Ayers | @codebytes | [email protected] |
| Eduardo Noriega | @EduardoN | [email protected] |
| Jean Hayes | @jehayesms | [email protected] |
| Marco Aurélio Bigélli Cardoso | @MarcoABCardoso | [email protected] |
| Maria Vrabie | @MariaVrabie | [email protected] |
| Neeraj Jhaveri | @neerajjhaveri | [email protected] |
| Thiago Rotta | @rottathiago | [email protected] |
| Victor Santana | @Welasco | [email protected] |
| Sabyasachi Samaddar | @ssamadda | [email protected] |