Ryzen™ AI Software

Introduction

AMD Ryzen™ AI Software includes the tools and runtime libraries for optimizing and deploying AI inference on your AMD Ryzen™ AI based PC. It enables developers to quickly build and run a variety of AI applications for Ryzen™ AI. It is designed with high efficiency and ease-of-use in mind, unleashing the full potential of AI acceleration on Ryzen™ AI.

This repository contains the demos, examples and tutorials, demonstrating usage and capabilities of the Ryzen™ AI Software. It is a subset of the Ryzen™ AI Software release.

Examples

• Real-time object detection with Yolov8
• Run multiple concurrent AI applications with ONNXRuntime
• Run LLM OPT-1.3B model with ONNXRuntime
• Run LLM OPT-1.3B model with PyTorch
• Run Vision-Transformer model with ONNXRuntime
• Run ONNX end-to-end examples with custom pre/post-processing nodes running on IPU

Demos

• Cloud-to-Client demo on Ryzen AI
• Multiple model concurrency demo on Ryzen AI

Tutorials

• A Getting Started Tutorial with a fine-tuned ResNet model
• End-to-end Object Detection
• Quantization for Ryzen AI

Getting Started

To run the demos and examples in this repository, please follow the instructions of README.md in each directory.

Reference

• Ryzen™ AI Developer Guide
• ONNXRuntime Vitis-AI EP
• Quantization with Microsoft Olive
• AMD AI Developer Forum