microsoft/DeepSpeedExamples

Stars
5,092
Rank 8,164 (Top 0.2 %)
Language
Python
License
Apache License 2.0
Created almost 5 years ago
Updated about 1 year ago

microsoft/DeepSpeedExamples

microsoft

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Example models using DeepSpeed

DeepSpeed Examples

This repository contains various examples including training, inference, compression, benchmarks, and applications that use DeepSpeed.

1. Applications

This folder contains end-to-end applications that use DeepSpeed to train and use cutting-edge models.

2. Training

There are several training and finetuning examples so please see the individual folders for specific instructions.

3. Inference

The DeepSpeed Huggingface inference README explains how to get started with running DeepSpeed Huggingface inference examples.

4. Compression

Model compression examples.

5. Benchmarks

All benchmarks that use the DeepSpeed library are maintained in this folder.

Build Pipeline Status

Description	Status
Integrations

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.

When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.

vscode

Visual Studio Code

PowerToys

Windows system utilities to maximize productivity

TypeScript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

terminal

The new Windows Terminal and the original Windows console host, all in the same place!

Web-Dev-For-Beginners

24 Lessons, 12 Weeks, Get Started as a Web Developer

ML-For-Beginners

12 weeks, 26 lessons, 52 quizzes, classic Machine Learning for all

generative-ai-for-beginners

21 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

Jupyter Notebook

playwright

Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.

monaco-editor

A browser based code editor

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

AI-For-Beginners

12 Weeks, 24 Lessons, AI for All!

Jupyter Notebook

autogen

A programming framework for agentic AI 🤖

Jupyter Notebook

MS-DOS

The original sources of MS-DOS 1.25, 2.0, and 4.0 for reference purposes

Data-Science-For-Beginners

10 Weeks, 20 Lessons, Data Science for All!

Jupyter Notebook

calculator

Windows Calculator: A simple yet powerful calculator that ships with Windows

cascadia-code

This is a fun, new monospaced font that includes programming ligatures and is designed to enhance the modern look and feel of the Windows Terminal.

JARVIS

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

api-guidelines

Microsoft REST API Guidelines

winget-cli

WinGet is the Windows Package Manager. This project includes a CLI (Command Line Interface), PowerShell modules, and a COM (Component Object Model) API (Application Programming Interface).

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

vcpkg

C++ Library Manager for Windows, Linux, and MacOS

fluentui

Fluent UI web represents a collection of utilities, React components, and web components for building web applications.

semantic-kernel

Integrate cutting-edge LLM technology quickly and easily into your apps

graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system

CNTK

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit

WSL

Issues found on WSL

LightGBM

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

AirSim

Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research

react-native-windows

A framework for building native Windows apps with React.

recommenders

Best Practices on Recommendation Systems

IoT-For-Beginners

12 Weeks, 24 Lessons, IoT for All!

qlib

Qlib is an AI-oriented quantitative investment platform that aims to realize the potential, empower research, and create value using AI technologies in quantitative investment, from exploring ideas to implementing productions. Qlib supports diverse machine learning modeling paradigms. including supervised learning, market dynamics modeling, and RL.

dotnet

This repo is the official home of .NET on GitHub. It's a great starting point to find many .NET OSS projects from Microsoft and the community, including many that are part of the .NET Foundation.

Bringing-Old-Photos-Back-to-Life

Bringing Old Photo Back to Life (CVPR 2020 oral)

ai-edu

AI education materials for Chinese students, teachers and IT professionals.

pyright

Static Type Checker for Python

nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

guidance

A guidance language for controlling large language models.

Jupyter Notebook

TypeScript-Node-Starter

A reference example for TypeScript and Node with a detailed README describing how to use the two together.

Swin-Transformer

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".

TypeScript-React-Starter

A starter template for TypeScript and React with a detailed README describing how to use the two together.

frontend-bootcamp

Frontend Workshop from HTML/CSS/JS to TypeScript/React/Redux

mimalloc

mimalloc is a compact general purpose allocator with excellent performance.

windows-rs

Rust for Windows

wslg

Enabling the Windows Subsystem for Linux to include support for Wayland and X server related scenarios

language-server-protocol

Defines a common protocol for language servers.

sql-server-samples

Azure Data SQL Samples - Official Microsoft GitHub Repository containing code samples for SQL Server, Azure SQL, Azure Synapse, and Azure SQL Edge

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

fast

The adaptive interface system for modern web experiences.

computervision-recipes

Best Practices, code samples, and documentation for Computer Vision.

Jupyter Notebook

napajs

Napa.js: a multi-threaded JavaScript runtime

Windows-universal-samples

API samples for the Universal Windows Platform.

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

fluentui-emoji

A collection of familiar, friendly, and modern emoji from Microsoft

vscode-tips-and-tricks

Collection of helpful tips and tricks for VS Code.

playwright-python

Python version of the Playwright testing and automation library.

STL

MSVC's implementation of the C++ Standard Library.

react-native-code-push

React Native module for CodePush

vscode-extension-samples

Sample code illustrating the VS Code extension API.

inshellisense

IDE style command line auto complete

reverse-proxy

A toolkit for developing high-performance HTTP reverse proxy applications.

reactxp

Library for cross-platform app development.

WSL2-Linux-Kernel

The source for the Linux kernel used in Windows Subsystem for Linux 2 (WSL2)

ailab

Experience, Learn and Code the latest breakthrough innovations with Microsoft AI

c9-python-getting-started

Sample code for Channel 9 Python for Beginners course

Jupyter Notebook

UFO

A UI-Focused Agent for Windows OS Interaction.

cpprestsdk

The C++ REST SDK is a Microsoft project for cloud-based client-server communication in native code using a modern asynchronous C++ API design. This project aims to help C++ developers connect to and interact with services.

botframework-sdk

Bot Framework provides the most comprehensive experience for building conversation applications.

azuredatastudio

Azure Data Studio is a data management and development tool with connectivity to popular cloud and on-premises databases. Azure Data Studio supports Windows, macOS, and Linux, with immediate capability to connect to Azure SQL and SQL Server. Browse the extension library for more database support options including MySQL, PostreSQL, and MongoDB.

winget-pkgs

The Microsoft community Windows Package Manager manifest repository

Windows-driver-samples

This repo contains driver samples prepared for use with Microsoft Visual Studio and the Windows Driver Kit (WDK). It contains both Universal Windows Driver and desktop-only driver samples.

winfile

Original Windows File Manager (winfile) with enhancements

nlp-recipes

Natural Language Processing Best Practices & Examples

WinObjC

Objective-C for Windows

SandDance

Visually explore, understand, and present your data.

VFSForGit

Virtual File System for Git: Enable Git at Enterprise Scale

GSL

Guidelines Support Library

MixedRealityToolkit-Unity

This repository is for the legacy Mixed Reality Toolkit (MRTK) v2. For the latest version of the MRTK please visit https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity

fluentui-system-icons

Fluent System Icons are a collection of familiar, friendly and modern icons from Microsoft.

vscode-go

An extension for VS Code which provides support for the Go language. We have moved to https://github.com/golang/vscode-go

microsoft-ui-xaml

Windows UI Library: the latest Windows 10 native controls and Fluent styles for your applications

vscode-recipes

rushstack

Monorepo for tools developed by the Rush Stack community

MMdnn

MMdnn is a set of tools to help users inter-operate among different deep learning frameworks. E.g. model conversion and visualization. Convert models between Caffe, Keras, MXNet, Tensorflow, CNTK, PyTorch Onnx and CoreML.

vscode-docs

Public documentation for Visual Studio Code

ethr

Ethr is a Comprehensive Network Measurement Tool for TCP, UDP & ICMP.

FASTER

Fast persistent recoverable log and key-value store + cache, in C# and C++.

vscode-cpptools

Official repository for the Microsoft C/C++ extension for VS Code.

DirectX-Graphics-Samples

This repo contains the DirectX Graphics samples that demonstrate how to build graphics intensive applications on Windows.

promptbase

All things prompt engineering

BosqueLanguage

The Bosque programming language is an experiment in regularized design for a machine assisted rapid and reliable software development lifecycle.

TaskWeaver

A code-first agent framework for seamlessly planning and executing data analytics tasks.

Detours

Detours is a software package for monitoring and instrumenting API calls on Windows. It is distributed in source code form.

tsyringe

Lightweight dependency injection container for JavaScript/TypeScript

SynapseML

Simple and Distributed Machine Learning

Windows-classic-samples

This repo contains samples that demonstrate the API used in Windows classic desktop applications.

sudo

It's sudo, for Windows

TypeScript-Handbook

Deprecated, please use the TypeScript-Website repo instead

vscode-dev-containers

NOTE: Most of the contents of this repository have been migrated to the new devcontainers GitHub org (https://github.com/devcontainers). See https://github.com/devcontainers/template-starter and https://github.com/devcontainers/feature-starter for information on creating your own!

tsdoc

A doc comment standard for TypeScript