octoml/octoml-cli-tutorials

Stars
14
Rank 1,430,398 (Top 29 %)
Language
Python
License
Apache License 2.0
Created over 2 years ago
Updated over 1 year ago

octoml/octoml-cli-tutorials

octoml

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

A repository containing full end to end examples of the OctoML CLI workflow.

Apple-M1-BERT

3X speedup over Apple’s TensorFlow plugin by using Apache TVM on M1

octoml-profile

Home for OctoML PyTorch Profiler

synr

A library for syntactically rewriting Python programs, pronounced (sinner).

octoai-textgen-cookbook

Simple getting-started code examples for LLM applications powered by OctoAI

deformable-attention-kernel

TVMScript kernel for deformable attention

triton-client-rs

A client library in Rust for Nvidia Triton.

octoml-llm-qa

A code sample that shows how to use 🦜️🔗langchain, 🦙llama_index and a hosted LLM endpoint to do a standard chat or Q&A about a pdf document

relax

A fork of tvm/unity

tvm2onnx

An open-source tool created by OctoML that converts TVM-optimized models to code runnable in ONNX Runtime.

TransparentAI

An example of building your own ML cloud app using OctoML.

public-tvm-docker

Build TVM docker image for production compilation deployments

dockercon23-octoai

DockerCon 2023 OctoAI AI/ML Workshop GitHub Repo

Jupyter Notebook

qualcomm

tvm-build

A library for building TVM programmatically.

mlops

CK MLOps components

octoml-examples

A collection of test models for the OctoML AI acceleration service

octoai-apps

A collection of OctoAI-based demos.

macho-dyld

Custom dyld version inherited from original Apple dyld implementation

cm-mlops

Collective Mind repository with unified automations to automatically co-design, optimize and deploy intelligent and Pareto-efficient systems across continuously changing software and hardware stacks.

mlperf-loadgen-harness

A simple Python harness to run an ONNX model in various concurrency and replication configurations against MLCommon's LoadGen to measure throughput.

octoai-template-apps

fern-config

Configuration for generating SDKs and Documentation.

mlcommons-inference

Fork of MLCommons inference repository to test TVM integration

azsphere

TVM on Azure Sphere Platform

venv

CK virtual environment

octoai-launch-examples

Examples of how to build Generative AI applications powered by the OctoAI compute service.

Jupyter Notebook

octocloud-templates

.github