project-codeflare/zero-copy-model-loading

Stars
24
Rank 986,245 (Top 20 %)
Language
Jupyter Notebook
License
Apache License 2.0
Created about 3 years ago
Updated about 2 years ago

project-codeflare/zero-copy-model-loading

project-codeflare

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

In-depth code associated with my Medium blog post, "How to Load PyTorch Models 340 Times Faster with Ray"

codeflare

Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.

Jupyter Notebook

multi-cluster-app-dispatcher

Holistic job manager on Kubernetes

rayvens

Rayvens makes it possible for data scientists to access hundreds of data services within Ray with little effort.

codeflare-transfer-learning

codeflare-sdk

An intuitive, easy-to-use python interface for batch resource requesting, access, job submission, and observation. Simplifying the developer's life while enabling access to high-performance compute resources, either in the cloud or on-prem.

instaslice

InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing

codeflare-cli

mcad

instascale

On-demand Kubernetes/OpenShift cluster scaling and aggregated resource provisioning

codeflare-operator

Operator for installation and lifecycle management of CodeFlare distributed workload stack

data-integration

Object Storage data processing for Ray framework

appwrapper

AppWrapper controller for Kueue

ibm-vpc-ray-connector

Enables Ray to use IBM Gen2 backend

project-codeflare-landing

serverless-distributed-dl-training

mlbatch

Queuing and quota management for AI/ML batch jobs on Kubernetes