hpcaitech/GPT-Demo hpcaitech/GPT-Demo

  • Stars
    star
    9
  • Rank 1,883,945 (Top 39 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created almost 2 years ago
  • Updated over 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
hpcaitech/GPT-Demo
github

hpcaitech

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

GPT Demo with hybrid distributed training

More Repositories

1

ColossalAI

Making large AI models cheaper, faster and more accessible
Python
36,489
star
2

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All
Python
14,987
star
3

EnergonAI

Large-scale model inference.
Python
631
star
4

FastFold

Optimizing AlphaFold Training and Inference on GPU Clusters
Python
490
star
5

ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI
Python
333
star
6

PaLM-colossalai

Scalable PaLM implementation of PyTorch
Python
191
star
7

SkyComputing

Sky Computing: Accelerating Geo-distributed Computing in Federated Learning
Python
88
star
8

CachedEmbedding

A memory efficient DLRM training solution using ColossalAI
Python
87
star
9

TensorNVMe

A Python library transfers PyTorch tensors between CPU and NVMe
C++
77
star
10

ColossalAI-Benchmark

Performance benchmarking with ColossalAI
Python
38
star
11

Titans

A collection of models built with ColossalAI
Python
32
star
12

ColossalAI-Documentation

Documentation for Colossal-AI
JavaScript
23
star
13

ColossalAI-Pytorch-lightning

Python
23
star
14

Oh-My-Dockerfile

A collection of dockerfiles for various tasks
Dockerfile
16
star
15

Elixir

Elixir: Train a Large Language Model on a Small GPU Cluster
Python
9
star
16

public_assets

Storing publicly available assets such as images, animations and texts
Python
6
star
17

OPT-Benchmark

Python
4
star
18

mmdetection-examples

Train mmdetection models with ColossalAI.
Python
2
star