feifeibear/ColoBloom

Stars
5
Rank 2,861,937 (Top 57 %)
Language
Python
License
Apache License 2.0
Created about 2 years ago
Updated almost 2 years ago

feifeibear/ColoBloom

feifeibear

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

LLMSpeculativeSampling

Fast inference from large lauguage models via speculative decoding

SWCaffe

A Deep Learning Framework customized for Sunway TaihuLight

Distributed-ResNet-Tensorflow

A Distributed ResNet on multi-machines each with one GPU card.

swGEMM

A highly efficient library for GEMM operations on Sunway TaihuLight

swDNN

a highly-efficient library for deep neural networks based on Sunway TaihuLight supercomputer.

PSTensor

PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.

PyTorchMemTracer

Depict GPU memory footprint during DNN training of PyTorch

ChituAttention

Quantized Attention on GPU

intel-baidu-allreduce

DeepSpeedZeRO3Benchmark

A finetuned benchmark scripts for DeepSpeed zero3 stage

swDNNv1.0

A Deep Learning Library for Sunway TaihuLight

crack_leetcode

五天刷题，三天模拟！快速掌握leetcode解题套路！

ssh-passwd-free

Method to set passwd-free for a set of IPs

TensorrtBenchmark

Benchmark bert using TensorRT

SMO-SVM

a python implementation of libsvm

cudaMemHook

horovod-resnet

Communication-Efficient-DNN

DiTKVAnalysis

An auxiliary project analysis of the characteristics of KV in DiT Attention.

89757

DeepGlobe

DTensor

Study PyTorch DTensor

MoE-Megatron-LM

large-scale-tensorflow-benchmark

benchmark tensorflow for supercomputers

Jupyter Notebook

ProjectRun

CommTest

Test for PyTorch Async Collective Communication

ColossalAI_bert_inference

ckp_training

ADMM-NeuralNetwork

ADMM-NeuralNetwork was implemented by a potato