feifeibear/Communication-Efficient-DNN

Stars
3
Rank 3,948,250 (Top 79 %)
Language
Python
License
MIT License
Created over 6 years ago
Updated over 6 years ago

feifeibear/Communication-Efficient-DNN

feifeibear

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

LLMSpeculativeSampling

Fast inference from large lauguage models via speculative decoding

SWCaffe

A Deep Learning Framework customized for Sunway TaihuLight

Distributed-ResNet-Tensorflow

A Distributed ResNet on multi-machines each with one GPU card.

swGEMM

A highly efficient library for GEMM operations on Sunway TaihuLight

swDNN

a highly-efficient library for deep neural networks based on Sunway TaihuLight supercomputer.

PSTensor

PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.

PyTorchMemTracer

Depict GPU memory footprint during DNN training of PyTorch

ColoBloom

intel-baidu-allreduce

DeepSpeedZeRO3Benchmark

A finetuned benchmark scripts for DeepSpeed zero3 stage

swDNNv1.0

A Deep Learning Library for Sunway TaihuLight

crack_leetcode

五天刷题，三天模拟！快速掌握leetcode解题套路！

ssh-passwd-free

Method to set passwd-free for a set of IPs

TensorrtBenchmark

Benchmark bert using TensorRT

SMO-SVM

a python implementation of libsvm

cudaMemHook

horovod-resnet

89757

DTensor

Study PyTorch DTensor

DeepGlobe

MoE-Megatron-LM

large-scale-tensorflow-benchmark

benchmark tensorflow for supercomputers

Jupyter Notebook

ProjectRun

CommTest

Test for PyTorch Async Collective Communication

ColossalAI_bert_inference

ckp_training

ADMM-NeuralNetwork

ADMM-NeuralNetwork was implemented by a potato