hwang595/ps_pytorch hwang595/ps_pytorch

  • Stars
    star
    52
  • Rank 560,474 (Top 12 %)
  • Language
    Python
  • License
    MIT License
  • Created about 7 years ago
  • Updated over 5 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
hwang595/ps_pytorch
github

hwang595

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

implement distributed machine learning with Pytorch + OpenMPI

More Repositories

1

Cuttlefish

The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
Python
42
star
2

PyTorch-parameter-server

Implementation of Parameter Server using PyTorch communication lib
Python
42
star
3

ATOMO

Atomo: Communication-efficient Learning via Atomic Sparsification
Python
25
star
4

Draco

DRACO: Byzantine-resilient Distributed Training via Redundant Gradients
Python
24
star
5

DETOX

DETOX: A Redundancy-based Framework for Faster and More Robust Gradient Aggregation
Python
16
star
6

ErasureHead

distributed gradient descent using approximate coding to mitigate stragglers
Python
10
star
7

Pufferfish

The implementation for MLSys 2021 paper: "Pufferfish: Communication-efficient Models At No Extra Cost"
Python
5
star
8

ML-material

Useful machine learning materials
3
star
9

FoE-ICLR2024

The implementation of FoE for ICLR 2024
Python
2
star
10

distributed_tensorflow

distributed TensorFlow deep nets
Python
1
star
11

data_augmentation_playground

validation and initial experiments for data augmentation
Python
1
star
12

distributed-MXNet

distributed networks on MXNet
Python
1
star