feifeibear/PyTorchMemTracer

Stars
9
Rank 1,939,727 (Top 39 %)
Language
Python
Created almost 3 years ago
Updated about 2 years ago

feifeibear/PyTorchMemTracer

feifeibear

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Depict GPU memory footprint during DNN training of PyTorch

LLMSpeculativeSampling

Fast inference from large lauguage models via speculative decoding

SWCaffe

A Deep Learning Framework customized for Sunway TaihuLight

Distributed-ResNet-Tensorflow

A Distributed ResNet on multi-machines each with one GPU card.

swGEMM

A highly efficient library for GEMM operations on Sunway TaihuLight

swDNN

a highly-efficient library for deep neural networks based on Sunway TaihuLight supercomputer.

PSTensor

PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.

ChituAttention

Quantized Attention on GPU

ColoBloom

intel-baidu-allreduce

DeepSpeedZeRO3Benchmark

A finetuned benchmark scripts for DeepSpeed zero3 stage

swDNNv1.0

A Deep Learning Library for Sunway TaihuLight

crack_leetcode

五天刷题，三天模拟！快速掌握leetcode解题套路！

ssh-passwd-free

Method to set passwd-free for a set of IPs

TensorrtBenchmark

Benchmark bert using TensorRT

SMO-SVM

a python implementation of libsvm

cudaMemHook

horovod-resnet

Communication-Efficient-DNN

DiTKVAnalysis

An auxiliary project analysis of the characteristics of KV in DiT Attention.

89757

DeepGlobe

DTensor

Study PyTorch DTensor

MoE-Megatron-LM

large-scale-tensorflow-benchmark

benchmark tensorflow for supercomputers

Jupyter Notebook

ProjectRun

CommTest

Test for PyTorch Async Collective Communication

ColossalAI_bert_inference

ckp_training

ADMM-NeuralNetwork

ADMM-NeuralNetwork was implemented by a potato