Learn pytorch with examples.
basic
Toy example shows how to write customized Function and Module.
rnn
Implementation RNN (Vanilla, GRU, LSTM, LSTMP) from scratch. Gradient is clipped to avoid explosion, using pytorch Variable's register_hook function.
binary
BinaryNet with pytorch. Manipulate learning by 1) modifying optimizer (mlp.py) or 2) using param_groups (cnn.py).
cffi
Extend pytorch with cffi.
meprop
meprop training
focalloss
Focal Loss
senet
Squeeze and Excitation Networks
swish
Sigmoid-weighted Linear Units (i.e. Swish activation)
amsgrad
Modified (corrected) Adam optimizer.
nvrtc
CUDA extension by compiling CUDA kernels online.
dgc
Deep Gradient Compression.