mpezeshki/Gradient_Starvation mpezeshki/Gradient_Starvation

  • Stars
    star
    54
  • Rank 544,902 (Top 11 %)
  • Language
    Python
  • License
    MIT License
  • Created almost 4 years ago
  • Updated almost 4 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
mpezeshki/Gradient_Starvation
github

mpezeshki

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Gradient Starvation: A Learning Proclivity in Neural Networks

More Repositories

1

pytorch_forward_forward

Implementation of Hinton's forward-forward (FF) algorithm - an alternative to back-propagation
Python
1,364
star
2

Associative_LSTM

LSTM with associative memory cells (http://arxiv.org/abs/1602.03032)
Python
111
star
3

Recurrent-Neural-Networks

Recurrent Neural Network for modeling sequential data implemented using Python and Theano.
Python
89
star
4

CTC-Connectionist-Temporal-Classification

Theano implementation of CTC.
Python
74
star
5

RNN_Experiments

General experiments on Vanilla RNN and LSTM in Theano.
Python
16
star
6

Epoch_wise_Double_Descent

Official implementation of "Multi-scale Feature Learning Dynamics: Insights for Double Descent".
Python
12
star
7

LSTM_Dropout

Python
4
star
8

Theano_Tile_Coding

A tile coder in theano for Reinforcement Learning tasks
Python
3
star
9

CatsVSDogs

Kaggle Cats vs Dogs challenge for IFT6266
Python
2
star
10

Identity_RNN

RNN on MNIST (one pixel at a time) with Identity initialization
Python
2
star
11

ladder_network

Implementation of "Ladder Network" using Blocks and Theano.
Python
2
star
12

GAN-Nesterov-Training

1
star