• Stars
    star
    464
  • Rank 94,450 (Top 2 %)
  • Language
    Jupyter Notebook
  • Created about 10 years ago
  • Updated over 8 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Attempt at implementing system described in "Neural Turing Machines." by Graves, Alex, Greg Wayne, and Ivo Danihelka. (http://arxiv.org/abs/1410.5401)

Neural Turing Machines

Attempt at implementing system described in "Neural Turing Machines." by Alex Graves, Greg Wayne, and Ivo Danihelka.

This is still very much a work in progress:

  • Only the copy task has been implemented.
  • Cost does not consistently converge.
  • The structure of the controller is merely speculation on my part, the paper does not provide the details.

I've documented some of my adventures on my blog, you can check out the articles on this particular project here.

There's been some discussion going on in the Reddit thread on /r/machinelearning. You can check that out here.

Usage

python train_copy.py [output_model_file]

More Repositories

1

scattermoe

Triton-based implementation of Sparse Mixture of Experts.
Python
170
star
2

python-crf

Python implementation of linear-chain conditional random fields.
Python
101
star
3

theano_toolkit

Collection of useful, re-used routines.
Python
45
star
4

theano-ctc

CTC implementation in Theano.
Python
42
star
5

icentia-ecg

Working on Icentia ECG data.
Jupyter Notebook
35
star
6

minicraft-android

Android port of minicraft
Java
34
star
7

rnn-experiment

Experiments with Recurrent Neural Nets
Python
26
star
8

SUT

Repository for Sparse Universal Transformers
Python
17
star
9

chicken-rice-nn

Miscellaneous code for doing NLP with Theano
Python
13
star
10

neural-transducers

An attempt at implementing ideas in "Learning to Transduce with Unbounded Memory" (http://arxiv.org/abs/1506.02516)
Python
11
star
11

python-dbn

Learning about RBMs and DBNs
Python
10
star
12

theano-kaldi

Bunch of scripts for working with Kaldi.
Python
9
star
13

variational-autoencoders

Variational Autoencoders
Python
8
star
14

quora-codesprint-2013

Code used for Quora CodeSprint
Python
8
star
15

neural-qa

Attempt at using neural networks for the bAbI project (https://research.facebook.com/researchers/1543934539189348)
Python
8
star
16

stack-binary-recursive-nn

Parallelised implementation of Recursive Neural Networks for binary trees in PyTorch
Python
5
star
17

viz-speech

Tools for visualisation of neural networks for speech recognition.
Python
5
star
18

march-madness-2014

Python
5
star
19

lspi-tetris-agent

Tetris Agent coded using the LSPI reinforcement learning algorithm
Java
4
star
20

stick-breaking-vae

Infinite MIxture Models with VAEs
Python
3
star
21

rtdp

Code for the paper titled "Recursive Top-Down Production for Sentence Generation with Latent Trees"
PLSQL
3
star
22

latex

LaTeX classes, snippets...
2
star
23

mm-crawl

Markov Models for Focused Web Crawling
Python
2
star
24

schoolwork

Python
2
star
25

symboljs

Symbol.js is a library that aims to let you define mathematical expressions symbolically, and evaluating them later by substituting the parameters with values.
JavaScript
2
star
26

autojack

JavaScript
1
star
27

ift6266

IFT 6266 Deep Learning class project.
Python
1
star
28

higgs-boson

Kaggle Higgs-boson
Python
1
star
29

learn-perl

Simple crawler using perl
Perl
1
star
30

presentations

Presentation sources.
Jupyter Notebook
1
star
31

billion-word-imputation

Billion Word Imputation Kaggle Challenge.
Python
1
star
32

theano-gmm

Testing out GMM expectation maximisation
Python
1
star
33

word2vec-string-alignment

word2vec
Python
1
star