• Stars
    star
    891
  • Rank 51,222 (Top 2 %)
  • Language
    Jupyter Notebook
  • License
    Apache License 2.0
  • Created about 9 years ago
  • Updated over 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Recurrent Neural Network Tutorial, Part 2 - Implementing a RNN in Python and Theano

Please read the blog post that goes with this code!

Jupyter Notebook Setup

System Requirements:

To start the Jupyter Notebook:

# Clone the repo
git clone https://github.com/dennybritz/rnn-tutorial-rnnlm
cd rnn-tutorial-rnnlm

# Create a new virtual environment (optional, but recommended)
virtualenv venv
source venv/bin/activate

# Install requirements
pip install -r requirements.txt
# Start the notebook server
jupyter notebook

Setting up a CUDA-enabled GPU instance on EC2:

# Install build tools
sudo apt-get update
sudo apt-get install -y build-essential git python-pip libfreetype6-dev libxft-dev libncurses-dev libopenblas-dev  gfortran python-matplotlib libblas-dev liblapack-dev libatlas-base-dev python-dev python-pydot linux-headers-generic linux-image-extra-virtual
sudo pip install -U pip

# Install CUDA 7
wget http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1410/x86_64/cuda-repo-ubuntu1410_7.0-28_amd64.deb
sudo dpkg -i cuda-repo-ubuntu1410_7.0-28_amd64.deb
sudo apt-get update
sudo apt-get install -y cuda
sudo reboot

# Clone the repo and install requirements
git clone [email protected]:dennybritz/nn-theano.git
cd nn-theano
sudo pip install -r requirements.txt

# Set Environment variables
export CUDA_ROOT=/usr/local/cuda-7.0
export PATH=$PATH:$CUDA_ROOT/bin
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$CUDA_ROOT/lib64
export THEANO_FLAGS=mode=FAST_RUN,device=gpu,floatX=float32
# For profiling only
export CUDA_LAUNCH_BLOCKING=1

# Startup jupyter noteboook
jupyter notebook

To start a public notebook server that is accessible over the network you can follow the official instructions.

More Repositories

1

reinforcement-learning

Implementation of Reinforcement Learning Algorithms. Python, OpenAI Gym, Tensorflow. Exercises and Solutions to accompany Sutton's Book and David Silver's course.
Jupyter Notebook
20,284
star
2

cnn-text-classification-tf

Convolutional Neural Network for Text Classification in Tensorflow
Python
5,635
star
3

deeplearning-papernotes

Summaries and notes on Deep Learning research papers
4,385
star
4

nn-from-scratch

Implementing a Neural Network from Scratch
Jupyter Notebook
1,811
star
5

chatbot-retrieval

Dual LSTM Encoder for Dialog Response Generation
Jupyter Notebook
1,579
star
6

neal-react

Startup Landing Page Components for React.js
JavaScript
1,378
star
7

rails_startup_template

A startup template for Ruby on Rails 4 applications
Ruby
668
star
8

rnn-tutorial-gru-lstm

Language Model GRU with Python and Theano
Python
492
star
9

tf-rnn

Practical Examples for RNNs in Tensorflow
Jupyter Notebook
484
star
10

startupreadings

Reading list for all things startup-related
423
star
11

papergraph

AI/ML citation graph with postgres + graphql
Jupyter Notebook
188
star
12

booknotes

Notes I'm taking when reading books
137
star
13

neal-sample

Sample page for neal-react
JavaScript
69
star
14

nn-theano

Speed up your Neural Network with Theano and the GPU
Python
61
star
15

bella

Labeling and Evaluation Tool for NLP Tasks
JavaScript
55
star
16

papergraph-ui

Browse the CS/AI/ML research paper graph
Svelte
52
star
17

sentiment-analysis

Japanese Sentiment Analysis
Jupyter Notebook
42
star
18

deepdive

Scala
36
star
19

akka-cluster-deploy

Akka cluster + Docker + CoreOS
Scala
26
star
20

url-metadata-extractor

API that extracts metadata from a URL.
HTML
26
star
21

linkedin-extractor

Given a Linkedin profie URL returns structured metadata.
HTML
25
star
22

representation-learning

Unsupervised Deep Learning and Representation Learning Tutorial
Jupyter Notebook
12
star
23

pandoc-graphql

Turn your local documents into a GraphQL API using pandoc
Rust
12
star
24

ablog-content

Jupyter Notebook
9
star
25

probability-monads

Haskell
9
star
26

s3-cors-upload-rails

Ruby
8
star
27

visual-pagedump

An API to create visual-semantic mappings between web pages and DOM nodes
JavaScript
6
star
28

boilerpipe-api

Extract main article text from HTML pages
Scala
5
star
29

elk-playground

Playground for Elasticsearch, Logstash and Kibana using Docker
Shell
5
star
30

scpd-downloader

Stanford SCPD Lecture Downloader
Ruby
4
star
31

twitter-collect

Monitors Twitter for interesting articles
JavaScript
3
star
32

crawler-scala

Scala
2
star
33

hndump

Watches HackerNews and dumps raw events for later analysis.
JavaScript
1
star
34

sampler

Gibbs sampler for factor graphs
Scala
1
star
35

rnn-bptt

Latex files for RNN BPTT post
TeX
1
star
36

rust-analyzer-issue3667

Rust
1
star
37

phonenumber-api

Extracts phone numbers from raw text
Scala
1
star
38

twitter-smileys

Crawling twitter for smiley distant supervision
TeX
1
star
39

actioncrawler

Crawling wrapper for webdriver
JavaScript
1
star
40

lang_classifier

Python language classifier
Python
1
star