dennybritz/deeplearning-papernotes dennybritz/deeplearning-papernotes

  • Stars
    star
    4,385
  • Rank 9,668 (Top 0.2 %)
  • Language
  • Created over 8 years ago
  • Updated over 6 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
dennybritz/deeplearning-papernotes
github

dennybritz

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Summaries and notes on Deep Learning research papers

2018-02

  • The Matrix Calculus You Need For Deep Learning [arXiv]
  • Regularized Evolution for Image Classifier Architecture Search [arXiv]
  • Online Learning: A Comprehensive Survey [arXiv]
  • Visual Interpretability for Deep Learning: a Survey [arXiv]
  • Behavior is Everything – Towards Representing Concepts with Sensorimotor Contingencies [paper] [article] [code]
  • IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures [arXiv] [article] [code]
  • DeepType: Multilingual Entity Linking by Neural Type System Evolution [arXiv] [article] [code]
  • DensePose: Dense Human Pose Estimation In The Wild [arXiv] [article]

2018-01

  • Nested LSTMs [arXiv]
  • Generating Wikipedia by Summarizing Long Sequences [arXiv]
  • Scalable and accurate deep learning for electronic health records [arXiv]
  • Kernel Feature Selection via Conditional Covariance Minimization [NIPS paper] [article] [code]
  • Psychlab: A Psychology Laboratory for Deep Reinforcement Learning Agents [arXiv] [article] [code]
  • Fine-tuned Language Models for Text Classification [arXiv] [code] (soon)
  • Deep Learning: An Introduction for Applied Mathematicians [arXiv]
  • Innateness, AlphaZero, and Artificial Intelligence [arXiv]
  • Can Computers Create Art? [arXiv]
  • eCommerceGAN : A Generative Adversarial Network for E-commerce [arXiv]
  • Expected Policy Gradients for Reinforcement Learning [arXiv]
  • DroNet: Learning to Fly by Driving [UZH docs] [article] [code]
  • Symmetric Decomposition of Asymmetric Games [Scientific Reports] [article]
  • Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor [arXiv] [code]
  • SBNet: Sparse Blocks Network for Fast Inference [arXiv] [article] [code]
  • DeepMind Control Suite [arXiv] [code]
  • Deep Learning: A Critical Appraisal [arXiv]

2017-12

  • Adversarial Patch [arXiv]
  • CNN Is All You Need [arXiv]
  • Learning Robot Objectives from Physical Human Interaction [paper] [article]
  • The NarrativeQA Reading Comprehension Challenge [arXiv] [dataset]
  • Objects that Sound [arXiv]
  • Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions [arXiv] [article] [article2]
  • Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning [arXiv] [article] [code]
  • Improving Exploration in Evolution Strategies for Deep Reinforcement Learning via a Population of Novelty-Seeking Agents [arXiv] [article] [code]
  • Superhuman AI for heads-up no-limit poker: Libratus beats top professionals [Science]
  • Mathematics of Deep Learning [arXiv]
  • State-of-the-art Speech Recognition With Sequence-to-Sequence Models [arXiv] [article]
  • Peephole: Predicting Network Performance Before Training [arXiv]
  • Deliberation Network: Pushing the frontiers of neural machine translation [Research at Microsoft] [article]
  • GPU Kernels for Block-Sparse Weights [Research at OpenAI] [article] [code]
  • Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm [arXiv]
  • Deep Learning Scaling is Predictable, Empirically [arXiv] [article]

2017-11

  • High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs [arXiv] [article] [code]
  • StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation [arXiv] [code]
  • Population Based Training of Neural Networks [arXiv] [article]
  • Distilling a Neural Network Into a Soft Decision Tree [arXiv]
  • Neural Text Generation: A Practical Guide [arXiv]
  • Parallel WaveNet: Fast High-Fidelity Speech Synthesis [DeepMind documents] [article]
  • CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning [arXiv] [article]
  • Non-local Neural Networks [arXiv]
  • Deep Image Prior [paper] [article] [code]
  • Online Deep Learning: Learning Deep Neural Networks on the Fly [arXiv]
  • Learning Explanatory Rules from Noisy Data [arXiv]
  • Improving Palliative Care with Deep Learning [arXiv] [article]
  • VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection [arXiv]
  • Weighted Transformer Network for Machine Translation [arXiv] [article]
  • Non-Autoregressive Neural Machine Translation [arXiv] [article]
  • Block-Sparse Recurrent Neural Networks [arXiv]
  • A Unified Game-Theoretic Approach to Multiagent Reinforcement Learning [arXiv]
  • Neural Discrete Representation Learning [arXiv] [article]
  • Don't Decay the Learning Rate, Increase the Batch Size [arXiv]
  • Hierarchical Representations for Efficient Architecture Search [arXiv]

2017-10

  • Unsupervised Machine Translation Using Monolingual Corpora Only [arXiv]
  • Dynamic Routing Between Capsules [arXiv]
  • A generative vision model that trains with high data efficiency and breaks text-based CAPTCHAs [Science] [article] [code]
  • Understanding Grounded Language Learning Agents [arXiv]
  • Planning, Fast and Slow: A Framework for Adaptive Real-Time Safe Trajectory Planning [arXiv] [article] [code] (soon)
  • Malware Detection by Eating a Whole EXE [arXiv] [article]
  • Progressive Growing of GANs for Improved Quality, Stability, and Variation [Research at Nvidia] [article] [code]
  • Meta Learning Shared Hierarchies [arXiv] [article] [code]
  • Deep Voice 3: 2000-Speaker Neural Text-to-Speech [arXiv] [article]
  • AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actions [arXiv] [article] [dataset]
  • Mastering the game of Go without Human Knowledge [Nature] [article]
  • Sim-to-Real Transfer of Robotic Control with Dynamics Randomization [arXiv] [article]
  • Asymmetric Actor Critic for Image-Based Robot Learning [arXiv] [article]
  • A systematic study of the class imbalance problem in convolutional neural networks [arXiv]
  • Generalization in Deep Learning [arXiv]
  • Swish: a Self-Gated Activation Function [arXiv]
  • Emergent Translation in Multi-Agent Communication [arXiv]
  • SLING: A framework for frame semantic parsing [arXiv] [article] [code]
  • Meta-Learning for Wrestling [arXiv] [article] [code]
  • Mixed Precision Training [arXiv] [article] [article2] [code/docs]
  • Generative Adversarial Networks: An Overview [arXiv]
  • Emergent Complexity via Multi-Agent Competition [arXiv] [article] [code]
  • Deep Lattice Networks and Partial Monotonic Functions [Research at Google] [article] [code]
  • The IIT Bombay English-Hindi Parallel Corpus [arXiv] [article]
  • Rainbow: Combining Improvements in Deep Reinforcement Learning [arXiv]
  • Lifelong Learning With Dynamically Expandable Networks [arXiv]
  • Variational Inference & Deep Learning: A New Synthesis (Thesis) [dropbox]
  • Neural Task Programming: Learning to Generalize Across Hierarchical Tasks [arXiv]
  • Neural Color Transfer between Images [arXiv]
  • The hippocampus as a predictive map [biorXiv] [article]
  • Scalable and accurate deep learning for electronic health records [arXiv]

2017-09

  • Variational Memory Addressing in Generative Models [arXiv]
  • Overcoming Exploration in Reinforcement Learning with Demonstrations [arXiv]
  • A Hybrid DSP/Deep Learning Approach to Real-Time Full-Band Speech Enhancement [arXiv] [article] [code]
  • ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases [CVF] [article] [dataset]
  • NIMA: Neural Image Assessment [arXiv] [article]
  • Generating Sentences by Editing Prototypes [arXiv] [code]
  • The Consciousness Prior [arXiv]
  • StarSpace: Embed All The Things! [arXiv] [code]
  • Neural Optimizer Search with Reinforcement Learning [arXiv]
  • Dynamic Evaluation of Neural Sequence Models [arXiv]
  • Neural Machine Translation [arXiv]
  • Matterport3D: Learning from RGB-D Data in Indoor Environments [arXiv] [article] [article2] [code]
  • Deep Reinforcement Learning that Matters [arXiv] [code]
  • The Uncertainty Bellman Equation and Exploration [arXiv]
  • WESPE: Weakly Supervised Photo Enhancer for Digital Cameras [arXiv] [article]
  • Globally Normalized Reader [arXiv] [article] [code]
  • A Brief Introduction to Machine Learning for Engineers [arXiv]
  • Learning with Opponent-Learning Awareness [arXiv] [article]
  • A Deep Reinforcement Learning Chatbot [arXiv]
  • Squeeze-and-Excitation Networks [arXiv]
  • Efficient Methods and Hardware for Deep Learning (Thesis) [Stanford Digital Repository]

2017-08

  • Design and Analysis of the NIPS 2016 Review Process [arXiv]
  • Fast Automated Analysis of Strong Gravitational Lenses with Convolutional Neural Networks [arXiv] [article]
  • TensorFlow Agents: Efficient Batched Reinforcement Learning in TensorFlow [white paper] [code]
  • Automated Crowdturfing Attacks and Defenses in Online Review Systems [arXiv]
  • Neural Network Dynamics for Model-Based Deep Reinforcement Learning with Model-Free Fine-Tuning [arXiv] [article] [code]
  • Deep Learning for Video Game Playing [arXiv]
  • Deep & Cross Network for Ad Click Predictions [arXiv]
  • Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms [arXiv] [code]
  • Multi-task Self-Supervised Visual Learning [arXiv]
  • Learning a Multi-View Stereo Machine [arXiv] [article] [code] (soon)
  • Twin Networks: Using the Future as a Regularizer [arXiv]
  • A Brief Survey of Deep Reinforcement Learning [arXiv]
  • Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation [arXiv] [code]
  • On the Effectiveness of Visible Watermarks [CVPR] [article]
  • Practical Network Blocks Design with Q-Learning [arXiv]
  • On Ensuring that Intelligent Machines Are Well-Behaved [arXiv]
  • Reproducibility of Benchmarked Deep Reinforcement Learning Tasks for Continuous Control [arXiv] [code]
  • Training Deep AutoEncoders for Collaborative Filtering [arXiv] [code]
  • Learning to Perform a Perched Landing on the GroundUsing Deep Reinforcement Learning [nature]
  • Revisiting the Effectiveness of Off-the-shelf Temporal Modeling Approaches for Large-scale Video Classification [arXiv] [article]
  • Intrinsically Motivated Goal Exploration Processes with Automatic Curriculum Learning [arXiv]
  • Neural Expectation Maximization [arXiv] [code]
  • Google Vizier: A Service for Black-Box Optimization [Research at Google]
  • STARDATA: A StarCraft AI Research Dataset [arXiv] [code]
  • Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm [arXiv] [code] [article]
  • Natural Language Processing with Small Feed-Forward Networks [arXiv]

2017-07

  • Photographic Image Synthesis with Cascaded Refinement Networks [arXiv] [code]
  • StarCraft II: A New Challenge for Reinforcement Learning [DeepMind Documents] [code] [article]
  • Leveraging Demonstrations for Deep Reinforcement Learning on Robotics Problems with Sparse Rewards [arXiv]
  • Reinforcement Learning with Deep Energy-Based Policies [arXiv] [article] [code]
  • DARLA: Improving Zero-Shot Transfer in Reinforcement Learning [arXiv]
  • Synthesizing Robust Adversarial Examples [arXiv] [article] [code] (Soon)
  • Voice Synthesis for in-the-Wild Speakers via a Phonological Loop [arXiv] [code] [article]
  • Eyemotion: Classifying facial expressions in VR using eye-tracking cameras [arXiv] [article]
  • A Distributional Perspective on Reinforcement Learning [arXiv] [article] [video]
  • On the State of the Art of Evaluation in Neural Language Models [arXiv]
  • Optimizing the Latent Space of Generative Networks [arXiv]
  • Neuroscience-Inspired Artificial Intelligence [Neuron] [article]
  • Learning Transferable Architectures for Scalable Image Recognition [arXiv]
  • Reverse Curriculum Generation for Reinforcement Learning [arXiv]
  • Imagination-Augmented Agents for Deep Reinforcement Learning [arXiv] [article]
  • Learning model-based planning from scratch [arXiv] [article]
  • Proximal Policy Optimization Algorithms [AWSS3] [code]
  • Automatic Recognition of Deceptive Facial Expressions of Emotion [arXiv]
  • Distral: Robust Multitask Reinforcement Learning [arXiv]
  • Creatism: A deep-learning photographer capable of creating professional work [arXiv] [article]
  • SCAN: Learning Abstract Hierarchical Compositional Visual Concepts [arXiv] [article]
  • Revisiting Unreasonable Effectiveness of Data in Deep Learning Era [arXiv] [article]
  • The Intentional Unintentional Agent: Learning to Solve Many Continuous Control Tasks Simultaneously [arXiv]
  • Deep Bilateral Learning for Real-Time Image Enhancement [arXiv] [code] [article]
  • Emergence of Locomotion Behaviours in Rich Environments [arXiv] [article]
  • Learning human behaviors from motion capture by adversarial imitation [arXiv] [article]
  • Robust Imitation of Diverse Behaviors [arXiv] [article]
  • Hindsight Experience Replay [arXiv]
  • Cardiologist-Level Arrhythmia Detection with Convolutional Neural Networks [arXiv] [article]
  • End-to-End Learning of Semantic Grasping [arXiv]
  • ELF: An Extensive, Lightweight and Flexible Research Platform for Real-time Strategy Games [arXiv] [code] [article]

2017-06

  • Noisy Networks for Exploration [arXiv]
  • Do GANs actually learn the distribution? An empirical study [arXiv]
  • Gradient Episodic Memory for Continuum Learning [arXiv]
  • Natural Language Does Not Emerge 'Naturally' in Multi-Agent Dialog [arXiv] [code]
  • Deep Interest Network for Click-Through Rate Prediction [arXiv]
  • Cognitive Psychology for Deep Neural Networks: A Shape Bias Case Study [arXiv] [article]
  • Structure Learning in Motor Control: A Deep Reinforcement Learning Model [arXiv]
  • Programmable Agents [arXiv]
  • Grounded Language Learning in a Simulated 3D World [arXiv]
  • Schema Networks: Zero-shot Transfer with a Generative Causal Model of Intuitive Physics [arXiv]
  • SVCCA: Singular Vector Canonical Correlation Analysis for Deep Learning Dynamics and Interpretability [arXiv] [article] [code]
  • One Model To Learn Them All [arXiv] [code] [article]
  • Hybrid Reward Architecture for Reinforcement Learning [arXiv]
  • Expected Policy Gradients [arXiv]
  • Variational Approaches for Auto-Encoding Generative Adversarial Networks [arXiv]
  • Deal or No Deal? End-to-End Learning for Negotiation Dialogues [S3AWS] [code] [article]
  • Attention Is All You Need [arXiv] [code] [article]
  • Sobolev Training for Neural Networks [arXiv]
  • YellowFin and the Art of Momentum Tuning [arXiv] [code] [article]
  • Forward Thinking: Building and Training Neural Networks One Layer at a Time [arXiv]
  • Depthwise Separable Convolutions for Neural Machine Translation [arXiv] [code]
  • Parameter Space Noise for Exploration [arXiv] [code] [article]
  • Deep Reinforcement Learning from human preferences [arXiv] [article]
  • Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments [arXiv] [code]
  • Self-Normalizing Neural Networks [arXiv] [code]
  • Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour [arXiv]
  • A simple neural network module for relational reasoning [arXiv] [article]
  • Visual Interaction Networks [arXiv] [article]

2017-05

  • Supervised Learning of Universal Sentence Representations from Natural Language Inference Data [arXiv] [code]
  • pix2code: Generating Code from a Graphical User Interface Screenshot [arXiv] [article] [code]
  • The Cramer Distance as a Solution to Biased Wasserstein Gradients [arXiv]
  • Reinforcement Learning with a Corrupted Reward Channel [arXiv]
  • Dilated Residual Networks [arXiv] [code]
  • Bayesian GAN [arXiv] [code]
  • Gradient Descent Can Take Exponential Time to Escape Saddle Points [arXiv] [article]
  • Thinking Fast and Slow with Deep Learning and Tree Search [arXiv]
  • ParlAI: A Dialog Research Software Platform [arXiv] [code] [article]
  • Semantically Decomposing the Latent Spaces of Generative Adversarial Networks [arXiv] [article]
  • Look, Listen and Learn [arXiv]
  • Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset [arXiv] [code]
  • Convolutional Sequence to Sequence Learning [arXiv] [code] [code2] [article]
  • The Kinetics Human Action Video Dataset [arXiv] [article]
  • Safe and Nested Subgame Solving for Imperfect-Information Games [arXiv]
  • Discrete Sequential Prediction of Continuous Actions for Deep RL [arXiv]
  • Metacontrol for Adaptive Imagination-Based Optimization [arXiv]
  • Efficient Parallel Methods for Deep Reinforcement Learning [arXiv]
  • Real-Time Adaptive Image Compression [arXiv]

2017-04

  • General Video Game AI: Learning from Screen Capture [arXiv]
  • Learning to Skim Text [arXiv]
  • Get To The Point: Summarization with Pointer-Generator Networks [arXiv] [code] [article]
  • Adversarial Neural Machine Translation [arXiv]
  • Deep Q-learning from Demonstrations [arXiv]
  • Learning from Demonstrations for Real World Reinforcement Learning [arXiv]
  • DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks [arXiv] [article] [code]
  • A Neural Representation of Sketch Drawings [arXiv] [code] [article]
  • Automated Curriculum Learning for Neural Networks [arXiv]
  • Hierarchical Surface Prediction for 3D Object Reconstruction [arXiv] [article]
  • Neural Message Passing for Quantum Chemistry [arXiv]
  • Learning to Generate Reviews and Discovering Sentiment [arXiv] [code]
  • Best Practices for Applying Deep Learning to Novel Applications [arXiv]

2017-03

  • Improved Training of Wasserstein GANs [arXiv]
  • Evolution Strategies as a Scalable Alternative to Reinforcement Learning [arXiv]
  • Controllable Text Generation [arXiv]
  • Neural Episodic Control [arXiv]
  • A Structured Self-attentive Sentence Embedding [arXiv]
  • Multi-step Reinforcement Learning: A Unifying Algorithm [arXiv]
  • Deep learning with convolutional neural networks for brain mapping and decoding of movement-related information from the human EEG [arXiv]
  • FaSTrack: a Modular Framework for Fast and Guaranteed Safe Motion Planning [arXiv] [article] [article2]
  • Massive Exploration of Neural Machine Translation Architectures [arXiv] [code]
  • Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regression [arXiv] [article] [code]
  • Minimax Regret Bounds for Reinforcement Learning [arXiv]
  • Sharp Minima Can Generalize For Deep Nets [arXiv]
  • Parallel Multiscale Autoregressive Density Estimation [arXiv]
  • Neural Machine Translation and Sequence-to-sequence Models: A Tutorial [arXiv]
  • Large-Scale Evolution of Image Classifiers [arXiv]
  • FeUdal Networks for Hierarchical Reinforcement Learning [arXiv]
  • Evolving Deep Neural Networks [arXiv]
  • How to Escape Saddle Points Efficiently [arXiv] [article]
  • Opening the Black Box of Deep Neural Networks via Information [arXiv] [video]
  • Understanding Synthetic Gradients and Decoupled Neural Interfaces [arXiv]
  • Learning to Optimize Neural Nets [arXiv] [article]

2017-02

  • The Shattered Gradients Problem: If resnets are the answer, then what is the question? [arXiv]
  • Neural Map: Structured Memory for Deep Reinforcement Learning [arXiv]
  • Bridging the Gap Between Value and Policy Based Reinforcement Learning [arXiv]
  • Deep Voice: Real-time Neural Text-to-Speech [arXiv]
  • Beating the World's Best at Super Smash Bros. with Deep Reinforcement Learning [arXiv]
  • The Game Imitation: Deep Supervised Convolutional Networks for Quick Video Game AI [arXiv]
  • Learning to Parse and Translate Improves Neural Machine Translation [arXiv]
  • All-but-the-Top: Simple and Effective Postprocessing for Word Representations [arXiv]
  • Deep Learning with Dynamic Computation Graphs [arXiv]
  • Skip Connections as Effective Symmetry-Breaking [arXiv]
  • odelSemi-Supervised QA with Generative Domain-Adaptive Nets [arXiv]

2017-01

  • Wasserstein GAN [arXiv]
  • Deep Reinforcement Learning: An Overview [arXiv]
  • DyNet: The Dynamic Neural Network Toolkit [arXiv]
  • DeepStack: Expert-Level Artificial Intelligence in No-Limit Poker [arXiv]
  • NIPS 2016 Tutorial: Generative Adversarial Networks [arXiv]

2016-12

  • A recurrent neural network without Chaos [arXiv]
  • Language Modeling with Gated Convolutional Networks [arXiv]
  • EnhanceNet: Single Image Super-Resolution Through Automated Texture Synthesis [arXiv] [article]
  • Learning from Simulated and Unsupervised Images through Adversarial Training [arXiv]
  • How Grammatical is Character-level Neural Machine Translation? Assessing MT Quality with Contrastive Translation Pairs [arXiv]
  • Improving Neural Language Models with a Continuous Cache [arXiv]
  • DeepMind Lab [arXiv] [code]
  • Deep Learning of Robotic Tasks without a Simulator using Strong and Weak Human Supervision [arXiv]
  • Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning [arXiv]
  • Overcoming catastrophic forgetting in neural networks [arXiv]

2016-11 (ICLR Edition)

Reinforcement Learning:

-Learning to reinforcement learn [arXiv]

Machine Translation & Dialog

2016-10

2016-09

  • Towards Deep Symbolic Reinforcement Learning [arXiv]
  • HyperNetworks [arXiv]
  • Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation [arXiv]
  • Safe and Efficient Off-Policy Reinforcement Learning [arXiv]
  • Playing FPS Games with Deep Reinforcement Learning [arXiv]
  • SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient [arXiv]
  • Episodic Exploration for Deep Deterministic Policies: An Application to StarCraft Micromanagement Tasks [arXiv]
  • Energy-based Generative Adversarial Network [arXiv]
  • Stealing Machine Learning Models via Prediction APIs [arXiv]
  • Semi-Supervised Classification with Graph Convolutional Networks [arXiv]
  • WaveNet: A Generative Model For Raw Audio [arXiv]
  • Hierarchical Multiscale Recurrent Neural Networks [arXiv]
  • End-to-End Reinforcement Learning of Dialogue Agents for Information Access [arXiv]
  • Deep Neural Networks for YouTube Recommendations [paper]

2016-08

  • Semantics derived automatically from language corpora contain human-like biases [arXiv]
  • Why does deep and cheap learning work so well? [arXiv]
  • Machine Comprehension Using Match-LSTM and Answer Pointer [arXiv]
  • Stacked Approximated Regression Machine: A Simple Deep Learning Approach [arXiv]
  • Decoupled Neural Interfaces using Synthetic Gradients [arXiv]
  • WikiReading: A Novel Large-scale Language Understanding Task over Wikipedia [arXiv]
  • Temporal Attention Model for Neural Machine Translation [arXiv]
  • Residual Networks of Residual Networks: Multilevel Residual Networks [arXiv]
  • Learning Online Alignments with Continuous Rewards Policy Gradient [arXiv]

2016-07

2016-06

2016-05

  • Hierarchical Memory Networks [arXiv]
  • Deep API Learning [arXiv]
  • Wide Residual Networks [arXiv]
  • TensorFlow: A system for large-scale machine learning [arXiv]
  • Learning Natural Language Inference using Bidirectional LSTM model and Inner-Attention [arXiv]
  • Aspect Level Sentiment Classification with Deep Memory Network [arXiv]
  • FractalNet: Ultra-Deep Neural Networks without Residuals [arXiv]
  • Learning End-to-End Goal-Oriented Dialog [arXiv]
  • One-shot Learning with Memory-Augmented Neural Networks [arXiv]
  • Deep Learning without Poor Local Minima [arXiv]
  • AVEC 2016 - Depression, Mood, and Emotion Recognition Workshop and Challenge [arXiv]
  • Data Programming: Creating Large Training Sets, Quickly [arXiv]
  • Deeply-Fused Nets [arXiv]
  • Deep Portfolio Theory [arXiv]
  • Unsupervised Learning for Physical Interaction through Video Prediction [arXiv]
  • Movie Description [arXiv]

2016-04

2016-03

2016-02

2016-01

2015-12

NLP

Vision

2015-11

NLP

Programs

  • Neural Random-Access Machines [arxiv]
  • Neural Programmer: Inducing Latent Programs with Gradient Descent [arXiv]
  • Neural Programmer-Interpreters [arXiv]
  • Learning Simple Algorithms from Examples [arXiv]
  • Neural GPUs Learn Algorithms [arXiv] [code]
  • On Learning to Think: Algorithmic Information Theory for Novel Combinations of Reinforcement Learning Controllers and Recurrent Neural World Models [arXiv]

Vision

  • ReSeg: A Recurrent Neural Network for Object Segmentation [arXiv]
  • Deconstructing the Ladder Network Architecture [arXiv]
  • Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks [arXiv]
  • Multi-Scale Context Aggregation by Dilated Convolutions [arXiv] [code]

General

2015-10

2015-09

2015-08

2015-07

2015-06

2015-05

2015-04

  • Correlational Neural Networks [arXiv]

2015-03

2015-02

2015-01

  • Hidden Technical Debt in Machine Learning Systems [NIPS]

2014-12

2014-11

  • The Loss Surfaces of Multilayer Networks [arXiv]

2014-10

2014-09

2014-08

  • Convolutional Neural Networks for Sentence Classification [arxiv]

2014-07

2014-06

2014-05

2014-04

  • A Convolutional Neural Network for Modelling Sentences [arXiv]

2014-03

2014-02

2014-01

2013

  • Visualizing and Understanding Convolutional Networks [arXiv]
  • DeViSE: A Deep Visual-Semantic Embedding Model [pub]
  • Maxout Networks [arXiv]
  • Exploiting Similarities among Languages for Machine Translation [arXiv]
  • Efficient Estimation of Word Representations in Vector Space [arXiv]

2011

  • Natural Language Processing (almost) from Scratch [arXiv]

More Repositories

1

reinforcement-learning

Implementation of Reinforcement Learning Algorithms. Python, OpenAI Gym, Tensorflow. Exercises and Solutions to accompany Sutton's Book and David Silver's course.
Jupyter Notebook
20,284
star
2

cnn-text-classification-tf

Convolutional Neural Network for Text Classification in Tensorflow
Python
5,635
star
3

nn-from-scratch

Implementing a Neural Network from Scratch
Jupyter Notebook
1,811
star
4

chatbot-retrieval

Dual LSTM Encoder for Dialog Response Generation
Jupyter Notebook
1,579
star
5

neal-react

Startup Landing Page Components for React.js
JavaScript
1,378
star
6

rnn-tutorial-rnnlm

Recurrent Neural Network Tutorial, Part 2 - Implementing a RNN in Python and Theano
Jupyter Notebook
891
star
7

rails_startup_template

A startup template for Ruby on Rails 4 applications
Ruby
668
star
8

rnn-tutorial-gru-lstm

Language Model GRU with Python and Theano
Python
492
star
9

tf-rnn

Practical Examples for RNNs in Tensorflow
Jupyter Notebook
484
star
10

startupreadings

Reading list for all things startup-related
423
star
11

papergraph

AI/ML citation graph with postgres + graphql
Jupyter Notebook
188
star
12

booknotes

Notes I'm taking when reading books
137
star
13

neal-sample

Sample page for neal-react
JavaScript
69
star
14

nn-theano

Speed up your Neural Network with Theano and the GPU
Python
61
star
15

bella

Labeling and Evaluation Tool for NLP Tasks
JavaScript
55
star
16

papergraph-ui

Browse the CS/AI/ML research paper graph
Svelte
52
star
17

sentiment-analysis

Japanese Sentiment Analysis
Jupyter Notebook
42
star
18

deepdive

Scala
36
star
19

akka-cluster-deploy

Akka cluster + Docker + CoreOS
Scala
26
star
20

url-metadata-extractor

API that extracts metadata from a URL.
HTML
26
star
21

linkedin-extractor

Given a Linkedin profie URL returns structured metadata.
HTML
25
star
22

representation-learning

Unsupervised Deep Learning and Representation Learning Tutorial
Jupyter Notebook
12
star
23

pandoc-graphql

Turn your local documents into a GraphQL API using pandoc
Rust
12
star
24

ablog-content

Jupyter Notebook
9
star
25

probability-monads

Haskell
9
star
26

s3-cors-upload-rails

Ruby
8
star
27

visual-pagedump

An API to create visual-semantic mappings between web pages and DOM nodes
JavaScript
6
star
28

boilerpipe-api

Extract main article text from HTML pages
Scala
5
star
29

elk-playground

Playground for Elasticsearch, Logstash and Kibana using Docker
Shell
5
star
30

scpd-downloader

Stanford SCPD Lecture Downloader
Ruby
4
star
31

twitter-collect

Monitors Twitter for interesting articles
JavaScript
3
star
32

crawler-scala

Scala
2
star
33

hndump

Watches HackerNews and dumps raw events for later analysis.
JavaScript
1
star
34

sampler

Gibbs sampler for factor graphs
Scala
1
star
35

rust-analyzer-issue3667

Rust
1
star
36

phonenumber-api

Extracts phone numbers from raw text
Scala
1
star
37

rnn-bptt

Latex files for RNN BPTT post
TeX
1
star
38

twitter-smileys

Crawling twitter for smiley distant supervision
TeX
1
star
39

actioncrawler

Crawling wrapper for webdriver
JavaScript
1
star
40

lang_classifier

Python language classifier
Python
1
star