Awesome Deep learning papers and other resources

A list of recent papers regarding deep learning and deep reinforcement learning. They are sorted by time to see the recent papers first. I will renew the recent papers and add notes to these papers.

You should find the papers and software with star flag are more important or popular.

Table of Contents

• Papers
• Model Zoo
• Pretrained Model
• Courses
• Books
• Tutorials
• Software
• Applications
• Awesome Projects
• Corpus

Papers

• 2021 year
  • computer vision
  • natural language process
  • multi model
• 2020 year
  • deep learning
  • deep reinforcement learning
  • natural language process
  • computer vision
• 2019 year
  • deep learning
  • deep reinforcement learning
  • natural language process
  • computer vision
• 2018 year
  • deep learning
  • deep reinforcement learning
  • natural language process
  • computer vision
• 2017 year
  • deep learning
  • deep reinforcement learning
  • natural language process
  • computer vision
• 2016 year
  • deep learning
  • deep reinforcement learning
  • natural language process
  • computer vision
• 2015 year
• 2014 year
• 2013 year
• 2012 year
• 2011 year
• 2010 year
• before 2010 year

Model Zoo

• 2012 | AlexNet: ImageNet Classification with Deep Convolutional Neural Networks. pdf code
• 2013 | RCNN: Rich feature hierarchies for accurate object detection and semantic segmentation. arxiv code
• 2014 | CGNA: Conditional Generative Adversarial Nets. arxiv code
• 2014 | DeepFaceVariant: Deep Learning Face Representation from Predicting 10,000 Classes. pdf code
• 2014 | GAN: Generative Adversarial Networks. arxiv code
• 2014 | GoogLeNet: Going Deeper with Convolutions. pdf code

More details in Model Zoo

Pre Trained Model

• Aligning the fastText vectors of 78 languages
• Available pretrained word embeddings
• Inception-v3 of imagenet
• Caffe2 Model Repository

More details in Pretrained Model

Courses

• [Berkeley] CS294: Deep Reinforcement Learning
• [Berkeley] Stat212b：Topics Course on Deep Learning
• [CUHK] ELEG 5040: Advanced Topics in Signal Processing(Introduction to Deep Learning)
• [CMU] Deep Reinforcement Learning and Control
• [CMU] Neural networks for NLP )

More details in courses

Books

• Deep Learning by Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 中文版本
• Deep Learning Tutorial by LISA lab, University of Montreal
• Deep Learning Crash Course
• Documentation on all topics that I learn on both Artificial intelligence and machine learning.
• Interpretable Machine Learning
• Deep Learning and the Game of Go
• Deep Learning for Search
• Deep Learning with PyTorch
• Deep Reinforcement Learning in Action
• Grokking Deep Reinforcement Lerning
• Grokking Deep Learning for Computer Vision
• Probabilistic Deep Learning with Python
• Math and Architectures of Deep Learning
• Inside Deep Learning
• Engineering Deep Learning Platforms
• Deep Learning with R, Second Edition
• Regularization in Deep Learning
• Jax in Action

More details in books

Tutorials

• UFLDL Tutorial 1
• UFLDL Tutorial 2
• Deep Learning for NLP (without Magic)
• A Deep Learning Tutorial: From Perceptrons to Deep Networks
• Deep Learning from the Bottom up
• Theano Tutorial
• TensorFlow tutorials
• Deep Learning with R in Motion
• Grokking Deep Learning in Motion
• Machine Learning, Data Science and Deep Learning with Python

More details in tutorials

Software

• Keras Deep Learning library for Theano and TensorFlow. ⭐
• Kur Descriptive Deep Learning. ⭐
• Caffe Deep learning framework by the BVLC ⭐
• CNTK The Microsoft Cognitive Toolkit.
• Dlib A modern C++ toolkit containing machine learning algorithms and tools for creating complex software in C++.
• PyTorch Tensors and Dynamic neural networks in Python with strong GPU acceleration. ⭐
• Scikit-Learn Machine learning in Python. ⭐
  • Semisup-Learn Semi-supervised learning frameworks for Python
• Tensorflow An open source software library for numerical computation using data flow graph by Google ⭐

More details in software

Applications

• pytorch

  • 2D and 3D Face alignment library build using pytorch
  • Adversarial Autoencoders
  • A implementation of WaveNet with fast generation
  • A fast and differentiable QP solver for PyTorch.
  • A method to generate speech across multiple speakers
  • A model for style-specific music generation ⭐
  • A natural language processing toolkit using state-of-the-art deep learning models. ⭐
  • 使用PyTorch实现Char RNN生成古诗和周杰伦的歌词

• theano

  • CNN-yelp-challenge-2016-sentiment-classification
  • Deep learning tutorial for PyData
  • Deep Neural Network for Sentiment Analysis on Twitter
  • Implementations of many popular deep learning models in Theano+Lasagne

• tensorflow

  • A generic image detection program that uses tensorflow and a pre-trained Inception.
  • All kinds of text classificaiton models and more with deep learning ⭐
  • Applying transfer learning to a custom dataset by retraining Inception's final layer
  • An easy implement of VGG19 with tensorflow, which has a detailed explanation.
  • An experimentation system for Reinforcement Learning using OpenAI Gym, Tensorflow, and Keras. ⭐
  • An implementation of Pix2Pix in Tensorflow for use with frames from films

• Keras

  • A DCGAN to generate anime faces using custom mined dataset
  • A facial expression classification system that recognizes 6 basic emotions: happy, sad, surprise, fear, anger and neutral.
  • A neural network trained to help writing neural network code using autocomplete
  • Attention mechanism Implementation for Keras.
  • Automated deep neural network design with genetic programming ⭐
  • Attention based Neural Machine Translation for Keras
  • Keras Implementation of Ladder Network for Semi-Supervised Learning

• Mxnet

  • 使用MXNet的动态图接口Gluon实现Char RNN生成古诗和周杰伦的歌词

More details in applications

Awesome Projects

• 15 AI and Machine Learning Events
• 188 examples of artificial intelligence in action
• A curated list of automated machine learning papers, articles, tutorials, slides and projects ⭐
• A curated list of awesome Machine Learning frameworks, libraries and software.
• A curated list of awesome places to learn and/or practice algorithms.
• A curated list of awesome R packages and tools
• A curated list of awesome SLAM tutorials, projects and communities.
• A curated list of resources dedicated to bridge between coginitive science and deep learning
• A curated list of resources dedicated to Natural Language Processing (NLP)
• A curated list of resources for NLP (Natural Language Processing) for Chinese
• Another curated list of deep learning resources
• A list of artificial intelligence tools you can use today
• A list of deep learning implementations in biology
• Awesome-2vec
• Awesome Action Recognition

More details in awesome projects

Corpus

• 用于对话系统的中英文语料
• 搜狗实验室
• 情感分析︱网络公开的免费文本语料训练数据集汇总
• 中文情感分析用词语集
• 人民日报切分/标注语料库
• 哈工大信息检索研究中心(HIT CIR)语言技术平台共享资源
• 中文句结构树资料库
• 中文对白语料 chinese conversation corpus
• 中文语料小数据：Some useful Chinese corpus datasets
• 中文人名语料库。中文姓名,姓氏,名字,称呼,日本人名,翻译人名,英文人名
• 联合国平行语料库
• 保险行业语料库
• 用于训练中英文对话系统的语料库 Datasets for Training Chatbot System
• PTT 八卦版問答中文語料
• 3 Million Instacart Orders, Open Sourced
• ACM Multimedia Systems Conference Dataset Archive
• A dataset for book recommendations: ten thousand books, one million ratings
• A dataset for personalized highlight detection
• A dataset of 200k English plaintext jokes.
• A large-scale and high-qualityFMA: A Dataset For Music Analysis dataset of annotated musical notes.
• A large-scale dataset of manually annotated audio events ⭐
• Alphabetical list of free/public domain datasets with text data for use in NLP

More details in corpus

Contributors

Special thanks to everyone who contributed to this project.

• raer6
• isikdogan
• outlace
• divamgupta
• Naman-Bhalla
• ppuliu
• benedekrozemberczki
• roziunicorn
• von-latinski

License

The details in License