• Stars
    star
    366
  • Rank 116,547 (Top 3 %)
  • Language
  • Created almost 6 years ago
  • Updated over 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

The most important NLP highlights of 2018 (PDF Report)

NLP 2019 Highlights

2019 was an impressive year for the field of natural language processing (NLP). In this report, I want to highlight some of the most important stories related to machine learning and NLP that I came across in 2019. I will mostly focus on NLP but I will also highlight a few interesting stories related to AI in general. The headlines are in no particular order. Stories may include publications, engineering efforts, yearly reports, the release of educational resources, etc.

PDF of "NLP 2019 Highlights"


NLP 2018 Highlights

It has been a big year for the field of natural language processing (NLP) and for machine learning as a whole. There have been many trends and breaking stories, with state-of-the-art results and new interesting research directions emerging. We owe all of this progress to the brilliant researchers around the world and the millions of developers devoting their full time to improve tools that make it easier for everyone to learn and progress the field. We have witnessed a rise in transfer learning and other niche areas of research such as AI Ethics.

In this report, I have provided a summary of all the biggest NLP stories of the year (2018) coming from both academia and the industry. I hope this report serves as a guide for the researcher and developer that wishes to start learning about this field and also for the expert who wishes to brush up on some of the latest advancements. The selected topics are based purely on personal observation, so it is highly possible that I missed other important stories. In fact, the stories shared here are an extended compilation of the NLP Newsletter published weekly on the dair.ai publication. I have made an effort to categorize the stories in the best possible way so that the report could benefit as many readers as possible. Please note that the report is meant to be non-technical for the purpose of reaching as many diverse readers as possible. The stories are mainly categorized by the following key topics: AI ethics, research publications, trends, education, resources, industry, and much more.

PDF of "NLP 2018 Highlights"


If you are interested in extending this report for the upcoming year (2020), get in touch with me through Twitter (@omarsar0) or at [email protected].

If you use this report as reference, please cite:

@misc{saravia2019nlp,
  title={NLP Year in Review — 2019},
  author={Saravia, Elvis},
  journal={https://dair.ai/NLP\_Year\_in\_Review-2019/},
  year={2019}
}

More Repositories

1

nlp_overview

Overview of Modern Deep Learning Techniques Applied to Natural Language Processing
CSS
1,320
star
2

pytorch_notebooks

A collection of PyTorch notebooks for learning and practicing deep learning
Jupyter Notebook
125
star
3

mri-analysis-pytorch

MRI analysis using PyTorch and MedicalTorch
Jupyter Notebook
64
star
4

nlp_newsletter

Natural language processing (NLP) newsletter right on GitHub
59
star
5

pytorch_neural_machine_translation_attention

Neural Machine Translation with Attention (PyTorch)
Jupyter Notebook
44
star
6

deep_learning_notations

Contains useful deep learning notations for writing blogs, presentations, and papers.
Jupyter Notebook
44
star
7

os

📖 Operating Systems - A Friendly Handbook 📖 (Open Notes)
39
star
8

clinical_nlp_elastic

Clinical NLP Analysis with Elasticsearch and Kibana
Jupyter Notebook
34
star
9

nlp_pycon

Material for PyCon 2019 NLP Tutorial
33
star
10

nlp_pytorch_tensorflow_notebooks

Deep Learning for NLP Python Notebooks in PyTorch and TensorFlow
Jupyter Notebook
24
star
11

machine_learning_fundamentals

📗 Machine Learning - A Friendly Handbook 📗 (Open Notes)
17
star
12

emotion_analysis_elastic_pytorch

Deep Emotion Analysis with Elastic and PyTorch
Jupyter Notebook
16
star
13

data_mining_2017_fall_lab

Contains information and instructions for the first Data Mining lab session for 2017 Fall.
Jupyter Notebook
14
star
14

nlp_with_tensorflow

NLP tutorials I have written using TensorFlow
Jupyter Notebook
12
star
15

nlp_research

🔥 Summary of interesting NLP Papers and Research (Fast and easy reads!) 🔥
9
star
16

omarsar

9
star
17

appworks_meetup_2018

Contains all the material used for the "Applied Deep Learning for NLP Using PyTorch" meetup at AppWorks
Jupyter Notebook
8
star
18

odsc_nlp

NLP Tutorial Outline
7
star
19

rnn_introduction_fundamentals

Introduction to the Fundamentals of RNN
Jupyter Notebook
7
star
20

helsinki_ml

Machine Learning in the Elastic Stack
7
star
21

pytorch_intro_neural_network

Building a neural network from scratch using PyTorch
Jupyter Notebook
6
star
22

virtual_ml_meetup_elastic

Material for Elastic Virtual ML meetup on Machine Learning in the Elastic Stack
5
star
23

text_mining_lab_2017

Requirements for Text Mining Summer Course (Lab Session)
Jupyter Notebook
5
star
24

meda

😄 😟 😂 An emotion classification web service 😄 😟 😂
HTML
5
star
25

data_mining_hw_1

Contains information for the first assignment of Data Mining 2017 Fall, NTHU.
Python
5
star
26

friendly_machine_learning

Mini blog for notes and guides on Machine Learning (Open Notes)
HTML
5
star
27

data_science_bookmarks

A list of wonderful blogs, articles, papers, ... related to data science
4
star
28

emotion_recognition_tensorflow

Deep Learning Based Emotion Recognition With TensorFlow
Jupyter Notebook
4
star
29

fundamentals-of-rnn-series

Repository for the Fundamentals of RNN mini course delivered on YouTube
Jupyter Notebook
4
star
30

midas_api

MIDAS API
Jupyter Notebook
4
star
31

sentiment_with_attention

Sentiment Classification with GRU and Attention Layers
Jupyter Notebook
4
star
32

pytorch_intro_rnn

Building RNNs using PyTorch and Google Colab
Jupyter Notebook
4
star
33

data_mining_lab

Material for Data Mining Lab Session (Fall Semester @ NTHU)
Jupyter Notebook
4
star
34

friendly_data_science

Material and resources for the "Friendly Data Science" YouTube series.
Jupyter Notebook
4
star
35

data_mining_lab_fall_2

Data Mining Lab Session 2 (Fall 2017)
Jupyter Notebook
3
star
36

friendly_nlp

Mini blog for notes and guides on Natural Language Processing (Open Notes)
HTML
3
star
37

nlp-recipes

Recipes for NLP topics
3
star
38

checkdigit

🔒 Check digit algorithm - Service Security 🔒
Ruby
3
star
39

e-learning

Summarized notes on e-learning (open notes)
3
star
40

twitter_crawler_by_keywords

This crawler is designed to crawl tweets from the Twitter APIs using keywords.
Python
3
star
41

DeepViz

📊 A Visualization Tool for Mental Disorder Detection and Analysis on Social Media 📊
HTML
3
star
42

omarsar.github.io

My Blog - Research and Life Experience. 💬
HTML
3
star
43

friendly_deep_learning

Mini blog for notes and guides on Deep Learning
HTML
3
star
44

EmoViz

📊 A visualization tool for interest analysis via emotion detection. 📊
JavaScript
3
star
45

elastic_docker

Shows how to setup a containerised cluster using Docker
2
star
46

emotion_recognition_pytorch

Deep Learning Based Emotion Recognition With PyTorch
Jupyter Notebook
2
star
47

math_comp_project

💎 Matlab implementation and visualization of PCA, LDA, and K-means 💎
Jupyter Notebook
2
star
48

dm_2018_hw_1

Holds instructions for assignment 1 of the Data Mining course
Jupyter Notebook
2
star
49

Datezilla

A social dating app using popular GraphDb (neo4j) and Ruby on Rails
Shell
2
star
50

ruby_starter

🔷 🔷 A sinatra + ruby web app for beginners; a ruby + sinatra boilerplate 🔷 🔷
Ruby
2
star
51

energy_stats

Analyzing energy production with Kibana Lens
Jupyter Notebook
2
star
52

amazon_reviews_sentiment

Sentiment Analysis on Amazon Food Reviews Dataset
Jupyter Notebook
1
star
53

twittercrawler

Basic Twitter Crawler + Emotion Classifier
Python
1
star
54

quizzy

A self-study app
Ruby
1
star
55

Knapsack-Cipher

Knapsack Cipher - PK and SK cryptograpy
1
star
56

visualization-d3-vr

Visualization fun project rendered with d3, three.js and VR capabilities
HTML
1
star
57

service_security_notes

Takeaways for Service Security course. ✅
1
star
58

firebase_react_app

An app to play around with Firebase, Node and ReactJS
JavaScript
1
star
59

how_to_nlp

Guides and resources for NLP-related topics and research
1
star
60

sentiment-classifier

A sentiment analysis research / project
Python
1
star
61

rails_starter

🚧 A rails app (Heroku-ready) for beginners; rails 5.0 boilerplate 🚧
Ruby
1
star
62

nlp_functions

Some of the most used Natural Language Processing (NLP) functions for information retrieval
Python
1
star
63

deeplearning

A python3 version of image classification deep learning algorithm
Python
1
star
64

datascience_cheatlist

A cheatlist of functions for Data Scientist
Python
1
star
65

google_colab_wordcloud

Building Your First Wordcloud with Google Colaboratory and Python
Jupyter Notebook
1
star
66

tensorflow-deeplearning-udacity

Assignments for Tensorflow Deep Learning on Udacity
Jupyter Notebook
1
star
67

santander-customer-satisfaction

Kaggle competition
Jupyter Notebook
1
star
68

askelvis

Have questions to ask me directly? Try out my AMA!
1
star
69

react-node-app

Just playing with nodejs and react
JavaScript
1
star