• Stars
    star
    170
  • Rank 223,357 (Top 5 %)
  • Language
    Python
  • License
    MIT License
  • Created over 6 years ago
  • Updated over 6 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

NLP Tensorflow Tutorials

NLP Tutorial with Deep Learning using tensorflow


1. Install requirements

$ pip install -r requirements.txt

2. 01-sentiment_analysis

๋„ค์ด๋ฒ„ ์˜ํ™” ํ‰์  ๋ฐ์ดํ„ฐ๋ฅผ ์ด์šฉํ•˜์—ฌ ์—ฌ๋Ÿฌ ๋”ฅ๋Ÿฌ๋‹ ๋ชจ๋ธ์„ ๋น„๊ตํ•ด ๋ณผ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
๋‹ค์–‘ํ•œ ์ปดํ“จํ„ฐ ์‚ฌ์–‘์œผ๋กœ ํ…Œ์ŠคํŠธ ํ•ด ๋ณผ ์ˆ˜ ์žˆ๋„๋ก ๋ฐ์ดํ„ฐ์…‹์„ ํฌ๊ธฐ์— ๋”ฐ๋ผ ์„ธ ๊ฐ€์ง€๋ฅผ ๋‘์—ˆ์Šต๋‹ˆ๋‹ค.

Contents

  1. Data Process
  2. Logistic Regression
  3. Feed Forward Neural Network
  4. RNN: with rnn tensorflow API explanation
  5. LSTM: uni-directional LSTM, bi-directional LSTM, deep-bi-directional LSTM
  6. CNN
  7. POS: with konlpy Twitter API
  8. Morphs: with konlpy Twitter API
  9. word2vec: with gensim API
  10. doc2vec: with gensim API
  11. Every model is defined at models

3. 02-nlp_application

๋”ฅ๋Ÿฌ๋‹ ๋ชจ๋ธ์„ ์ด์šฉํ•˜์—ฌ ์‚ฌ์šฉ์ž์˜ ์ž…๋ ฅ์„ ๋ฐ›์•„ [๊ฐ์„ฑ๋ถ„์„, ์‚ผํ–‰์‹œ๋งŒ๋“ค๊ธฐ, ๋Œ€ํ™”ํ•˜๊ธฐ]๋ฅผ ํ…Œ์ŠคํŠธ ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
ํ›ˆ๋ จ๋œ ๋ชจ๋ธ์ด ๊ฐ™์ด ๋“ค์–ด์žˆ์–ด train ์—†์ด ๋ฐ”๋กœ test ํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, gpu ์—†์ด train ํ•  ์‹œ, ์‹œ๊ฐ„์ด ์˜ค๋ž˜ ๊ฑธ๋ฆด ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

train

$ python train.py

implementation

$ python test.py

4. Notice

  1. 02-nlp_application/01-Sentiment ์˜ ๊ฒฝ์šฐ, models ํด๋” ์•ˆ model-31000.zip ํŒŒ์ผ์˜ ์••์ถ•์„ ํ’€์–ด์ฃผ์–ด์•ผ train ์—†์ด ๋ฐ”๋กœ test ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

ubuntu/mac: how to unzip in command line

$ zip -FF model-31000.zip --out model-31000-full.zip
$ unzip model-31000-full.zip

  1. ๋ชจ๋“  ๋ฐ์ดํ„ฐ๋Š” ํ•œ๊ตญ์–ด๋กœ ์ด๋ฃจ์–ด์ ธ ์žˆ์Šต๋‹ˆ๋‹ค.

  2. konlpy ์„ค์น˜๋Š” http://konlpy.org/en/v0.4.4/install/ ๋ฅผ ์ฐธ์กฐํ•˜์„ธ์š”.