lovit/ie_openseminar_1_from_text_to_doc2vec_tsne lovit/ie_openseminar_1_from_text_to_doc2vec_tsne

  • Stars
    star
    2
  • Language
    Jupyter Notebook
  • Created over 7 years ago
  • Updated over 7 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
lovit/ie_openseminar_1_from_text_to_doc2vec_tsne
github

lovit

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Openseminar #1 From scraping to Word2vec, Doc2Vec visualization with t-SNE

More Repositories

1

soynlp

ํ•œ๊ตญ์–ด ์ž์—ฐ์–ด์ฒ˜๋ฆฌ๋ฅผ ์œ„ํ•œ ํŒŒ์ด์ฌ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค. ๋‹จ์–ด ์ถ”์ถœ/ ํ† ํฌ๋‚˜์ด์ € / ํ’ˆ์‚ฌํŒ๋ณ„/ ์ „์ฒ˜๋ฆฌ์˜ ๊ธฐ๋Šฅ์„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.
Python
941
star
2

KR-WordRank

๋น„์ง€๋„ํ•™์Šต ๋ฐฉ๋ฒ•์œผ๋กœ ํ•œ๊ตญ์–ด ํ…์ŠคํŠธ์—์„œ ๋‹จ์–ด/ํ‚ค์›Œ๋“œ๋ฅผ ์ž๋™์œผ๋กœ ์ถ”์ถœํ•˜๋Š” ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค
Python
353
star
3

textmining-tutorial

(ํ•œ๊ตญ์–ด) ํ…์ŠคํŠธ ๋งˆ์ด๋‹์„ ์œ„ํ•œ ๊ณต๋ถ€๊ฑฐ๋ฆฌ๋“ค
Jupyter Notebook
203
star
4

soyspacing

๋„์–ด์“ฐ๊ธฐ ์˜ค๋ฅ˜ ๊ต์ • ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค. CRF ์™€ ๊ฐ™์€ ๋จธ์‹ ๋Ÿฌ๋‹ ์•Œ๊ณ ๋ฆฌ์ฆ˜์ด ์•„๋‹Œ, ์ง๊ด€์ ์ธ ์ ‘๊ทผ๋ฒ•์œผ๋กœ ๋„์–ด์“ฐ๊ธฐ๋ฅผ ๊ต์ •ํ•ฉ๋‹ˆ๋‹ค.
Python
145
star
5

customized_konlpy

Customized KoNLPy - Korean Natural Language Processing Toolkit KoNLPy wrapping code
Python
126
star
6

textrank

Implementation TextRank and related utils
Python
85
star
7

KoBERTScore

BERTScore for Korean
Python
73
star
8

fastcampus_textml_blogs

ํŒจ์ŠคํŠธ์บ ํผ์Šค, ์ž์—ฐ์–ด์ฒ˜๋ฆฌ๋ฅผ ์œ„ํ•œ ๋จธ์‹ ๋Ÿฌ๋‹, ์ˆ˜์—…๊ด€๋ จ ํฌ์ŠคํŠธ ์ž…๋‹ˆ๋‹ค.
70
star
9

huggingface_konlpy

Training Transformers of Huggingface with KoNLPy
Jupyter Notebook
68
star
10

WordPieceModel

Word Piece Model python light version with functions tokenize/save/load
Python
66
star
11

namuwikitext

Wikitext format dataset of Namuwiki (Most famous Korean wikipedia)
Python
50
star
12

soy

Python
50
star
13

naver_news_search_scraper

๊ฒ€์ƒ‰์–ด ๊ธฐ์ค€์œผ๋กœ ๋„ค์ด๋ฒ„๋‰ด์Šค์™€ ๋Œ“๊ธ€์„ ์ˆ˜์ง‘ํ•˜๋Š” ํŒŒ์ด์ฌ ์ฝ”๋“œ
Python
43
star
14

korean_lemmatizer

ํ•œ๊ตญ์–ด ์šฉ์–ธ ๋ถ„์„๊ธฐ (์›ํ˜• ๋ณต์›, ์šฉ์–ธ ํ˜•ํƒœ์†Œ ๋ถ„์„)
Python
41
star
15

python_ml4nlp

ํŒจ์ŠคํŠธ์บ ํผ์Šค ์ž์—ฐ์–ด์ฒ˜๋ฆฌ๋ฅผ ์œ„ํ•œ ๋จธ์‹ ๋Ÿฌ๋‹ ์‹ค์Šต ์ž๋ฃŒ์‹ค
Jupyter Notebook
40
star
16

soykeyword

Python library for keyword extraction
Python
39
star
17

textmining_dataset

ํ…์ŠคํŠธ๋งˆ์ด๋‹ ์‹ค์Šต์„ ์œ„ํ•œ ๋ฐ์ดํ„ฐ์…‹ ํ•ธ๋“ค๋Ÿฌ
Python
38
star
18

clustering4docs

Clustering algorithm library. Implemented spherical kmeans
Python
37
star
19

sejong_corpus_cleaner

์„ธ์ข… ๋ง๋ญ‰์น˜ ๋ฐ์ดํ„ฐ๋ฅผ ์ •์ œํ•˜๊ธฐ ์œ„ํ•œ utils
Python
36
star
20

naver_movie_scraper

๋„ค์ด๋ฒ„ ์˜ํ™” ์ •๋ณด ๋ฐ ์‚ฌ์šฉ์ž ์ž‘์„ฑ ์˜ํ™”ํ‰/ํ‰์  ๋ฐ์ดํ„ฐ ์ˆ˜์ง‘๊ธฐ
Python
29
star
21

kmrd

Synthetic dataset for recommender system created from Naver Movie rating system
Python
24
star
22

levenshtein_finder

Similar string search in Levenshtein distance
Python
22
star
23

python_ml_intro

ํŒจ์ŠคํŠธ์บ ํผ์Šค, ํŒŒ์ด์ฌ์„ ์ด์šฉํ•œ ๋จธ์‹ ๋Ÿฌ๋‹ ์ž…๋ฌธ ์‹ค์Šต ์ฝ”๋“œ
Jupyter Notebook
21
star
24

python_ml4tm

ํŒจ์ŠคํŠธ์บ ํผ์Šค ํ…์ŠคํŠธ๋งˆ์ด๋‹์„ ์œ„ํ•œ ๋จธ์‹ ๋Ÿฌ๋‹ ์‹ค์Šต ์ž๋ฃŒ์‹ค
Jupyter Notebook
20
star
25

kowikitext

Python
19
star
26

petitions_dataset

์ฒญ์™€๋Œ€ ๊ตญ๋ฏผ์ฒญ์› ๊ฒŒ์‹œํŒ์œผ๋กœ๋ถ€ํ„ฐ ์ˆ˜์ง‘๋œ ๋ฐ์ดํ„ฐ
Python
17
star
27

synthetic_dataset

Synthetic data generator for machine learning
Python
16
star
28

petitions_archive

์ฒญ์™€๋Œ€ ๊ตญ๋ฏผ์ฒญ์› ๋ฐ์ดํ„ฐ ์•„์นด์ด๋ธŒ
15
star
29

petitions_scraper

์ฒญ์™€๋Œ€ ๊ตญ๋ฏผ์ฒญ์› ๊ฒŒ์‹œํŒ์˜ ๋ฐ์ดํ„ฐ๋ฅผ ์ˆ˜์ง‘ํ•˜๋Š” ์Šคํฌ๋ž˜ํผ
Python
15
star
30

pycrfsuite_spacing

python-crfsuite๋ฅผ ์ด์šฉํ•œ ํ•œ๊ตญ์–ด ๋„์–ด์“ฐ๊ธฐ ๊ต์ •๊ธฐ
Python
14
star
31

sejong_corpus

์„ธ์ข…๋ง๋ญ‰์น˜ ๊ฐ€๊ณต๋ฐ์ดํ„ฐ Repository
Jupyter Notebook
13
star
32

crf_postagger

Korean Part-of-Speech Tagger using Conditional Random Field (CRF)
Python
12
star
33

kmeans_to_pyLDAvis

Visualizing k-means using pyLDAvis
Python
11
star
34

komoran3py

Komoran 3 in Python
Python
11
star
35

hmm_postagger

Korean Morphological Analyzer using Hidden Markov Model (HMM)
Python
10
star
36

flask_api_tutorial

Flask ๋กœ API ๋ฅผ ๋งŒ๋“ค๊ธฐ ์œ„ํ•œ ํŠœํ† ๋ฆฌ์–ผ
Python
10
star
37

kmeans_ensemble

Python k-means ensemble package & tutorials
Python
9
star
38

text_embedding

Inferring vector of unseen words
Python
7
star
39

archive_carblog_analysis

Carblog dataset (github.com/lovit/carblog_dataset) ์˜ ๋ถ„์„ ์ฝ”๋“œ์ž…๋‹ˆ๋‹ค
Python
6
star
40

joint_visualization_of_words_and_docs

(Demo) Joint visualization for representation of words and docs trained from Doc2Vec
Python
6
star
41

ppomppu_scraper

๋ฝ๋ฟŒ๊ฒŒ์‹œํŒ ๋ณธ๋ฌธ, ์ œ๋ชฉ, ์Šคํฌ๋ž˜ํผ
Python
6
star
42

text-dedup

Python package for memory-friendly text de-duplication
Python
6
star
43

open-review2

๊ตฌ๊ด€์ด ๋ช…๊ด€์ธ ๋ฐ์ดํ„ฐ๋งˆ์ด๋‹ ์•Œ๊ณ ๋ฆฌ์ฆ˜๋“ค
5
star
44

pagerank

PageRank
Jupyter Notebook
5
star
45

topic_embedding

Embedding words to topic space
Python
5
star
46

ekmeans

Epsilon constrained k-means for document clustering with noise removal
Python
5
star
47

sharing_korean_dictionary

๋‹ค์–‘ํ•œ ๋ถ„์•ผ์˜ ํ•œ๊ตญ์–ด part of speech tagging / named entity recognition ์šฉ ์‚ฌ์ „์„ ๊ณต์œ ํ•˜๊ธฐ ์œ„ํ•œrepository์ž…๋‹ˆ๋‹ค
Python
4
star
48

rnnspace

Space Correction using Character-level Recurrent Neural Network (RNN, LSTM, GRU, etc)
Python
4
star
49

lovit.github.io

HTML
4
star
50

washingtonpost_scraper

Washington Post Search Scraper
Python
3
star
51

archive_clustering_visualization

Visualize clustering result
Jupyter Notebook
3
star
52

korean-wikis-handler

ํ•œ๊ตญ์–ด ์œ„ํ‚คํ”ผ๋””์•„, ๋‚˜๋ฌด์œ„ํ‚ค ๋ฐ์ดํ„ฐ ํ•ธ๋“ค๋ง
Jupyter Notebook
3
star
53

soygraph

Graph similarity & ranking algorithms
Python
3
star
54

python_upload_webserver

Flask, Waitress based file upload webserver
Python
3
star
55

sec.gov_scrapper

Scrapping code for www.sec.gov
Jupyter Notebook
2
star
56

s3-log-parser

AWS S3 access log parser
Python
2
star
57

fastcosine

Approximiated nearest neighbor search for sparse vector
Python
2
star
58

korean_autumn_hmm

"ํ•œ๊ตญ์˜ ๋ด„ ๊ฐ€์„์€ ์งง์•„์ง€๊ณ  ์žˆ๋Š”๊ฐ€? ๊น€๋™ํ˜„, ์‹ ํ•˜์šฉ, ๋Œ€ํ•œ์‚ฐ์—…๊ณตํ•™ํšŒ์ง€ 2013" ๋…ผ๋ฌธ์˜ ์žฌํ˜„
2
star
59

latex_sample

Latex ์œผ๋กœ ๋ฌธ์„œ ์ž‘์—…์„ ํ•˜๊ณ , git ์œผ๋กœ ๋ฒ„์ „๊ด€๋ฆฌ๋ฅผ ํ•˜๋Š” ๊ฒƒ์„ ์„ค๋ช…ํ•˜๊ธฐ ์œ„ํ•œ sample repository ์ž…๋‹ˆ๋‹ค.
TeX
1
star
60

python-stopwatch

Python stopwatch
Python
1
star
61

simple_ner

Simple NER Extraction
Jupyter Notebook
1
star
62

bag-of-concepts

Python
1
star
63

crs_downloader

Python
1
star
64

reddit_scraper

Reddit scraper. Get latest posts from Reddit
Python
1
star
65

wilsoncenter_scraper

Wilsoncenter web page scraper
Python
1
star
66

s3log_monitor

S3 log monitor
Python
1
star
67

network_based_nearest_neighbors

Network-based Nearest Neighbor Indexer
Python
1
star
68

lda_significance_rank

LDA ๋ชจ๋ธ์˜ junk topic, words ํƒ์ƒ‰๊ธฐ
Python
1
star
69

imdb_scraper

Python
1
star
70

easy_wikitext

Wikitext dataset handler
Python
1
star
71

google_scholar_citation_keywords

Google scholar citation keyword
Jupyter Notebook
1
star
72

archive_acl2019review

Python
1
star
73

wsj_scraper

Scrapping thumbnails of search result in WSJ
Python
1
star