lovit/synthetic_dataset lovit/synthetic_dataset

  • Stars
    star
    16
  • Rank 1,304,352 (Top 26 %)
  • Language
    Python
  • Created over 6 years ago
  • Updated 11 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
lovit/synthetic_dataset
github

lovit

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Synthetic data generator for machine learning

More Repositories

1

soynlp

ํ•œ๊ตญ์–ด ์ž์—ฐ์–ด์ฒ˜๋ฆฌ๋ฅผ ์œ„ํ•œ ํŒŒ์ด์ฌ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค. ๋‹จ์–ด ์ถ”์ถœ/ ํ† ํฌ๋‚˜์ด์ € / ํ’ˆ์‚ฌํŒ๋ณ„/ ์ „์ฒ˜๋ฆฌ์˜ ๊ธฐ๋Šฅ์„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.
Python
933
star
2

KR-WordRank

๋น„์ง€๋„ํ•™์Šต ๋ฐฉ๋ฒ•์œผ๋กœ ํ•œ๊ตญ์–ด ํ…์ŠคํŠธ์—์„œ ๋‹จ์–ด/ํ‚ค์›Œ๋“œ๋ฅผ ์ž๋™์œผ๋กœ ์ถ”์ถœํ•˜๋Š” ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค
Python
351
star
3

textmining-tutorial

(ํ•œ๊ตญ์–ด) ํ…์ŠคํŠธ ๋งˆ์ด๋‹์„ ์œ„ํ•œ ๊ณต๋ถ€๊ฑฐ๋ฆฌ๋“ค
Jupyter Notebook
204
star
4

soyspacing

๋„์–ด์“ฐ๊ธฐ ์˜ค๋ฅ˜ ๊ต์ • ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค. CRF ์™€ ๊ฐ™์€ ๋จธ์‹ ๋Ÿฌ๋‹ ์•Œ๊ณ ๋ฆฌ์ฆ˜์ด ์•„๋‹Œ, ์ง๊ด€์ ์ธ ์ ‘๊ทผ๋ฒ•์œผ๋กœ ๋„์–ด์“ฐ๊ธฐ๋ฅผ ๊ต์ •ํ•ฉ๋‹ˆ๋‹ค.
Python
145
star
5

customized_konlpy

Customized KoNLPy - Korean Natural Language Processing Toolkit KoNLPy wrapping code
Python
126
star
6

textrank

Implementation TextRank and related utils
Python
84
star
7

KoBERTScore

BERTScore for Korean
Python
72
star
8

fastcampus_textml_blogs

ํŒจ์ŠคํŠธ์บ ํผ์Šค, ์ž์—ฐ์–ด์ฒ˜๋ฆฌ๋ฅผ ์œ„ํ•œ ๋จธ์‹ ๋Ÿฌ๋‹, ์ˆ˜์—…๊ด€๋ จ ํฌ์ŠคํŠธ ์ž…๋‹ˆ๋‹ค.
70
star
9

huggingface_konlpy

Training Transformers of Huggingface with KoNLPy
Jupyter Notebook
68
star
10

WordPieceModel

Word Piece Model python light version with functions tokenize/save/load
Python
66
star
11

namuwikitext

Wikitext format dataset of Namuwiki (Most famous Korean wikipedia)
Python
50
star
12

soy

Python
50
star
13

naver_news_search_scraper

๊ฒ€์ƒ‰์–ด ๊ธฐ์ค€์œผ๋กœ ๋„ค์ด๋ฒ„๋‰ด์Šค์™€ ๋Œ“๊ธ€์„ ์ˆ˜์ง‘ํ•˜๋Š” ํŒŒ์ด์ฌ ์ฝ”๋“œ
Python
43
star
14

korean_lemmatizer

ํ•œ๊ตญ์–ด ์šฉ์–ธ ๋ถ„์„๊ธฐ (์›ํ˜• ๋ณต์›, ์šฉ์–ธ ํ˜•ํƒœ์†Œ ๋ถ„์„)
Python
41
star
15

python_ml4nlp

ํŒจ์ŠคํŠธ์บ ํผ์Šค ์ž์—ฐ์–ด์ฒ˜๋ฆฌ๋ฅผ ์œ„ํ•œ ๋จธ์‹ ๋Ÿฌ๋‹ ์‹ค์Šต ์ž๋ฃŒ์‹ค
Jupyter Notebook
40
star
16

soykeyword

Python library for keyword extraction
Python
39
star
17

textmining_dataset

ํ…์ŠคํŠธ๋งˆ์ด๋‹ ์‹ค์Šต์„ ์œ„ํ•œ ๋ฐ์ดํ„ฐ์…‹ ํ•ธ๋“ค๋Ÿฌ
Python
38
star
18

clustering4docs

Clustering algorithm library. Implemented spherical kmeans
Python
37
star
19

sejong_corpus_cleaner

์„ธ์ข… ๋ง๋ญ‰์น˜ ๋ฐ์ดํ„ฐ๋ฅผ ์ •์ œํ•˜๊ธฐ ์œ„ํ•œ utils
Python
36
star
20

naver_movie_scraper

๋„ค์ด๋ฒ„ ์˜ํ™” ์ •๋ณด ๋ฐ ์‚ฌ์šฉ์ž ์ž‘์„ฑ ์˜ํ™”ํ‰/ํ‰์  ๋ฐ์ดํ„ฐ ์ˆ˜์ง‘๊ธฐ
Python
29
star
21

kmrd

Synthetic dataset for recommender system created from Naver Movie rating system
Python
24
star
22

levenshtein_finder

Similar string search in Levenshtein distance
Python
22
star
23

python_ml_intro

ํŒจ์ŠคํŠธ์บ ํผ์Šค, ํŒŒ์ด์ฌ์„ ์ด์šฉํ•œ ๋จธ์‹ ๋Ÿฌ๋‹ ์ž…๋ฌธ ์‹ค์Šต ์ฝ”๋“œ
Jupyter Notebook
21
star
24

python_ml4tm

ํŒจ์ŠคํŠธ์บ ํผ์Šค ํ…์ŠคํŠธ๋งˆ์ด๋‹์„ ์œ„ํ•œ ๋จธ์‹ ๋Ÿฌ๋‹ ์‹ค์Šต ์ž๋ฃŒ์‹ค
Jupyter Notebook
20
star
25

kowikitext

Python
19
star
26

petitions_dataset

์ฒญ์™€๋Œ€ ๊ตญ๋ฏผ์ฒญ์› ๊ฒŒ์‹œํŒ์œผ๋กœ๋ถ€ํ„ฐ ์ˆ˜์ง‘๋œ ๋ฐ์ดํ„ฐ
Python
17
star
27

petitions_archive

์ฒญ์™€๋Œ€ ๊ตญ๋ฏผ์ฒญ์› ๋ฐ์ดํ„ฐ ์•„์นด์ด๋ธŒ
15
star
28

petitions_scraper

์ฒญ์™€๋Œ€ ๊ตญ๋ฏผ์ฒญ์› ๊ฒŒ์‹œํŒ์˜ ๋ฐ์ดํ„ฐ๋ฅผ ์ˆ˜์ง‘ํ•˜๋Š” ์Šคํฌ๋ž˜ํผ
Python
15
star
29

pycrfsuite_spacing

python-crfsuite๋ฅผ ์ด์šฉํ•œ ํ•œ๊ตญ์–ด ๋„์–ด์“ฐ๊ธฐ ๊ต์ •๊ธฐ
Python
14
star
30

sejong_corpus

์„ธ์ข…๋ง๋ญ‰์น˜ ๊ฐ€๊ณต๋ฐ์ดํ„ฐ Repository
Jupyter Notebook
13
star
31

crf_postagger

Korean Part-of-Speech Tagger using Conditional Random Field (CRF)
Python
12
star
32

kmeans_to_pyLDAvis

Visualizing k-means using pyLDAvis
Python
11
star
33

komoran3py

Komoran 3 in Python
Python
11
star
34

hmm_postagger

Korean Morphological Analyzer using Hidden Markov Model (HMM)
Python
10
star
35

flask_api_tutorial

Flask ๋กœ API ๋ฅผ ๋งŒ๋“ค๊ธฐ ์œ„ํ•œ ํŠœํ† ๋ฆฌ์–ผ
Python
10
star
36

kmeans_ensemble

Python k-means ensemble package & tutorials
Python
9
star
37

text_embedding

Inferring vector of unseen words
Python
7
star
38

archive_carblog_analysis

Carblog dataset (github.com/lovit/carblog_dataset) ์˜ ๋ถ„์„ ์ฝ”๋“œ์ž…๋‹ˆ๋‹ค
Python
6
star
39

joint_visualization_of_words_and_docs

(Demo) Joint visualization for representation of words and docs trained from Doc2Vec
Python
6
star
40

ppomppu_scraper

๋ฝ๋ฟŒ๊ฒŒ์‹œํŒ ๋ณธ๋ฌธ, ์ œ๋ชฉ, ์Šคํฌ๋ž˜ํผ
Python
6
star
41

text-dedup

Python package for memory-friendly text de-duplication
Python
6
star
42

open-review2

๊ตฌ๊ด€์ด ๋ช…๊ด€์ธ ๋ฐ์ดํ„ฐ๋งˆ์ด๋‹ ์•Œ๊ณ ๋ฆฌ์ฆ˜๋“ค
5
star
43

pagerank

PageRank
Jupyter Notebook
5
star
44

topic_embedding

Embedding words to topic space
Python
5
star
45

ekmeans

Epsilon constrained k-means for document clustering with noise removal
Python
5
star
46

sharing_korean_dictionary

๋‹ค์–‘ํ•œ ๋ถ„์•ผ์˜ ํ•œ๊ตญ์–ด part of speech tagging / named entity recognition ์šฉ ์‚ฌ์ „์„ ๊ณต์œ ํ•˜๊ธฐ ์œ„ํ•œrepository์ž…๋‹ˆ๋‹ค
Python
4
star
47

rnnspace

Space Correction using Character-level Recurrent Neural Network (RNN, LSTM, GRU, etc)
Python
4
star
48

lovit.github.io

HTML
4
star
49

washingtonpost_scraper

Washington Post Search Scraper
Python
3
star
50

soygraph

Graph similarity & ranking algorithms
Python
3
star
51

archive_clustering_visualization

Visualize clustering result
Jupyter Notebook
3
star
52

korean-wikis-handler

ํ•œ๊ตญ์–ด ์œ„ํ‚คํ”ผ๋””์•„, ๋‚˜๋ฌด์œ„ํ‚ค ๋ฐ์ดํ„ฐ ํ•ธ๋“ค๋ง
Jupyter Notebook
3
star
53

python_upload_webserver

Flask, Waitress based file upload webserver
Python
3
star
54

sec.gov_scrapper

Scrapping code for www.sec.gov
Jupyter Notebook
2
star
55

ie_openseminar_1_from_text_to_doc2vec_tsne

Openseminar #1 From scraping to Word2vec, Doc2Vec visualization with t-SNE
Jupyter Notebook
2
star
56

fastcosine

Approximiated nearest neighbor search for sparse vector
Python
2
star
57

s3-log-parser

AWS S3 access log parser
Python
2
star
58

korean_autumn_hmm

"ํ•œ๊ตญ์˜ ๋ด„ ๊ฐ€์„์€ ์งง์•„์ง€๊ณ  ์žˆ๋Š”๊ฐ€? ๊น€๋™ํ˜„, ์‹ ํ•˜์šฉ, ๋Œ€ํ•œ์‚ฐ์—…๊ณตํ•™ํšŒ์ง€ 2013" ๋…ผ๋ฌธ์˜ ์žฌํ˜„
2
star
59

latex_sample

Latex ์œผ๋กœ ๋ฌธ์„œ ์ž‘์—…์„ ํ•˜๊ณ , git ์œผ๋กœ ๋ฒ„์ „๊ด€๋ฆฌ๋ฅผ ํ•˜๋Š” ๊ฒƒ์„ ์„ค๋ช…ํ•˜๊ธฐ ์œ„ํ•œ sample repository ์ž…๋‹ˆ๋‹ค.
TeX
1
star
60

python-stopwatch

Python stopwatch
Python
1
star
61

reddit_scraper

Reddit scraper. Get latest posts from Reddit
Python
1
star
62

simple_ner

Simple NER Extraction
Jupyter Notebook
1
star
63

bag-of-concepts

Python
1
star
64

lda_significance_rank

LDA ๋ชจ๋ธ์˜ junk topic, words ํƒ์ƒ‰๊ธฐ
Python
1
star
65

crs_downloader

Python
1
star
66

wilsoncenter_scraper

Wilsoncenter web page scraper
Python
1
star
67

s3log_monitor

S3 log monitor
Python
1
star
68

network_based_nearest_neighbors

Network-based Nearest Neighbor Indexer
Python
1
star
69

imdb_scraper

Python
1
star
70

easy_wikitext

Wikitext dataset handler
Python
1
star
71

google_scholar_citation_keywords

Google scholar citation keyword
Jupyter Notebook
1
star
72

archive_acl2019review

Python
1
star
73

wsj_scraper

Scrapping thumbnails of search result in WSJ
Python
1
star