lang-uk/tokenize-ms lang-uk/tokenize-ms

  • Stars
    star
    3
  • Rank 3,963,521 (Top 79 %)
  • Language
    Python
  • License
    MIT License
  • Created over 8 years ago
  • Updated about 8 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
lang-uk/tokenize-ms
github

lang-uk

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Microservice for tokenization

More Repositories

1

ner-uk

Ukranian NER annotation project
Common Lisp
89
star
2

tokenize-uk

Simple python lib to tokenize texts into sentences and sentences to words. Small, fast and robust. Comes with ukrainian flavour
Python
55
star
3

ukrainian-word-stress

Adds word stress to Ukrainian texts
Python
45
star
4

tone-dict-uk

Ukrainian tone dictionary
Common Lisp
44
star
5

lang-uk.github.io

Site and documents of the lang-uk group
38
star
6

ua-gazetteers

Набір різноманітних колекцій даних українською мовою зібраний протягом роботи над антикорупційними проектами. CSV–формат, до деяких датасетів також наявний переклад англійською або російською.
28
star
7

tonal-model

Python
20
star
8

ukrainian-word-stress-dictionary

Dictionary of word stresses in the Ukrainian language 🇺🇦
18
star
9

dragoman

Python
10
star
10

lang.org.ua

http://lang.org.ua website
CSS
8
star
11

semesyuk-to-text

Jupyter Notebook
6
star
12

vecs

Vector representations
Python
6
star
13

new_design

New design for the lang.org.ua from Bachoo
HTML
4
star
14

ukrainian-heteronyms-dictionary

Dictionary of heteronyms in the Ukrainian language
3
star
15

ukrainian-abbreviations-dictionary

Dictionary of abbreviations in the Ukrainian language
3
star
16

1551.gov.ua

Dataset of requests to Kyiv City municipal portal (1551.gov.ua)
3
star
17

fasttext-vectors-uk

Word representation for Ukrainian with fastText
Jupyter Notebook
3
star
18

choppa

Partial python port of java SRX segmenter
Python
3
star
19

flair-pos

Grid search for the pos model
Python
3
star
20

vulyk-ner

NER tagging plugin for Vulyk, crowdsourcing framework
JavaScript
2
star
21

ipa-uk

Python package to generate IPA (international phonetic alphabet) for ukrainian words
Python
2
star
22

wordnet

Our drafts and ideas on the WordNet for Ukrainian Language
Jupyter Notebook
2
star
23

wikidrill

Like a drill but for the wiki
Jupyter Notebook
2
star
24

flair-ner

script to train and evaluate different params for flair NER models
Python
1
star
25

flair-ppl

Python
1
star
26

word-vectors-uk

Scripts, stats and tasks for ubertext vectors trained using different models
1
star