aosaimy/arabic-normalizer aosaimy/arabic-normalizer

  • Stars
    star
    2
  • Language
    JavaScript
  • License
    GNU General Publi...
  • Created about 7 years ago
  • Updated about 7 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
aosaimy/arabic-normalizer
github

aosaimy

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Configurable Text normaliser and tokeniser for Arabic texts. It normalises diacritics, Hamaza, digits, etc. It tokenises punctuation, digits, etc from text. It enforces text standard in several aspects: diacritics, letters, and tokenisation.

More Repositories

1

buckwalter-transliteration

A small npm module script that transliterates Arabic text using the Buckwalter Transliteration Scheme (of several versions). Useful for NLP experiments where latin script is preferred.
JavaScript
4
star
2

arabic-vowelizer

A tool for accurate diacritization of highly cited texts by automatically โ€œborrowingโ€ diacritization from other citations.
JavaScript
2
star
3

wasim

Wasim is a web-based tool for semi-automatic morphosyntactic annotation of inflectional languages resources. It features high flexibility in segmenting tokens, editing, diacritizing, and labelling tokens and segments.
JavaScript
1
star