• Stars
    star
    1
  • Language
    Go
  • Created almost 10 years ago
  • Updated over 8 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

natural language tokenization using various types of tokenizer, including a state function lexer, unicode matcher, and basic white space splitter