jirkamarsik/trainable-tokenizer

Stars
21
Rank 1,084,038 (Top 22 %)
Language
C++
License
Other
Created over 13 years ago
Updated over 7 years ago

jirkamarsik/trainable-tokenizer

jirkamarsik

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Fast and trainable tokenizer for natural languages relying on maximum entropy methods.

lambda-mu

Procrastinating with Agda: a formalization of System L

esa-wordseg

An implementation of the ESA unsupervised word segmentation algorithm in Clojure.

yapg

Yet Another Parser Generator - an LALR(1) parser generator

dp-mpi

Distributed dynamic programming with Python and MPI

quex

OBSOLETE: Quex 0.59.1 fixed this issue. (This is a fork of the Quex Lexical Analyzer Generator by Frank-Rene Schäfer fixing a trivial show-stopping bug.)

ling-eff

Effects and Handlers in Natural Language -- the working repository for my PhD research

bc-thesis

Fast and Trainable Tokenizer for Natural Languages - my bachelor thesis

acgtk

A publicly open Git mirror for the ACG toolkit hosted at

AdventOfCode2017

My Advent of Code 2017 solutions in Haskell

mulan-ensemble

Ensemble classifiers implementation for Mulan and a paper using it for experiments with text classification.

block-cipher-design

Some Haskell code to prototype a design for a lame block cipher.

ray-tracer

A quite straightforward ray tracer leveraging the power of functional and parallel programing.

dot-emacs

My Emacs setup, which tries to use mostly only MELPA for package installation and the Emacs Starter Kit for defaults. A lot of stuff is also pulled from the live-coding-emacs setup for Overtone.

Framed

Ludum Dare 38 jam entry

acg-clj

A toolkit for experimenting with abstract categorial grammars lexicalized by an external lexical database.

deflaw

An exploration into expressing laws of interactions in a population using logic programming.

maxent

OBSOLETE: This is a "fork" of the Maximum Entropy Modeling Toolkit by Le Zhang fixing some critical overflow errors. Now, that the project has moved to GitHub, it might be more prudent to conduct futher work in https://github.com/lzhang10/maxent.