neubig/kytea

Stars
197
Rank 197,722 (Top 4 %)
Language
C++
License
Other
Created almost 14 years ago
Updated over 4 years ago

neubig/kytea

neubig

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

The Kyoto Text Analysis Toolkit for word segmentation and pronunciation estimation, etc.

KyTea

KyTea is a general text analysis toolkit, with a focus on Japanese and other languages requiring word or morpheme segmentation.

Detailed usage information can be found at http://www.phontron.com/kytea

To build KyTea, run

 $ ./configure
 $ make

If there is no configure file in the directory (for example, if you checked the source out from GitHub), you must rebuild the configure file using the following command:

 $ autoreconf -i

nn4nlp-code

Code Samples from Neural Networks for NLP

lowresource-nlp-bootcamp-2020

The website for the CMU Language Technologies Institute low resource NLP bootcamp 2020

Jupyter Notebook

nlptutorial

A Tutorial about Programming for Natural Language Processing

nmt-tips

A tutorial about neural machine translation including tips on building practical systems

nlp-from-scratch-assignment-2022

An assignment for CMU CS11-711 Advanced NLP, building NLP systems from scratch

lamtram

lamtram: A toolkit for neural language and translation modeling

anlp-code

Jupyter Notebook

research-career-tools

naacl18tutorial

NAACL 2018 Tutorial: Modelling Natural Language, Programs, and their Intersection

minbert-assignment

Minimalist BERT implementation assignment for CS11-711

minnn-assignment

An assignment on creating a minimalist neural network toolkit for CS11-747

yrsnlp-2016

Structured Neural Networks for NLP: From Idea to Code

Jupyter Notebook

minllama-assignment

util-scripts

Various utility scripts useful for natural language processing, machine translation, etc.

latticelm

Software for unsupervised word segmentation and language model learning using lattices

coderx

A highly sophisticated sequence-to-sequence model for code generation

rapid-adaptation

Reproduction instructions for "Rapid Adaptation of Neural Machine Translation to New Languages"

mtandseq2seq-code

Code examples for CMU CS11-731, Machine Translation and Sequence-to-sequence Models

travatar

This is a repository for the Travatar forest-to-string translation decoder

lxmls-2017

Slides/code for the Lisbon machine learning school 2017

modlm

modlm: A toolkit for mixture of distributions language models

kylm

The Kyoyo Language Modeling Toolkit

pialign

pialign - A Phrasal ITG Aligner

pgibbs

An implementation of parallel gibbs sampling for word segmentation and POS tagging.

nlp-from-scratch-assignment-spring2024

An assignment for building an NLP system from scratch.

lader

A reordering tool for machine translation.

howtocode-2017

An example of DyNet autobatching for the NIPS "how to code a paper" workshop

Jupyter Notebook

kyfd

A decoder for finite state models for text processing.

egret

A fork of the Egret parser that fixes a few bugs

latticelm-v2

Second version of latticelm, a tool for learning language models from lattices

globalutility

nafil

A program for performing bilingual corpus filtering

prontron

A discriminative pronunciation estimator using the structured perceptron algorithm.

wat2014

Scripts for creating a system similar to the NAIST submission to WAT2014

multi-extract

A script for extracting multi-synchronous context-free grammars

nile

A clone of the nile alignment toolkit

webigator

A program to aggregate, rank, and search text information

ribes-c

A C++ implementation of the RIBES machine translation evaluation measure.

swe-bench-zeno

Scripts for analyzing swe-bench with Zeno