isi-nlp/ulf-tokenizer

Stars
2
Language
Perl
License
Apache License 2.0
Created over 6 years ago
Updated almost 3 years ago

isi-nlp/ulf-tokenizer

isi-nlp

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Tokenizer developed by Ulf Harmjakob @ USC ISI

Zoph_RNN

C++/CUDA toolkit for training sequence and sequence-to-sequence models across multiple GPUs

uroman

Universal Romanizer that can convert any unicode script to roman (latin) script

csci_544_fa_18_slides

slides from the fall 2018 version of csci 544

rtg

Reader Translator Generator - NMT toolkit based on pytorch

Jupyter Notebook

bolinas

SHERG rule extraction and parsing tools

ai2

Framework for testing models with AI2 leaderboards

NewsEdits

Jupyter Notebook

RECAP

Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generation

tutorials

universal-cipher-pos-tagging

Code to reproduce experiments in "A Grounded Unsupervised Universal Part-of-Speech Tagger for Low-Resource Languages"

isi_darma

tiburon

Tiburon tree transducer toolkit

nlcodec

Natural Language EnCoder-Decoder: word, char, bpe etc

boteval

Chat bot evaluation

Carmel-Repository

This is a repository for all the finite-state machines that are compatible with Carmel.

sbmt

LSTM

LSTM_PARSER

LSTM Parser for Syntactic Parsing, Syntax Based MT, and AMR parsing

mt_lit_lrec16

Dataset published alongside the paper "Extracting Structured Scholarly Information from the Machine Translation Literature" in LREC 2016.

deeplangtools

tools for deeplang project

unitok

in pursuit of a universal tokenizer

semeval16_task8_amrparsing

nlseminar

repository for the code and data behind the NL Seminar website

nl-seminar

NL seminar website

csci_544_fa_17_slides

slides from fall 2017 iteration of csci544

agile_tokenizer

English, French, and German tokenizer used by the Agile team in GALE/BOLT

commonsense-part-whole

Building a dataset of part-whole relations, inferring the relationship between adjectives and the whole/part

norm_vio_detection

sacrebleu

Clone of https://github.com/mjpost/sacrebleu (detached to keep this private)