Helsinki-NLP/OpusFilter Helsinki-NLP/OpusFilter

  • Stars
    star
    93
  • Rank 348,718 (Top 8 %)
  • Language
    Python
  • License
    MIT License
  • Created over 4 years ago
  • Updated 5 months ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
Helsinki-NLP/OpusFilter
github

Helsinki-NLP

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

OpusFilter - Parallel corpus processing toolkit

More Repositories

1

Tatoeba-Challenge

Makefile
762
star
2

Opus-MT

Open neural machine translation models and web services
Python
531
star
3

OPUS-MT-train

Training open neural machine translation models
Makefile
304
star
4

prosody

Helsinki Prosody Corpus and A System for Predicting Prosodic Prominence from Text
Python
224
star
5

HBMP

Sentence Embeddings in NLI with Iterative Refinement Encoders
Python
77
star
6

OpusTools

Python
61
star
7

OPUS-CAT

OPUS-CAT is a collection of software which make it possible to OPUS-MT neural machine translation models in professional translation. OPUS-CAT includes a local offline MT engine and a collection of CAT tool plugins.
C#
60
star
8

XED

XED multilingual emotion datasets
Jupyter Notebook
53
star
9

OPUS

The Open Parallel Corpus
JavaScript
42
star
10

UkrainianLT

A collection of links to Ukrainian language tools
26
star
11

mammoth

MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki
Python
19
star
12

OPUS-translator

Translation demonstrator
Smalltalk
18
star
13

MuCoW

Automatically harvested multilingual contrastive word sense disambiguation test sets for machine translation
Python
15
star
14

subalign

Perl
14
star
15

sentimentator

Tool for sentiment analysis annotation
HTML
11
star
16

OPUS-MT-testsets

benchmarks for evaluating MT models
Smalltalk
9
star
17

OpusTools-perl

Perl
5
star
18

neural-search-tutorials

Additional Notebooks for the Building NLP Applications course
Jupyter Notebook
5
star
19

nli-data-sanity-check

Data and scripts for a diagnostics test suite which allows to assess whether an NLU dataset constitutes a good testbed for evaluating the models' meaning understanding capabilities.
Jupyter Notebook
5
star
20

OPUS-interface

OPUS repository interface
Python
5
star
21

OPUS-ingest

Makefile
4
star
22

LanguageCodes

Perl
4
star
23

shroom

SCSS
4
star
24

OPUS-repository

Perl
3
star
25

doclevel-MT-benchmark

Document-level Machine Translation Benchmark
Python
3
star
26

Uplug

HTML
3
star
27

americasnlp2021-st

AmericasNLP 2021 shared task
JavaScript
3
star
28

Geometry

Python
2
star
29

shared-info

2
star
30

LSDC

Low-Saxon Dialect Classification
2
star
31

pdf2xml

Perl
2
star
32

Syntactic_Debiasing

Python
2
star
33

OpusFilter-hub

A hub of OpusFilter configurations
Python
1
star
34

OPUS-index

Index of resources in OPUS
1
star
35

NLU-Course-2020

Python
1
star
36

SELF-FEIL

Emotion Lexicons for Finnish
1
star
37

OPUS-MT-dashboard

PHP
1
star
38

External-MT-leaderboard

Leaderboards for external MT models
1
star
39

nlu-dataset-diagnostics

This repository contains data and scripts to reproduce the results from our paper: How Does Data Corruption Affect Natural Language Understanding Models? A Study on GLUE datasets.
Python
1
star
40

en-fi-testsuite

WMT18 Testsuite for Finnish morphology
Python
1
star
41

finlandsvensk-AI

1
star
42

ndc-aligned

Word-aligned version of the Norwegian Dialect Corpus
Python
1
star
43

OPUS-website

OPUS website files
1
star
44

OPUS-MT-leaderboard-recipes

Makefile recipes shared between all leaderboard repos
Makefile
1
star
45

OPUS-MT-leaderboard

1
star
46

murreviikko

Dialectologically annotated and normalized dataset of dialectal Finnish tweets
Python
1
star
47

Sami-MT

machine translation for Sรกmi languages
1
star