• Stars
    star
    2
  • Language
    Python
  • License
    Creative Commons ...
  • Created 8 months ago
  • Updated 6 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Manually annotated dataset of Finnish varieties in the Suomi24, the largest Finnish internet forum, the id's of automatically annotated dialectal messages and the scripts used for classification and evaluation.

More Repositories

1

Tatoeba-Challenge

Makefile
797
star
2

Opus-MT

Open neural machine translation models and web services
Python
612
star
3

OPUS-MT-train

Training open neural machine translation models
Makefile
330
star
4

prosody

Helsinki Prosody Corpus and A System for Predicting Prosodic Prominence from Text
Python
229
star
5

OpusFilter

OpusFilter - Parallel corpus processing toolkit
Python
101
star
6

HBMP

Sentence Embeddings in NLI with Iterative Refinement Encoders
Python
78
star
7

OPUS-CAT

OPUS-CAT is a collection of software which make it possible to OPUS-MT neural machine translation models in professional translation. OPUS-CAT includes a local offline MT engine and a collection of CAT tool plugins.
C#
69
star
8

OpusTools

Python
67
star
9

XED

XED multilingual emotion datasets
Jupyter Notebook
55
star
10

OPUS

The Open Parallel Corpus
JavaScript
54
star
11

UkrainianLT

A collection of links to Ukrainian language tools
29
star
12

OPUS-translator

Translation demonstrator
Smalltalk
27
star
13

mammoth

MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki
Python
21
star
14

MuCoW

Automatically harvested multilingual contrastive word sense disambiguation test sets for machine translation
Python
16
star
15

subalign

Perl
15
star
16

sentimentator

Tool for sentiment analysis annotation
HTML
11
star
17

OPUS-MT-testsets

benchmarks for evaluating MT models
Smalltalk
10
star
18

OpusTools-perl

Perl
6
star
19

neural-search-tutorials

Additional Notebooks for the Building NLP Applications course
Jupyter Notebook
5
star
20

OPUS-interface

OPUS repository interface
Python
5
star
21

OPUS-ingest

Makefile
4
star
22

LanguageCodes

Perl
4
star
23

shroom

SCSS
4
star
24

nli-data-sanity-check

Data and scripts for a diagnostics test suite which allows to assess whether an NLU dataset constitutes a good testbed for evaluating the models' meaning understanding capabilities.
Jupyter Notebook
4
star
25

OPUS-repository

Perl
3
star
26

doclevel-MT-benchmark

Document-level Machine Translation Benchmark
Python
3
star
27

Uplug

HTML
3
star
28

americasnlp2021-st

AmericasNLP 2021 shared task
JavaScript
3
star
29

Geometry

Python
2
star
30

shared-info

2
star
31

LSDC

Low-Saxon Dialect Classification
2
star
32

pdf2xml

Perl
2
star
33

Syntactic_Debiasing

Python
2
star
34

OpusTranslationService

Translation service based on LibreTranslate
Python
2
star
35

OPUS-index

Index of resources in OPUS
1
star
36

OpusFilter-hub

A hub of OpusFilter configurations
Python
1
star
37

NLU-Course-2020

Python
1
star
38

SELF-FEIL

Emotion Lexicons for Finnish
1
star
39

ndc-aligned

Word-aligned version of the Norwegian Dialect Corpus
Python
1
star
40

OPUS-MT-dashboard

PHP
1
star
41

External-MT-leaderboard

Leaderboards for external MT models
1
star
42

nlu-dataset-diagnostics

This repository contains data and scripts to reproduce the results from our paper: How Does Data Corruption Affect Natural Language Understanding Models? A Study on GLUE datasets.
Python
1
star
43

en-fi-testsuite

WMT18 Testsuite for Finnish morphology
Python
1
star
44

finlandsvensk-AI

1
star
45

OPUS-website

OPUS website files
1
star
46

OPUS-MT-leaderboard-recipes

Makefile recipes shared between all leaderboard repos
Makefile
1
star
47

OPUS-MT-leaderboard

1
star
48

murreviikko

Dialectologically annotated and normalized dataset of dialectal Finnish tweets
Python
1
star
49

Sami-MT

machine translation for Sรกmi languages
1
star
50

lm-vs-mt

Two Stacks Are Better Than One: A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives
Python
1
star
51

OPUS-API

API for searching corpora from OPUS
Python
1
star
52

dialect-topic-model

Scripts and metadata for the paper "Corpus-based dialectometry with topic models"
Python
1
star