deep-spin/qe-evaluation deep-spin/qe-evaluation

  • Stars
    star
    12
  • Rank 1,597,372 (Top 32 %)
  • Language
    Python
  • License
    MIT License
  • Created over 5 years ago
  • Updated over 5 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
deep-spin/qe-evaluation
github

deep-spin

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Evaluation scripts for the 2019 machine translation quality estimation shared task

More Repositories

1

entmax

The entmax mapping and its loss, a family of sparse softmax alternatives.
Python
406
star
2

infinite-former

Python
65
star
3

tutorial

Web page for our tutorial on latent structure for NLP
47
star
4

lp-sparsemap

LP-SparseMAP: Differentiable sparse structured prediction in coarse factor graphs
C++
41
star
5

UA_COMET

Repository for "Uncertainty-Aware Machine Translation Evaluation", accepted to Findings of EMNLP 2021.
Python
34
star
6

OpenNMT-APE

Python
33
star
7

sparse-marginalization-lvm

Official PyTorch (Lightning) implementation of the NeurIPS 2020 paper "Efficient Marginalization of Discrete and Structured Latent Variables via Sparsity".
Python
28
star
8

scheduled-sampling-transformers

Code for the paper "Scheduled Sampling for Transformers"
Python
25
star
9

tower-eval

Python
24
star
10

mcan-vqa-continuous-attention

Python
21
star
11

uncertainties_MT_eval

Code and data for the paper "Disentangling Uncertainty in Machine Translation Evaluation", accepted at EMNLP 2022.
Python
21
star
12

sparse_text_generation

Python
19
star
13

hallucinations-in-nmt

17
star
14

sparse_continuous_distributions

This repository provides open-source code for sparse continuous distributions and corresponding Fenchel-Young losses.
Python
16
star
15

robust_MT_evaluation

Repository for "BLEU Meets COMET: Combining Lexical and Neural Metrics Towards Robust Machine Translation Evaluation", accepted at EAMT 2023.
Jupyter Notebook
16
star
16

lmt_hallucinations

Shell
14
star
17

qaware-decode

A repository for experiments in quality-aware decoding
Python
14
star
18

OpenNMT-entmax

Python
14
star
19

sparse-communication

Jupyter Notebook
12
star
20

understanding-spigot

Code for the paper "Understanding the Mechanics of SPIGOT: Surrogate Gradients for Latent Structure Learning"
Python
11
star
21

entmax-jax

The entmax mapping in JAX
Python
11
star
22

spectra-rationalization

Repository for SPECTRA: Sparse Structured Text Rationalization, accepted at EMNLP 2021 main conference.
Python
10
star
23

explainable-qe-shared-task

IST-Unbabel 2021 Submission for the Quality Estimation Shared Task
Jupyter Notebook
9
star
24

translation_llm

Jupyter Notebook
8
star
25

non-exchangeable-crc

Jupyter Notebook
7
star
26

crest

Code for CREST: A Joint Framework for Rationalization and Counterfactual Text Generation, accepted at ACL 2023.
Python
7
star
27

pyturbo

Neural dependency parser with higher-order features
Python
6
star
28

S7

Smoothing and Shrinking the Sparse Seq2Seq Search Space
Python
6
star
29

ot-hallucination-detection

Python
5
star
30

efficient_kNN_MT

Python
5
star
31

unn

Code for the paper "Modeling Structure with Undirected Neural Networks"
Python
5
star
32

chunk-based_knn-mt

Python
5
star
33

sigmorphon-seq2seq

DeepSPIN's submission to SIGMORPHON 2020
Python
4
star
34

spec

The Explanation Game: Towards Prediction Explainability through Sparse Communication
Python
4
star
35

SIGMORPHON2019

IT-IST's submission to SIGMORPHON 2019 Task 1
Python
3
star
36

speech-continuous-attention

Speech Classification using Continuous Attention Mechanisms
Python
3
star
37

tutorial-latent-struct-src

Sources for our slides for the latent structure in NLP tutorial
TeX
3
star
38

quest-decoding

A package for sampling from Gibbs distributions during inference with LLMs.
Python
3
star
39

translation-hypothesis-ensembling

Shell
3
star
40

vqa-multimodal-continuous-attention

Python
3
star
41

quati

Simple and modular library for document classification and sequence tagging.
Python
2
star
42

TVmax

Python
2
star
43

SSHN

Sparse and Structured Hopfield Networks
Python
2
star
44

doce

This is the a repo of DOCE
Jupyter Notebook
2
star
45

deep-spin.github.io

Website of the DeepSPIN ERC project.
HTML
1
star