SapienzaNLP/ita-bench

Stars
12
Rank 1,597,372 (Top 32 %)
Language
Python
License
Apache License 2.0
Created 2 months ago
Updated about 2 months ago

SapienzaNLP/ita-bench

SapienzaNLP

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

A collection of Italian benchmarks for LLM evaluation

relik

Retrieve, Read and LinK: Fast and Accurate Entity Linking and Relation Extraction on an Academic Budget (ACL 2024)

extend

Entity Disambiguation as text extraction (ACL 2022)

spring

SPRING is a seq2seq model for Text-to-AMR and AMR-to-Text (AAAI2021).

ewiser

A Word Sense Disambiguation system integrating implicit and explicit external knowledge.

consec

Text Extraction Formulation + Feedback Loop for state-of-the-art WSD (EMNLP 2021)

maverick-coref

esc

ESC: Redesigning WSD with Extractive Sense Comprehension

mcl-wic

Semeval-2021 Multilingual and Cross-lingual Word-in-Context Task

gsrl

GSRL is a seq2seq model for end-to-end dependency- and span-based SRL (IJCAI2021).

unify-srl

Unifying Cross-Lingual Semantic Role Labeling with Heterogeneous Linguistic Resources (NAACL-2021).

xl-amr

XL-AMR is a sequence-to-graph cross-lingual AMR parser that exploits transfer learning (EMNLP2020).

wsd-hard-benchmark

Data and code for "Nibbling at the Hard Core of Word Sense Disambiguation" (ACL 2022).

usea

Universal Semantic Annotator (LREC 2022)

xl-wsd-code

Code to train and test Word Sense Disambiguation models based on different pretrained transformers.

genesis

GeneSis is the first generative approach for lexical substitution (EMNLP 2021).

srl4e

conception

Code and experiments for the COLING2020 paper "Conception: Multilingually-Enhanced, Human-Readable Concept Vector Representations".

multi-srl

Code and models for the COLING2020 paper "Bridging the Gap in Multilingual Semantic Role Labeling: a Language-Agnostic Approach".

clubert

Distribution of word meanings in Wikipedia for English, Italian, French, German and Spanish.

steps

STEPS is a seq2seq model for Semantic Typing of Event Processes (AAAI 2022).

LeakDistill

bmr

guardians-mt-eval

Official repository of the ACL 2024 paper "Guardians of the Machine Translation Meta-Evaluation: Sentinel Metrics Fall In!".

neural-pagerank-wsd

Exploiting the global WordNet graph to perform WSD

srl-pas-probing

Probing for Predicate Argument Structures in Pretrained Language Models (ACL 2022).

mulan

Multilingual Label propagatioN for Word Sense Disambiguation

MaTESe

MaTESe: Machine Translation Evaluation as a Sequence Tagging Problem

mwsd-datasets

Semeval-2013 and -2015 multilingual WSD datasets for BabelNet 4.0

dsrl

Code for "Semantic Role Labeling meets Definition Modeling: using natural language to describe predicate-argument structures"

nounatlas

The NounAtlas frame inventory and model repository

multilabel-wsd

A multi-labeling model for knowledge integration into Word Sense Disambiguation (EACL 2021).

mosaico

A multilingual open-text semantically annotated interlinked corpus

sir

SIR is a sense-enhanced Information Retrieval system for multiple languages (EMNLP2021).

zebra

nlp2020-hw1

CLAP

exploring-srl

Repository for the paper "Exploring Non-Verbal Predicates in Semantic Role Labeling: Challenges and Opportunities"

nlp2021-hw1

nlp2023-hw1

Homework 1 for the NLP 2023 course

united-srl

A unified dataset for span- and dependency-based multilingual and cross-lingual Semantic Role Labeling (EMNLP 2021).

ea-mt

Entity-Aware Machine Translation (SemEval-2025: Task 2)

nlp2022-hw1

csi_code

nlp2020-hw2

alasca

New large-scale datasets for the task of lexical substitution (IJCAI 2021)

nlp2023-hw2

Homework 2 for the Multilingual NLP 2023 course

XL-WA

visual-definition-modeling