Discover allenai/flex Open Source project by AI2 (@allenai)

Stars
91
Rank 366,013 (Top 8 %)
Language
Python
License
Apache License 2.0
Created over 3 years ago
Updated over 2 years ago

allenai

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Few-shot NLP benchmark for unified, rigorous eval

allennlp

An open-source NLP research library, built on PyTorch.

Python

11,751

OLMo

Modeling, training, eval, and inference code for OLMo

Python

4,535

RL4LMs

A modular RL library to fine-tune language models to human preferences

Python

2,101

longformer

Longformer: The Long-Document Transformer

Python

2,022

bilm-tf

Tensorflow implementation of contextualized word representations from bi-directional language models

Python

1,621

scispacy

A full spaCy pipeline and models for scientific/biomedical documents.

Python

1,618

bi-att-flow

Bi-directional Attention Flow (BiDAF) network is a multi-stage hierarchical process that represents context at different levels of granularity and uses a bi-directional attention flow mechanism to achieve a query-aware context representation without early summarization.

Python

1,533

scibert

A BERT model for scientific text.

open-instruct

ai2thor

An open-source platform for Visual AI.

1,160

dolma

Data and tools for generating and inspecting OLMo pre-training data.

Python

961

XNOR-Net

ImageNet classification using binary Convolutional Neural Networks

Lua

839

s2orc

S2ORC: The Semantic Scholar Open Research Corpus: https://www.aclweb.org/anthology/2020.acl-main.447/

Python

817

mmc4

MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.

scitldr

objaverse-xl

🪐 Objaverse-XL is a Universe of 10M+ 3D Objects. Contains API Scripts for Downloading and Processing!

Python

701

papermage

library supporting NLP and CV research on scientific papers

Python

692

natural-instructions

Expanding natural instructions

Python

690

visprog

Official code for VisProg (CVPR 2023 Best Paper!)

Python

686

science-parse

Science Parse parses scientific papers (in PDF form) and returns them in structured form.

Java

611

pdffigures2

Given a scholarly PDF, extract figures, tables, captions, and section titles.

Scala

593

writing-code-for-nlp-research-emnlp2018

A companion repository for the "Writing code for NLP Research" Tutorial at EMNLP 2018

Python

558

tango

Organize your experiments into discrete steps that can be cached and reused throughout the lifetime of your research project.

Python

528

allennlp-models

Officially supported AllenNLP models

Python

521

specter

SPECTER: Document-level Representation Learning using Citation-informed Transformers

Python

506

dont-stop-pretraining

Code associated with the Don't Stop Pretraining ACL 2020 paper

unified-io-2

macaw

Multi-angle c(q)uestion answering

Python

451

lumos

Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"

document-qa

scholarphi

An interactive PDF reader.

Python

418

deep_qa

A deep NLP library, based on Keras / tf, focused on question answering (but useful for other NLP too)

Python

404

acl2018-semantic-parsing-tutorial

Materials from the ACL 2018 tutorial on neural semantic parsing

402

unifiedqa

UnifiedQA: Crossing Format Boundaries With a Single QA System

Python

384

pawls

Software that makes labeling PDFs easy.

Python

380

OLMoE

OLMoE: Open Mixture-of-Experts Language Models

Jupyter Notebook

374

KnowBert -- Knowledge Enhanced Contextual Word Representations

Python

359

PeerRead

Data and code for Kang et al., NAACL 2018's paper titled "A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applications"

Python

354

reward-bench

RewardBench: the first evaluation tool for reward models.

Python

346

naacl2021-longdoc-tutorial

Python

342

openie-standalone

Quality information extraction at web scale. Edit

Scala

327

Holodeck

CVPR 2024: Language Guided Generation of 3D Embodied AI Environments.

Python

319

python-package-template

A template repo for Python packages

Python

318

allenact

An open source framework for research in Embodied-AI from AI2.

Python

316

ir_datasets

Provides a common interface to many IR ranking datasets.

Python

314

s2orc-doc2json

Parsers for scientific papers (PDF2JSON, TEX2JSON, JATS2JSON)

Python

302

acl2022-zerofewshot-tutorial

291

OLMo-Eval

Evaluation suite for LLMs

Python

280

procthor

🏘️ Scaling Embodied AI by Procedurally Generating Interactive 3D Houses

Python

257

fm-cheatsheet

Website for hosting the Open Foundation Models Cheat Sheet.

FineGrainedRLHF

beaker-cli

A collaborative platform for rapid and reproducible research.

230

comet-atomic-2020

Python

228

spv2

Science-parse version 2

Python

225

scifact

Data and models for the SciFact verification task.

Python

217

objaverse-rendering

📷 Scripts for rendering Objaverse

Python

206

ScienceWorld

ScienceWorld is a text-based virtual environment centered around accomplishing tasks from the standardized elementary science curriculum.

unified-io-inference

allennlp-demo

Code for the AllenNLP demo.

TypeScript

191

citeomatic

A citation recommendation system that allows users to find relevant citations for their paper drafts. The tool is backed by Semantic Scholar's OpenCorpus dataset.

Jupyter Notebook

189

cartography

Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics

Jupyter Notebook

188

savn

Learning to Learn how to Learn: Self-Adaptive Visual Navigation using Meta-Learning (https://arxiv.org/abs/1812.00971)

Python

175

vampire

Variational Methods for Pretraining in Resource-limited Environments

Python

173

vila

Incorporating VIsual LAyout Structures for Scientific Text Classification

Python

172

s2-folks

Public space for the user community of Semantic Scholar APIs to share scripts, report issues, and make suggestions.

171

hidden-networks

Python

164

cord19

Get started with CORD-19

161

mmda

multimodal document analysis

Jupyter Notebook

158

PRIMER

The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization

Python

150

catwalk

This project studies the performance and robustness of language models and task-adaptation methods.

Python

141

dnw

Discovering Neural Wirings (https://arxiv.org/abs/1906.00586)

Python

139

deepfigures-open

Companion code to the paper "Extracting Scientific Figures with Distantly Supervised Neural Networks" 🤖

Python

133

tpu_pretrain

LM Pretraining with PyTorch/TPU

Python

132

allentune

Hyperparameter Search for AllenNLP

Python

128

SciREX

Data/Code Repository for https://api.semanticscholar.org/CorpusID:218470122

Python

128

scidocs

Dataset accompanying the SPECTER model

Python

127

lm-explorer

interactive explorer for language models

Python

127

pdffigures

Command line tool to extract figures, tables, and captions from scholarly documents in PDF form.

C++

125

OpenBookQA

Code for experiments on OpenBookQA from the EMNLP 2018 paper "Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering"

Python

121

peS2o

Pretraining Efficiently on S2ORC!

120

gooaq

Question-answers, collected from Google

Python

116

allennlp-as-a-library-example

A simple example for how to build your own model using AllenNLP as a dependency.

Python

113

embodied-clip

Official codebase for EmbCLIP

multimodalqa

alexafsm

With alexafsm, developers can model dialog agents with first-class concepts such as states, attributes, transition, and actions. alexafsm also provides visualization and other tools to help understand, test, debug, and maintain complex FSM conversations.

Python

108

allennlp-semparse

A framework for building semantic parsers (including neural module networks) with AllenNLP, built by the authors of AllenNLP

Python

107

scicite

Repository for NAACL 2019 paper on Citation Intent prediction

Python

106

ai2thor-rearrangement

🔀 Visual Room Rearrangement

Python

104

commonsense-kg-completion

Python

102

medicat

Dataset of medical images, captions, subfigure-subcaption annotations, and inline textual references

Python

102

real-toxicity-prompts

Jupyter Notebook

101

s2search

The Semantic Scholar Search Reranker

Python

aristo-mini

Aristo mini is a light-weight question answering system that can quickly evaluate Aristo science questions with an evaluation web server and the provided baseline solvers.

Python

gpv-1

A task-agnostic vision-language architecture as a step towards General Purpose Vision

Jupyter Notebook

elastic

Python

manipulathor

ManipulaTHOR, a framework that facilitates visual manipulation of objects using a robotic arm

Jupyter Notebook

spoc-robot-training

SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real World

Python

S2AND

Semantic Scholar's Author Disambiguation Algorithm & Evaluation Suite

Python

propara

ProPara (Process Paragraph Comprehension) dataset and models

ARC-Solvers

allenai/flex

allenai

Reviews

Repository Details

More Repositories