Discover HazyResearch/prefix-linear-attention Open Source project

Resources for Data Centric AI

1,372

data-centric-ai

TeX

1,099

safari

Convolutions for Sequence Modeling

Creative interactive views of any dataset.

867

meerkat

Hyperbolic Graph Convolutional Networks in PyTorch.

826

hgcn

Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena

597

hyena-dna

Ask Me Anything language model prompting

585

ama_prompting

Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"

538

Language Modeling with the H3 State Space Model

535

This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes"

513

evaporate

Prompt programming with FMs.

479

manifest

🌲 A tool for converting PDF into hOCR with text, tables, and figures being recognized and preserved.

440

pdftotree

Snorkel MeTaL: A framework for training models with multi-task weak supervision

431

metal

A knowledge base construction engine for richly formatted data

423

fonduer

Building blocks for foundation models.

408

aisys-building-blocks

377

hyperbolics

Hyperbolic Embeddings

An open science effort to benchmark legal reasoning in foundation models

372

legalbench

More interactive weak supervision with FlyingSquid

341

flyingsquid

FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores

313

flash-fft-conv

Hyperbolic Knowledge Graph embeddings.

276

KGEmb

Self-Supervision for Named Entity Disambiguation at the Tail

249

bootleg

Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"

213

based

Hyperbolic Hierarchical Clustering.

209

HypHC

fly

TART

TART: A plug-and-play Transformer module for task-agnostic reasoning

Learning to Compose Domain-Specific Transformations for Data Augmentation

190

tanda

hippo-code

butterfly

Butterfly matrix multiplication in PyTorch

Code for SpaceTime 🌌⏱️. Proposed in Effectively Modeling Time Series with Simple Discrete State Spaces, ICLR 2023.

164

spacetime

Understand and test language model architectures on synthetic tasks.

163

zoology

Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"

160

lolcats

A system for generating training labels via natural language explanations

154

babble

Your worst case is our best case.

146

EmptyHeaded

domino

blocking-tutorial

mindbender

Tools for iterative knowledge base development with DeepDive

CoffeeScript

117

reef

Automatically labeling training data

Foundation Models for Data Tasks

106

fm_data_tasks

A collection of simple tutorials for using Fonduer

100

fonduer-tutorials

Automating enterprise workflows with multimodal agents

100

eclair-agents

TreeStructure

Table Extraction Tool

CaffeConTroll

Interactive Model Iteration with Weak Supervision and Pre-Trained Embeddings

epoxy

Hyperbolic PCA via Horospherical Projections

HoroPCA

Structured matrices for compressing neural networks

structured-nets

Combating hidden stratification with GEORGE

hidden-stratification

Numba-based version of DimmWitted Gibbs sampler

numbskull

Model Patching: Closing the Subgroup Performance Gap with Data Augmentation

model-patching

Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models

skill-it

Public materials for the Fall 2016 offering of CS145

cs145-notebooks-2016

(ICML 2021) Mandoline: Model Evaluation under Distribution Shift

mandoline

A Learnable LSH Framework for Efficient NN Training

mongoose

Code release for the paper Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning

thanos-code

Weakly Supervised MRI Series Classification for the UK Biobank

ukb-cardiac-mri

Tuffy, a Markov Logic Network solver

tuffy

Java

snorkel-superglue

Applying Snorkel to SuperGLUE

Official code repository for Correct-N-Contrast

correct-n-contrast

ludwig-benchmarking-toolkit

Ludwig benchmark

smallfry

Code release for Type-Aware Bi-Encoders for Open-Domain Entity Retrieval

tabi

Low precision random Fourier features for kernel approximation

lp_rffs

Compiler for writing DeepDive applications in a Datalog-like language — ⚠️🚧🛑 REPO MOVED TO DEEPDIVE 👇🏿

ddlog

Scala

wonderbread

WONDERBREAD benchmark + dataset for BPM tasks

Reproducible code for Augmentation paper

augmentation_code

DimmWitted Gibbs Sampler in C++ — ⚠️🚧🛑 REPO MOVED TO DEEPDIVE 👉🏿

sampler

random_embedding

snorkel-biocorpus

DeepDive Biomedical Tools

ddbiolib

Omnivore Optimizer and Distributed CcT

bazaar

JavaScript

Omnivore

A study of the downstream instability of word embeddings

anchor-stability

Cross-domain data integration for named entity disambiguation in biomedical text

medical-ned-integration

The Genomics DeepDive project

dd-genomics

Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification

embroid

torchhalp

dimmwitted

Accelerated Stochastic Power Iteration with Momentum

Accelerated-PCA

Liger: Fusing Weak Supervision and Model Embeddings

liger

cross-modal-ws-demo

hyperE

treedlib

ivy-tutorial

An Introductory Tutorial for Ivy

Observational Supervision for Medical Image Classification using Gaze Data

observational

chinstrap

Code to generate kernel features using Gaussian quadrature

quadrature-features

Weakly supervised classification of adverse event reports from the FDA's MAUDE database.

icij-maude

DeepDive Librarian for managing all data sets we publish and receive

librarian

halp

bert-pretraining

D3M Model Search Component

d3m-model-search

elementary

Data services and APIs

Structure learning code from [ICML'19 paper](https://arxiv.org/abs/1903.05844)

dependency_model