Discover HazyResearch/wonderbread Open Source project

Resources for Data Centric AI

1,372

data-centric-ai

TeX

1,085

safari

Convolutions for Sequence Modeling

Creative interactive views of any dataset.

855

meerkat

Hyperbolic Graph Convolutional Networks in PyTorch.

821

hgcn

Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena

576

hyena-dna

Ask Me Anything language model prompting

566

ama_prompting

Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"

534

Language Modeling with the H3 State Space Model

525

This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes"

505

evaporate

Prompt programming with FMs.

475

manifest

Snorkel MeTaL: A framework for training models with multi-task weak supervision

436

metal

🌲 A tool for converting PDF into hOCR with text, tables, and figures being recognized and preserved.

422

pdftotree

A knowledge base construction engine for richly formatted data

413

fonduer

406

hyperbolics

Hyperbolic Embeddings

More interactive weak supervision with FlyingSquid

368

flyingsquid

An open science effort to benchmark legal reasoning in foundation models

311

legalbench

Building blocks for foundation models.

306

aisys-building-blocks

279

flash-fft-conv

FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores

Hyperbolic Knowledge Graph embeddings.

261

KGEmb

Self-Supervision for Named Entity Disambiguation at the Tail

245

bootleg

Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"

211

based

Hyperbolic Hierarchical Clustering.

199

HypHC

TART: A plug-and-play Transformer module for task-agnostic reasoning

188

TART

fly

tanda

Learning to Compose Domain-Specific Transformations for Data Augmentation

Code for SpaceTime 🌌⏱️. Proposed in Effectively Modeling Time Series with Simple Discrete State Spaces, ICLR 2023.

169

spacetime

Butterfly matrix multiplication in PyTorch

158

butterfly

Understand and test language model architectures on synthetic tasks.

158

zoology

hippo-code

babble

A system for generating training labels via natural language explanations

Your worst case is our best case.

145

EmptyHeaded

domino

blocking-tutorial

mindbender

Tools for iterative knowledge base development with DeepDive

CoffeeScript

116

reef

Automatically labeling training data

A collection of simple tutorials for using Fonduer

105

fonduer-tutorials

Foundation Models for Data Tasks

100

fm_data_tasks

TreeStructure

Table Extraction Tool

CaffeConTroll

Automating enterprise workflows with multimodal agents

eclair-agents

Interactive Model Iteration with Weak Supervision and Pre-Trained Embeddings

epoxy

Hyperbolic PCA via Horospherical Projections

HoroPCA

Structured matrices for compressing neural networks

structured-nets

Combating hidden stratification with GEORGE

hidden-stratification

Numba-based version of DimmWitted Gibbs sampler

numbskull

Model Patching: Closing the Subgroup Performance Gap with Data Augmentation

model-patching

Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models

skill-it

Public materials for the Fall 2016 offering of CS145

cs145-notebooks-2016

(ICML 2021) Mandoline: Model Evaluation under Distribution Shift

mandoline

A Learnable LSH Framework for Efficient NN Training

mongoose

Code release for the paper Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning

thanos-code

prefix-linear-attention

Tuffy, a Markov Logic Network solver

tuffy

Java

ukb-cardiac-mri

Weakly Supervised MRI Series Classification for the UK Biobank

Applying Snorkel to SuperGLUE

snorkel-superglue

Official code repository for Correct-N-Contrast

correct-n-contrast

ludwig-benchmarking-toolkit

Ludwig benchmark

Compiler for writing DeepDive applications in a Datalog-like language — ⚠️🚧🛑 REPO MOVED TO DEEPDIVE 👇🏿

ddlog

Scala

augmentation_code

Reproducible code for Augmentation paper

smallfry

Code release for Type-Aware Bi-Encoders for Open-Domain Entity Retrieval

tabi

Low precision random Fourier features for kernel approximation

lp_rffs

DimmWitted Gibbs Sampler in C++ — ⚠️🚧🛑 REPO MOVED TO DEEPDIVE 👉🏿

sampler

random_embedding

snorkel-biocorpus

bazaar

ddbiolib

DeepDive Biomedical Tools

A study of the downstream instability of word embeddings

anchor-stability

Omnivore Optimizer and Distributed CcT

Omnivore

Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification

embroid

The Genomics DeepDive project

dd-genomics

Cross-domain data integration for named entity disambiguation in biomedical text

medical-ned-integration

dimmwitted

torchhalp

cross-modal-ws-demo

hyperE

treedlib

Accelerated-PCA

Accelerated Stochastic Power Iteration with Momentum

Liger: Fusing Weak Supervision and Model Embeddings

liger

An Introductory Tutorial for Ivy

ivy-tutorial

chinstrap

Observational Supervision for Medical Image Classification using Gaze Data

observational

Code to generate kernel features using Gaussian quadrature

quadrature-features

Weakly supervised classification of adverse event reports from the FDA's MAUDE database.

icij-maude

DeepDive Librarian for managing all data sets we publish and receive

librarian

halp

bert-pretraining

D3M Model Search Component

d3m-model-search

elementary

Data services and APIs

Structure learning code from [ICML'19 paper](https://arxiv.org/abs/1903.05844)

dependency_model