Discover srush/ProbDist Open Source project by Sasha Rush (@srush)

Solve puzzles. Improve your pytorch.

5,464

Tensor-Puzzles

A tiny library for coding with large language models.

2,967

MiniChain

A fast llama2 decoder in pure Rust.

1,197

llama2.rs

Rust

998

Triton-Puzzles

Puzzles for learning Triton

What would you do with 1000 H100s...

895

LLM-Training-Puzzles

Implementation of https://srush.github.io/annotated-s4

797

annotated-s4

Annotated version of the Mamba paper

451

annotated-mamba

Autodiff-Puzzles

Transformer-Puzzles

Puzzles for exploring transformers

Live Python Notebooks with any Editor

281

streambook

An interactive exploration of Transformer programming.

277

raspy

do-we-need-attention

parallax

awesome-o1

GPTWorld

A puzzle to learn about prompting

Experiment of using Tangent to autodiff triton

104

awesome-ml-tracking

102

triton-autodiff

torch-queue

Silly twitter torch implementations.

LLM-Talk

torch-golf

A dynamic programming toolkit.

PyDecode

C++

VirtualTeaching

DIY setup for virtual teaching on ubuntu

mamba-primer

learns-dex

text2table

jax-lda

ProbTalk

Hierarchical-Bayes-Compiler

g9py

drop7

Tensor-Puzzles-Penzai

Proof-of-concept of global switching between numpy/jax/pytorch in a library.

mamba-scans

Blog post

anynp

transformers-bet

Amateur experiments with autodiff mechanics simulators

relax-decode

Java

aima-arguments

torch-mechanics

minitorch-rust

cs5781

Machine Learning Engineering

postgres-provanence

PowerEdit

A super-minimal Python-based video editor ⚡

Holder for a bunch of semirings used in ChartParsing

SemiRings

DiffRast

MRF-LM

Shell

TextBook

Command-line Facebook

Combined repo for nlp libs

hsNLP-

when I was 4 years old I was maimed by a giant pig

provenance

icfp2009

Annotated Transformer Blog Post

configure

some configuration file

Emacs Lisp

clustering

C++

annotated-transformer.github.io

BT-AI

srush-blog

An implementation of the Eisner Parser (described in "Bilexical Grammars and a Cubic-time parsing algorithm" ) in Haskell

Eisner-Parser

Finite State Machine lib for haskell

FSM

hplay

opennmt-gen

Shell

PhraseDep

C++

triton

tf-fork

srush-wiki

icfp2003

Race Car

icfp2008

hypergraph

Hypergraph specification

learns-triton

Training

Implementation of Huber-Law rejection sampling for bipartite graphs

bipartite-sampler

ezTVM

test_grade

haskell library for basic chart parsers

Chart-Parsing-

blog-twitter

sigmoidfit

Command line bindings for evernote

evernote

prof8

Experimental paper writing linter.

TeX

transforest

decoding-methods

blog

Create animations for LaTeX Beamer presentations.

nlp-course

beamer-animation

Duel

Art project for monadnack

nlp

twitter-simmons-sports

monadnack-project

peoplesounds

CutParse

Lattice

Penn-Treebank

Haskell library for the penn treebank management

icfp2020