tonyduan/transformer-blocks

Stars
10
Rank 1,807,489 (Top 36 %)
Language
Python
License
MIT License
Created over 5 years ago
Updated about 1 year ago

tonyduan/transformer-blocks

tonyduan

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Multi-Head Attention, Transformer, Perceiver, Linear Attention.

normalizing-flows

Neural Spline Flow, RealNVP, Autoregressive Flow, 1x1Conv in PyTorch.

mixture-density-network

Mixture density network implemented in PyTorch.

matrix-completion

Lightweight Python library for in-memory matrix completion.

diffusion

From-scratch diffusion model implemented in PyTorch.

rs4a

Randomized Smoothing of All Shapes and Sizes (ICML 2020).

Jupyter Notebook

snn

Self-normalizing neural network implemented in PyTorch.

conjugate-bayes

Conjugate Bayesian linear regression and distribution models in Python.

hte-prediction-rcts

Predicting treatment effects from RCTs (Circulation: CQO 2019).

ge-vae

Graph Embedding VAE (NeurIPS 2019 Workshop on Graph Representations).

gp-lib

Lightweight Python library for (sparse) GP regression.

graph-embeddings

Methods for embedding the structure of graphs into node features.

glm-lib

Lightweight Python library for GLM regression.

dotfiles

Personal dotfiles and logs of installed packages.

clj-yahoo-boss

Clojure client for the Yahoo BOSS Search API.

variational-autoencoders

Variational autoencoder implemented in PyTorch. Derives the ELBO, Log-Derivative trick, Reparameterization trick.

paper-template

Blank starter LaTeX code for writing papers and slides.

retinanet-detection

Single-shot CNN object detection with RetinaNet in PyTorch.

maskformer

Maskformer (Per-Pixel Classification is Not All You Need) in PyTorch.