• Stars
    star
    25
  • Rank 952,314 (Top 19 %)
  • Language
    Python
  • License
    MIT License
  • Created over 2 years ago
  • Updated over 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

PyTorch implementation of Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation

More Repositories

1

storyteller

Multimodal AI Story Teller, built with Stable Diffusion, GPT, and neural text-to-speech
Python
489
star
2

koclip

KoCLIP: Korean port of OpenAI CLIP, in Flax
Python
139
star
3

deep-malware-detection

A neural approach to malware detection in portable executables
Python
71
star
4

wordwise

N-gram keyword extraction using spaCy and pretrained language models
Python
62
star
5

ensemble-transformers

Ensembling Hugging Face transformers made easy
Python
59
star
6

g-mlp

PyTorch implementation of Pay Attention to MLPs
Python
39
star
7

param-share-transformer

PyTorch implementation of Lessons on Parameter Sharing across Layers in Transformers
Python
25
star
8

fnet

PyTorch implementation of FNet: Mixing Tokens with Fourier transforms
Python
25
star
9

mlp-mixer

PyTorch implementation of MLP-Mixer: An all-MLP Architecture for Vision
Python
20
star
10

conformer

PyTorch implementation of Conformer: Convolution-augmented Transformer for Speech Recognition
Python
13
star
11

realformer

PyTorch implementation of RealFormer: Transformer Likes Residual Attention
Python
11
star
12

jaketae.github.io

Personal blog with Jupyter notebooks
Jupyter Notebook
11
star
13

vit-breast-cancer

Transfer learning pretrained vision transformers for breast histopathology
Python
9
star
14

lm-identifier

A toolkit for identifying pretrained language models from potentially AI-generated text
Python
9
star
15

tupe

PyTorch implementation of Rethinking Positional Encoding in Language Pre-training
Python
7
star
16

fastapi-bert

Fine-tuning and deploying BERT through FastAPI
Jupyter Notebook
6
star
17

ml-from-scratch

Machine learning algorithms implemented from scratch with NumPy
Python
4
star
18

pygrad

Pure Python autograd library based on NumPy
Python
4
star
19

auto-tagger

Fine-tuning and zero-shot learning with transformers to automatically tag my study blog posts
Python
4
star
20

res-mlp

PyTorch implementation of ResMLP: Feedforward networks for image classification with data-efficient training
Python
3
star
21

graph-neural-ode

Graph neural ordinary differential equations
Python
3
star
22

image-classifier

Image classifier web application based on MobileNet, built using Flask, TensorFlow, and Matplotlib
HTML
2
star
23

dotfiles

Minimalist dotfiles and personal preferences
Shell
1
star
24

docker-django

Python
1
star