john-hewitt/backpacks-flash-attn john-hewitt/backpacks-flash-attn

  • Stars
    star
    54
  • Rank 541,894 (Top 11 %)
  • Language
    Python
  • License
    BSD 3-Clause "New...
  • Created over 1 year ago
  • Updated over 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
john-hewitt/backpacks-flash-attn
github

john-hewitt

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

The original Backpack Language Model implementation, a fork of FlashAttention

More Repositories

1

structural-probes

Codebase for testing whether hidden states of neural networks encode discrete structures.
Python
364
star
2

control-tasks

Repository describing example random control tasks for designing and interpreting neural probes
Python
29
star
3

conditional-probing

Codebase for running (conditional) probing experiments
Python
21
star
4

dyckkm-learning

Codebase implementing LMs for learning the Dyck-(k,m) bounded hierarchical language
Python
12
star
5

truncation-sampling

Codebase describing experiments in Truncation Sampling as Language Model Desmoothing
Jupyter Notebook
9
star
6

dyckkm-constructions

Codebase implementing RNN constructions that generate Dyck-(k,m)
Python
8
star
7

embed-init

Rough codebase for exploring initialization strategies for new word embeddings in pretrained LMs
Python
7
star
8

ts-mauve-experiments

Python
2
star
9

cs229-head-tracking

Code for analyzing mental health outcomes with VR head tracking data
Python
1
star