Discover @john-hewitt Open Source projects

John Hewitt (@john-hewitt)

john-hewitt

Stars
507
Global Rank 56,741 (Top 2 %)
Followers 154
Following 7
Registered about 10 years ago
Most used languages

Python
90.0 %

Jupyter Notebook
10.0 %
Location 🇺🇸 United States
Country Total Rank 14,683
Country Ranking

Python
2,648

Jupyter Notebook
9,471

structural-probes

Codebase for testing whether hidden states of neural networks encode discrete structures.

backpacks-flash-attn

The original Backpack Language Model implementation, a fork of FlashAttention

control-tasks

Repository describing example random control tasks for designing and interpreting neural probes

conditional-probing

Codebase for running (conditional) probing experiments

dyckkm-learning

Codebase implementing LMs for learning the Dyck-(k,m) bounded hierarchical language

truncation-sampling

Codebase describing experiments in Truncation Sampling as Language Model Desmoothing

Jupyter Notebook

dyckkm-constructions

Codebase implementing RNN constructions that generate Dyck-(k,m)

embed-init

Rough codebase for exploring initialization strategies for new word embeddings in pretrained LMs

ts-mauve-experiments

cs229-head-tracking

Code for analyzing mental health outcomes with VR head tracking data