Ofir Press (@ofirpress)
github

ofirpress

Twitter logo Share LinkedIn logo Share Facebook logo Share
  • Stars
    star
    1,356
  • Global Rank 22,742 (Top 0.8 %)
  • Followers 170
  • Following 8
  • Registered about 8 years ago
  • Most used languages
    Python
         66.7 %
    Lua
         11.1 %
    Jupyter Notebook
         11.1 %
    JavaScript
         11.1 %

Top repositories

1

attention_with_linear_biases

Code for the ALiBi method for transformer language models (ICLR 2022)
Python
493
star
2

YouMayNotNeedAttention

Code for the Eager Translation Model from the paper You May Not Need Attention
Python
292
star
3

self-ask

Code and data for "Measuring and Narrowing the Compositionality Gap in Language Models"
Jupyter Notebook
290
star
4

shortformer

Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.
Python
146
star
5

sandwich_transformer

This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer Models by Reordering their Sublayers.
Python
55
star
6

UsingTheOutputEmbedding

Code for the EACL paper "Using the Output Embedding to Improve Language Models" by Ofir Press and Lior Wolf
Lua
44
star
7

0plot

Use 0plot to automatically build matplotlib plots using ChatGPT.
JavaScript
19
star
8

PartialShuffle

Python
14
star
9

tstl_t5_bias

This is our implementation of the T5 bias for fairseq.
Python
2
star