alexisrozhkov/dilated-self-attention alexisrozhkov/dilated-self-attention

  • Stars
    star
    13
  • Rank 1,512,713 (Top 30 %)
  • Language
    Python
  • License
    MIT License
  • Created over 1 year ago
  • Updated over 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
alexisrozhkov/dilated-self-attention
github

alexisrozhkov

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Implementation of the dilated self attention as described in "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

More Repositories

1

extract_media_from_backup

Simple python script to extract media (photos and videos) from iPhone 6 backup directory
Python
13
star
2

RAS

Conversion of robust algebraic segementation from Matlab to C++
C++
1
star