qwopqwop200/pale-transformer-pytorch qwopqwop200/pale-transformer-pytorch

  • Stars
    star
    5
  • Rank 2,861,937 (Top 57 %)
  • Language
    Python
  • License
    MIT License
  • Created over 2 years ago
  • Updated over 2 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
qwopqwop200/pale-transformer-pytorch
github

qwopqwop200

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Pale Transformer implementation(Pale Transformer: A General Vision Transformer Backbone with Pale-Shaped Attention) This is an unofficial implementation. https://arxiv.org/abs/2112.14000

More Repositories

1

GPTQ-for-LLaMa

4 bits quantization of LLaMA using GPTQ
Python
2,957
star
2

lama-with-maskdino

automatic image inpainting (lama(with refinement) and maskdino)
Python
35
star
3

GPTQ-for-KoAlpaca

Python
14
star
4

SoftPool

softpool implementation(Refining activation downsampling with SoftPool) This is an unofficial implementation. https://arxiv.org/pdf/2101.00440v2.pdf
Python
14
star
5

MaxVIT-pytorch

MaxVIT implementation(MaxViT: Multi-Axis Vision Transformer) This is an unofficial implementation. https://arxiv.org/abs/2204.01697
Python
9
star
6

llama-danbooru-qlora

Jupyter Notebook
8
star
7

AutoQuant

Python
8
star
8

NatIR

NatIR: Image Restoration Using Neighborhood-Attention-Transformer
Python
6
star
9

Neighborhood-Attention-Transformer

NAT implementation(Neighborhood Attention Transformer) This is an unofficial implementation. https://arxiv.org/pdf/2204.07143.pdf
Python
6
star
10

KoLIMA

Jupyter Notebook
4
star
11

Magneto-pytorch

Magneto implementation(Foundation Transformers) This is an unofficial implementation. https://arxiv.org/abs/2210.06423
Python
3
star
12

MLP-Mixer-tf2

MLP-Mixer implementation(MLP-Mixer: An all-MLP Architecture for Vision) This is an unofficial implementation. https://arxiv.org/pdf/2105.01601v1.pdf
Python
3
star
13

Swin-MLP-Mixer

This code is a structure that combines swim-transformer and mlp mixer, and performance may be poor because I didnโ€™t train and test this model
Python
3
star
14

D-Adaptation-Adan

Adan with D-Adaptation automatic step-sizes
Python
2
star
15

halonet-tf2

halonet implementation(Scaling Local Self-Attention for Parameter Efficient Visual Backbones) This is an unofficial implementation.https://arxiv.org/pdf/2103.12731v2.pdf
Python
1
star
16

psnr_ssim_ycbcr

Code for calculating psnr and ssim in y channel in ycbcr.This code is based on BasicSR (https://github.com/xinntao/BasicSR).
Python
1
star
17

Subtitles-generator-with-whisper

Subtitles generator using whisper and translator
Python
1
star