libeineu/ODE-Transformer libeineu/ODE-Transformer

  • Stars
    star
    20
  • Rank 1,116,316 (Top 23 %)
  • Language
    Python
  • License
    Other
  • Created over 2 years ago
  • Updated almost 2 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
libeineu/ODE-Transformer
github

libeineu

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

This is a code repository for the ACL 2022 paper "ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generation", which redesigns the Transformer architecture from the ODE perspective via using high-order ODE solvers to enhance the residual connections.

More Repositories

1

Context-Aware

The implementation of "Does Multi-Encoder Help? A Case Study on Context-AwareNeural Machine Translation"
Python
38
star
2

GPKD

The codebase of paper：Learning Light-Weight Translation Models from Deep Transformer, which is accepted by AAAI2021 conference.
Python
11
star
3

SDT-Training

The implementation of "Shallow-to-Deep Training for Neural Machine Translation"
Python
10
star
4

UMST

Python
10
star