SimiaoZuo/MoEBERT

Stars
94
Rank 354,928 (Top 8 %)
Language
Python
License
Apache License 2.0
Created over 2 years ago
Updated over 2 years ago

SimiaoZuo/MoEBERT

SimiaoZuo

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).

Transformer-Hawkes-Process

Code for Transformer Hawkes Process, ICML 2020.

Stackelberg-Adv

Code for SALT: Stackelberg Adversarial Regularization, EMNLP 2021.

Caching-Adv

Code for ARCH: Adversarial Regularization with Caching, Findings of EMNLP 2021.