fe1ixxu/Stratified_Mixture_of_Experts fe1ixxu/Stratified_Mixture_of_Experts

  • Stars
    star
    2
  • Language
    Python
  • License
    MIT License
  • Created over 1 year ago
  • Updated about 1 year ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
fe1ixxu/Stratified_Mixture_of_Experts
github

fe1ixxu

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

This is the repository for our EMNLP 2023 paper: Towards Being Parameter-Efficient: A Stratified Sparsely Activated Transformer with Dynamic Capacity.

More Repositories

1

ALMA

State-of-the-art LLM-based translation models.
Ruby
375
star
2

BiBERT

This is the repository of the EMNLP 2021 paper "BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation".
Python
31
star
3

CPO_SIMPO

This repository contains the joint use of CPO and SimPO method for better reference-free preference learning methods.
Python
24
star
4

MIMO_OFDM

k-Modular Quadratic Programming Algorithm for PAPR in MIMO OFDM
MATLAB
11
star
5

Intra-Distillation

This is the repository for our EMNLP 2022 paper "The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains".
Python
9
star
6

VT-STOWER

Roff
7
star
7

Gradual-Finetune

Python
5
star
8

Contextual_Mapping

Python
3
star
9

LMS_FD

This is the repository for our EMNLP 2023 paper: Condensing Multilingual Knowledge with Lightweight Language-Specific Modules.
Python
3
star
10

Mixed-Gradient-Few-Shot

This is the repository of the Findings of NAACL 2022 paper "Por Qué Não Utiliser Alla Språk? Mixed Training with Gradient Optimization in Few-Shot Cross-Lingual Transfer".
Shell
3
star
11

ZeroShot-CrossLing-Parsing

Python
2
star
12

MoAdapter

Python
1
star
13

ISSS

Invisble Seccurity Signature System
Python
1
star
14

BETTER_MMT

Python
1
star