JetRunner/MetaDistil

Stars
80
Rank 401,988 (Top 8 %)
Language
Python
License
MIT License
Created over 3 years ago
Updated about 2 years ago

JetRunner/MetaDistil

JetRunner

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Code for ACL 2022 paper "BERT Learns to Teach: Knowledge Distillation with Meta Learning".

BERT-of-Theseus

⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).

SuperICL

Code for "Small Models are Valuable Plug-ins for Large Language Models"

PABEE

Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".

LaPraDoR

🦮 Code and pretrained models for Findings of ACL 2022 paper "LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrieval"

dogwhistle

Baseline code for NAACL 2021 paper "Blow the Dog Whistle: A Chinese Dataset for Cant Understanding with Common Sense and World Knowledge"

beyond-preserved-accuracy

Repo for EMNLP 2021 paper "Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression"

dope-score-chinese

Automatic metric for evaluating rap lyrics in Chinese (Mandarin).

TuPaTE

Code for EMNLP 2022 paper "Efficiently Tuned Parameters are Task Embeddings"

unihan-lm

The official repository for "UnihanLM: Coarse-to-Fine Chinese-Japanese Language Model Pretraining with the Unihan Database", AACL-IJCNLP 2020

GoBangX

A GoBang Game Built with Qt Quick

PaSST-EE

element-starterkit

A upgraded starter kit for Element UI generated by vue-cli including vuex and vue-router

pytorch-apex-docker

Up-to-date Dockerfile for PyTorch + apex