attention

several types of attention modules written in PyTorch

Griffin

Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

Knowledge-Distillation

Implementation of Distilling the Knowledge in a Neural Network https://arxiv.org/pdf/1503.02531.pdf

variant_extractor

Extracting candidate genes and variants