Discover joeljang/salient-span-masking Open Source project

Stars
2
Language
Python
Created about 3 years ago
Updated about 3 years ago

joeljang

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Code used for salient span masking first proposed in "REALM: Retrieval-Augmented Language Model Pre-Training"

music2video

Making an AI-generated music video from any song with Wav2CLIP and VQGAN-CLIP

Python

226

ELM

[ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning

Python

continual-knowledge-learning

[ICLR 2022] Towards Continual Knowledge Learning of Language Models

Python

RLPHF

Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging

Python

knowledge-unlearning

[ACL 2023] Knowledge Unlearning for Mitigating Privacy Risks in Language Models

Python

temporalwiki

[EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models

Python

Pretraining_T5_custom_dataset

Continue Pretraining T5 on custom dataset based on available pretrained model checkpoints

Python

negated-prompts-for-llms

[NeurIPS 2022 Workshop] A Case Study with Negated Prompts using T0 (3B, 11B), InstructGPT (350M-175B), GPT-3 (350M - 175B) & OPT (125M - 175B) LMs

Python

Remaining-Useful-Life-Prediction

Remaining Useful Life prediction of machinery using a novel data wrangling method and CNN-LSTM network for prediction

Python

FLM

All-in-one repository for Fine-tuning & Pretraining (Large) Language Models

Python

T5_QA

Pretraining & Finetuning T5 for CBQA

Python

Sequential-Targeting

Code for Sequential Targeting: A Continual Learning Approach for Data Imbalance in Text Classification

Python

azcopy12-script

Simple scripts for downloading/uploading files & directories from azure blob storage using Azcopy v12

Python

joeljang/salient-span-masking

joeljang

Reviews

Repository Details

More Repositories