joeljang/Pretraining_T5_custom_dataset

Stars
40
Rank 680,660 (Top 14 %)
Language
Python
Created over 3 years ago
Updated over 3 years ago

joeljang/Pretraining_T5_custom_dataset

joeljang

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Continue Pretraining T5 on custom dataset based on available pretrained model checkpoints

music2video

Making an AI-generated music video from any song with Wav2CLIP and VQGAN-CLIP

ELM

[ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning

continual-knowledge-learning

[ICLR 2022] Towards Continual Knowledge Learning of Language Models

RLPHF

Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging

knowledge-unlearning

[ACL 2023] Knowledge Unlearning for Mitigating Privacy Risks in Language Models

temporalwiki

[EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models

negated-prompts-for-llms

[NeurIPS 2022 Workshop] A Case Study with Negated Prompts using T0 (3B, 11B), InstructGPT (350M-175B), GPT-3 (350M - 175B) & OPT (125M - 175B) LMs

Remaining-Useful-Life-Prediction

Remaining Useful Life prediction of machinery using a novel data wrangling method and CNN-LSTM network for prediction

FLM

All-in-one repository for Fine-tuning & Pretraining (Large) Language Models

T5_QA

Pretraining & Finetuning T5 for CBQA

salient-span-masking

Code used for salient span masking first proposed in "REALM: Retrieval-Augmented Language Model Pre-Training"

Sequential-Targeting

Code for Sequential Targeting: A Continual Learning Approach for Data Imbalance in Text Classification

azcopy12-script

Simple scripts for downloading/uploading files & directories from azure blob storage using Azcopy v12