Generative Distributional Control
Generative Distributional Control (GDC) is a general framework for imposing constraints on samples of pretrained language models. The constraints can be either pointwise (e.g. all samples must be non-offensive) or distributional (e.g. a specified percentage of samples must mention females).
This repo contains code accompanying the following three papers:
/dpg: A Distributional Approach to Controlled Text Generation (ICLR 2021)/cdpg: Controlling Conditional Language Models without Catastrophic Forgetting (ICML 2022)/rm_vs_dm: On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgetting (NeurIPS 2022)