Generative Tensorial Reinforcement Learning (GENTRL)
Supporting Information for the paper "Deep learning enables rapid identification of potent DDR1 kinase inhibitors".
The GENTRL model is a variational autoencoder with a rich prior distribution of the latent space. We used tensor decompositions to encode the relations between molecular structures and their properties and to learn on data with missing values. We train the model in two steps. First, we learn a mapping of a chemical space on the latent manifold by maximizing the evidence lower bound. We then freeze all the parameters except for the learnable prior and explore the chemical space to find molecules with a high reward.
Repository
In this repository, we provide an implementation of a GENTRL model with an example trained on a MOSES dataset.
To run the training procedure,
- Install RDKit to process molecules
- Install GENTRL model:
python setup.py install - Install MOSES from the repository
- Run the pretrain.ipynb to train an autoencoder
- Run the train_rl.ipynb to optimize a reward function