• Stars
    star
    494
  • Rank 89,130 (Top 2 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created about 1 year ago
  • Updated 9 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

AlphaMissense

This package provides the AlphaMissense model implementation. This implementation is provided for reference alongside the AlphaMissense 2023 publication and will not be actively maintained moving forward.

We forked the AlphaFold repository and modified it to implement AlphaMissense.

What we provide:

  • Detailed implementation of the AlphaMissense model and training losses (modules_missense.py)

  • The data pipeline to create input features for inference (pipeline_missense.py). The data pipeline requires access to genetic databases for multiple sequence alignments and, if using spatial cropping, protein structures of the AlphaFold Database hosted in Google Cloud Storage. Please see the section for genetic databases and AFDB readme file) to learn how to access these datasets.

  • Pre-computed predictions for all possible human amino acid substitutions and missense variants (hosted here).

What we don’t provide:

  • The trained AlphaMissense model weights.

Access AlphaMissense predictions:

Predictions for human major transcripts and isoforms are provided here. You can use these files with the Ensembl VEP tool and AlphaMissense plug-in.

Installation

  1. Install all dependencies:
sudo apt install python3.11-venv aria2 hmmer
  1. Clone this repository and cd into it.
git clone https://github.com/deepmind/alphamissense.git
cd ./alphamissense
  1. Set up a Python virtual environment and install the Python dependencies:
python3 -m venv ./venv
venv/bin/pip install -r requirements.txt
venv/bin/pip install -e .
  1. Test the installation
venv/bin/python test/test_installation.py

Usage

Because we are not releasing the trained model weights, the code is not meant to be used for making new predictions, but serve as an implementation reference. We are releasing the data pipeline, model and loss function code.

The data pipeline requires a FASTA file (i.e. protein_sequence_file) which should contain all target sequences, and the genetic sequence databases outlined in the next section.

from alphamissense.data import pipeline_missense

protein_sequence_file = ...
pipeline = pipeline_missense.DataPipeline(
    jackhmmer_binary_path=...,  # Typically '/usr/bin/jackhmmer'.
    protein_sequence_file=protein_sequence_file,
    uniref90_database_path=DATABASES_DIR + '/uniref90/uniref90.fasta',
    mgnify_database_path=DATABASES_DIR + '/mgnify/mgy_clusters_2022_05.fa',
    small_bfd_database_path=DATABASES_DIR + '/small_bfd/bfd-first_non_consensus_sequences.fasta',
)

sample = pipeline.process(
    protein_id=...,  # Sequence identifier in the FASTA file.
    reference_aa=...,  # Single capital letter, e.g. 'A'.
    alternate_aa=...,
    position=...,  # Integer, note that the position is 1-based!
    msa_output_dir=msa_output_dir,
)

The model is implemented as a JAX module and can be instantiated for example as:

from alphamissense.model import config
from alphamissense.model import modules_missense

def _forward_fn(batch):
    model = modules_missense.AlphaMissense(config.model_config().model)
    return model(batch, is_training=False, return_representations=False)

random_seed = 0
prng = jax.random.PRNGKey(random_seed)

params = hk.transform(_forward_fn).init(prng, sample)
apply = jax.jit(hk.transform(_forward_fn).apply)
output = apply(params, prng, sample)

For example, at this point the score of the variant would be stored in output['logit_diff']['variant_pathogenicity'].

Genetic databases

AlphaMissense used multiple genetic (sequence) databases for multiple sequence alignments:

We refer to the AlphaFold repository for instructions on how to download these databases.

Citing this work

Any publication that discloses findings arising from using this source code should cite:

@article {AlphaMissense2023,
  author       = {Jun Cheng, Guido Novati, Joshua Pan, Clare Bycroft, Akvilė Žemgulytė, Taylor Applebaum, Alexander Pritzel, Lai Hong Wong, Michal Zielinski, Tobias Sargeant, Rosalia G. Schneider, Andrew W. Senior, John Jumper, Demis Hassabis, Pushmeet Kohli, Žiga Avsec},
  journal      = {Science},
  title        = {Accurate proteome-wide missense variant effect prediction with AlphaMissense},
  year         = {2023},
  doi          = {10.1126/science.adg7492},
  URL          = {https://www.science.org/doi/10.1126/science.adg7492},
}

Acknowledgements

AlphaMissense communicates with and/or references the following separate libraries and packages:

  • Abseil
  • Biopython
  • HMMER Suite
  • Haiku
  • Immutabledict
  • JAX
  • Matplotlib
  • NumPy
  • Pandas
  • SciPy
  • Tree
  • Zstandard We thank all their contributors and maintainers!

License and Disclaimer

This is not an officially supported Google product.

The information within the AlphaMissense Database and the model implementation is provided for theoretical modelling only, caution should be exercised in its use. This information is not intended to be a substitute for professional medical advice, diagnosis, or treatment, and does not constitute medical or other professional advice.

Copyright 2023 DeepMind Technologies Limited.

AlphaMissense Code License

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at https://www.apache.org/licenses/LICENSE-2.0.

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

AlphaMissense predictions License

AlphaMissense predictions are made available under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0) license. You can find details at: https://creativecommons.org/licenses/by-nc-sa/4.0/

Third-party software

Use of the third-party software, libraries or code referred to in the Acknowledgements section above may be governed by separate terms and conditions or license provisions. Your use of the third-party software, libraries or code is subject to any such terms and you should check that you can comply with any applicable restrictions or terms and conditions before use.

More Repositories

1

deepmind-research

This repository contains implementations and illustrative code to accompany DeepMind publications
Jupyter Notebook
13,132
star
2

alphafold

Open source code for AlphaFold.
Python
12,602
star
3

sonnet

TensorFlow-based neural network library
Python
9,769
star
4

mujoco

Multi-Joint dynamics with Contact. A general purpose physics simulator.
Jupyter Notebook
8,113
star
5

pysc2

StarCraft II Learning Environment
Python
8,001
star
6

lab

A customisable 3D platform for agent-based AI research
C
7,101
star
7

graph_nets

Build Graph Nets in Tensorflow
Python
5,352
star
8

graphcast

Python
4,517
star
9

open_spiel

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.
C++
4,231
star
10

alphageometry

Python
4,079
star
11

learning-to-learn

Learning to Learn in TensorFlow
Python
4,064
star
12

dm_control

Google DeepMind's software stack for physics-based simulation and Reinforcement Learning environments, using MuJoCo.
Python
3,793
star
13

acme

A library of reinforcement learning components and agents
Python
3,466
star
14

trfl

TensorFlow Reinforcement Learning
Python
3,136
star
15

dm-haiku

JAX-based neural network library
Python
2,848
star
16

alphatensor

Python
2,670
star
17

dnc

A TensorFlow implementation of the Differentiable Neural Computer.
Python
2,478
star
18

gemma

Open weights LLM from Google DeepMind.
Python
2,421
star
19

mctx

Monte Carlo tree search in JAX
Python
2,313
star
20

code_contests

C++
2,064
star
21

optax

Optax is a gradient processing and optimization library for JAX.
Python
1,670
star
22

kinetics-i3d

Convolutional neural network model for video classification trained on the Kinetics dataset.
Python
1,639
star
23

penzai

A JAX research toolkit for building, editing, and visualizing neural networks.
Python
1,639
star
24

mathematics_dataset

This dataset code generates mathematical question and answer pairs, from a range of question types at roughly school-level difficulty.
Python
1,621
star
25

bsuite

bsuite is a collection of carefully-designed experiments that investigate core capabilities of a reinforcement learning (RL) agent
Python
1,497
star
26

educational

Jupyter Notebook
1,398
star
27

jraph

A Graph Neural Network Library in Jax
Python
1,349
star
28

rc-data

Question answering dataset featured in "Teaching Machines to Read and Comprehend
Python
1,285
star
29

mujoco_menagerie

A collection of high-quality models for the MuJoCo physics engine, curated by Google DeepMind.
Jupyter Notebook
1,278
star
30

tapnet

Tracking Any Point (TAP)
Jupyter Notebook
1,266
star
31

rlax

Python
1,223
star
32

scalable_agent

A TensorFlow implementation of Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures.
Python
981
star
33

android_env

RL research on Android devices.
Python
977
star
34

neural-processes

This repository contains notebook implementations of the following Neural Process variants: Conditional Neural Processes (CNPs), Neural Processes (NPs), Attentive Neural Processes (ANPs).
Jupyter Notebook
969
star
35

mujoco_mpc

Real-time behaviour synthesis with MuJoCo, using Predictive Control
C++
959
star
36

dramatron

Dramatron uses large language models to generate coherent scripts and screenplays.
Jupyter Notebook
947
star
37

tree

tree is a library for working with nested data structures
Python
925
star
38

materials_discovery

Jupyter Notebook
866
star
39

xmanager

A platform for managing machine learning experiments
Python
815
star
40

open_x_embodiment

Jupyter Notebook
785
star
41

chex

Python
751
star
42

ferminet

An implementation of the Fermionic Neural Network for ab-initio electronic structure calculations
Python
707
star
43

reverb

Reverb is an efficient and easy-to-use data storage and transport system designed for machine learning research
C++
700
star
44

funsearch

Jupyter Notebook
699
star
45

alphadev

Python
688
star
46

pycolab

A highly-customisable gridworld game engine with some batteries included. Make your own gridworld games to test reinforcement learning agents!
Python
659
star
47

concordia

A library for generative social simulation
Python
634
star
48

hanabi-learning-environment

hanabi_learning_environment is a research platform for Hanabi experiments.
Python
614
star
49

recurrentgemma

Open weights language model from Google DeepMind, based on Griffin.
Python
603
star
50

ai-safety-gridworlds

This is a suite of reinforcement learning environments illustrating various safety properties of intelligent agents.
Python
577
star
51

meltingpot

A suite of test scenarios for multi-agent reinforcement learning.
Python
576
star
52

ithaca

Restoring and attributing ancient texts using deep neural networks
Jupyter Notebook
547
star
53

dqn

Lua/Torch implementation of DQN (Nature, 2015)
Lua
546
star
54

uncertain_ground_truth

Dermatology ddx dataset, Jax implementations of Monte Carlo conformal prediction, plausibility regions and statistical annotation aggregation from our recent work on uncertain ground truth (TMLR'23 and ArXiv pre-print).
Python
534
star
55

distrax

Python
527
star
56

long-form-factuality

Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".
Python
526
star
57

surface-distance

Library to compute surface distance based performance metrics for segmentation tasks.
Python
526
star
58

tracr

Python
496
star
59

dsprites-dataset

Dataset to assess the disentanglement properties of unsupervised learning methods
Jupyter Notebook
476
star
60

narrativeqa

This repository contains the NarrativeQA dataset. It includes the list of documents with Wikipedia summaries, links to full stories, and questions and answers.
Shell
452
star
61

clrs

Jupyter Notebook
444
star
62

lab2d

A customisable 2D platform for agent-based AI research
C++
420
star
63

dqn_zoo

DQN Zoo is a collection of reference implementations of reinforcement learning agents developed at DeepMind based on the Deep Q-Network (DQN) agent.
Python
406
star
64

alphastar

Python
403
star
65

dm_pix

PIX is an image processing library in JAX, for JAX.
Python
386
star
66

opro

official code for "Large Language Models as Optimizers"
Python
383
star
67

mathematics_conjectures

Jupyter Notebook
367
star
68

spriteworld

Spriteworld: a flexible, configurable python-based reinforcement learning environment
Python
367
star
69

torax

TORAX: Tokamak transport simulation in JAX
Python
361
star
70

dm_env

A Python interface for reinforcement learning environments
Python
343
star
71

dm_robotics

Libraries, tools and tasks created and used at DeepMind Robotics.
Python
341
star
72

spiral

We provide a pre-trained model for unconditional 19-step generation of CelebA-HQ images
C++
327
star
73

launchpad

Python
310
star
74

leo

Implementation of Meta-Learning with Latent Embedding Optimization
Python
302
star
75

enn

Python
291
star
76

streetlearn

A C++/Python implementation of the StreetLearn environment based on images from Street View, as well as a TensorFlow implementation of goal-driven navigation agents solving the task published in “Learning to Navigate in Cities Without a Map”, NeurIPS 2018
C++
285
star
77

gqn-datasets

Datasets used to train Generative Query Networks (GQNs) in the ‘Neural Scene Representation and Rendering’ paper.
Python
269
star
78

treescope

An interactive HTML pretty-printer for machine learning research in IPython notebooks.
Python
256
star
79

multi_object_datasets

Multi-object image datasets with ground-truth segmentation masks and generative factors.
Python
254
star
80

AQuA

A algebraic word problem dataset, with multiple choice questions annotated with rationales.
238
star
81

synjax

Python
238
star
82

grid-cells

Implementation of the supervised learning experiments in Vector-based navigation using grid-like representations in artificial agents, as published at https://www.nature.com/articles/s41586-018-0102-6
Python
236
star
83

card2code

A code generation dataset for generating the code that implements Hearthstone and Magic The Gathering card effects.
236
star
84

arnheim

Jupyter Notebook
235
star
85

torch-hdf5

Torch interface to HDF5 library
Lua
234
star
86

kfac-jax

Second Order Optimization and Curvature Estimation with K-FAC in JAX.
Python
231
star
87

dm_memorytasks

A set of 13 diverse machine-learning tasks that require memory to solve.
Python
221
star
88

Temporal-3D-Pose-Kinetics

Exploiting temporal context for 3D human pose estimation in the wild: 3D poses for the Kinetics dataset
Python
218
star
89

dm_alchemy

DeepMind Alchemy task environment: a meta-reinforcement learning benchmark
Python
197
star
90

neural_testbed

Jupyter Notebook
191
star
91

perception_test

Jupyter Notebook
184
star
92

jmp

JMP is a Mixed Precision library for JAX.
Python
183
star
93

neural_networks_chomsky_hierarchy

Neural Networks and the Chomsky Hierarchy
Python
183
star
94

xquad

180
star
95

nanodo

Python
180
star
96

pg19

179
star
97

spectral_inference_networks

Implementation of Spectral Inference Networks, ICLR 2019
Python
165
star
98

barkour_robot

Barkour Robot: Agile Quadruped Robots by Google DeepMind
C++
165
star
99

onetwo

Python
164
star
100

abstract-reasoning-matrices

Progressive matrices dataset, as described in: Measuring abstract reasoning in neural networks (Barrett*, Hill*, Santoro*, Morcos, Lillicrap), ICML2018
162
star