• Stars
    star
    189
  • Rank 204,649 (Top 5 %)
  • Language
    Jupyter Notebook
  • License
    Other
  • Created over 8 years ago
  • Updated over 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Evolutionary couplings from protein and RNA sequence alignments

build_and_test Actions Status PyPI version

EVcouplings

Predict protein structure, function and mutations using evolutionary sequence covariation.

Installation and setup

Installing the Python package

If you are simply interested in using EVcouplings as a library, installing the Python package is all you need to do (unless you use functions that depend on external tools). If you want to run the evcouplings application (alignment generation, model parameter inference, structure prediction, etc.) you will also need to follow the sections on installing external tools and databases.

Requirements

EVcouplings requires a Python >= 3.5 installation. Since it depends on some packages that can be tricky to install using pip (numba, numpy, ...), we recommend using the Anaconda Python distribution. In case you are creating a new conda environment or using miniconda, please make sure to run conda install anaconda before running pip, or otherwise the required packages will not be present.

Installation

To install the latest version of EVcouplings on PyPI,

pip install evcouplings

To obtain the latest development version of EVcouplings from the github repository, run

pip install https://github.com/debbiemarkslab/EVcouplings/archive/develop.zip

and to update to the latest version after previously installing EVcouplings from the repository, run

pip install -U --no-deps https://github.com/debbiemarkslab/EVcouplings/archive/develop.zip

Installation will take seconds.

External software tools

After installation and before running compute jobs, the paths to the respective binaries of the following external tools have to be set in your EVcouplings job configuration file(s).

plmc (required)

Tool for inferring undirected statistical models from sequence variation. Download and install plmc to a directory of your choice from the plmc github repository according to the included documentation.

For compatibility with evcouplings, please compile using

make all-openmp32

jackhmmer (required)

Download and install HMMER from the HMMER webpage to a directory of your choice.

HHsuite (optional)

evcouplings uses the hhfilter tool to filter sequence alignments. Installation is only required if you need this functionality.

Download and install HHsuite from the HHsuite github repository to a directory of your choice.

CNSsolve 1.21 (optional)

evcouplings uses CNSsolve for computing 3D structure models from coupled residue pairs. Installation is only required if you want to run the fold stage of the computational pipeline.

Download and unpack a compiled version of CNSsolve 1.21 to a directory of your choice. No further setup is necessary, since evcouplings takes care of setting the right environment variables internally without relying on the included shell script cns_solve_env (you will have to put the path to the cns binary in your job config file however, e.g. cns_solve_1.21/intel-x86_64bit-linux/bin/cns).

PSIPRED (optional)

evcouplings uses PSIPRED for secondary structure prediction, to generate secondary structure distance and dihedral angle restraints for 3D structure computation. Installation is only required if you want to run the fold stage of the computational pipeline, and do not supply your own secondary structure predictions.

Download and install PSIPRED according to the instructions in the included README file.

maxcluster (optional)

evcouplings uses maxcluster to compare predicted 3D structure models to experimental protein structures, if there are any for the target protein or one of its homologs. Installation is only required if you want to run the fold stage of the computational pipeline.

Download maxcluster and place it in a directory of your choice.

Databases

After download and before running compute jobs, the paths to the respective databases have to be set in your EVcouplings job configuration file(s).

Automatic database setup

The evcouplings application minimally needs a sequence database for alignment generation, and structure mapping information for comparison of evolutionary couplings to 3D structures.

Sequence and structure mapping databases for EVcouplings can be automatically downloaded using the included command line tool evcouplings_dbupdate. This tool will fetch the UniProt (SwissProt/TrEMBL), UniRef100 and UniRef90 databases, and generate SIFTS-based structure mapping tables.

Please see

evcouplings_dbupdate --help

for how to download the respective databases. Note that this may take a while, especially the generation of post-processed SIFTS mapping files.

Sequence databases for EVcomplex

Running the EVcouplings pipeline for protein complexes (aka EVcomplex) requires two pre-computed databases. You can download these databases here:

ena_genome_location_table: https://marks.hms.harvard.edu/evcomplex_databases/cds_pro_2017_02.txt uniprot_to_embl_table: https://marks.hms.harvard.edu/evcomplex_databases/idmapping_uniprot_embl_2017_02.txt

Save these databases in your local environment, and then add the paths to the local copies of these databases to your config file for the complex pipeline.

In future releases these databases will be generated automatically.

Other sequence databases

You can however use any sequence database of your choice in FASTA format if you prefer to. The database for any particular job needs to be defined in the job configuration file ("databases" section) and set as the input database in the "alignment" section.

Structure and mapping databases

Relevant PDB structures for comparison of ECs and 3D structure predictions will be automatically fetched from the web in the new compressed MMTF format on a per-job basis. You can however also pre-download the entire PDB and place the structures in a directory if you want to (and set pdb_mmtf_dir in your job configuration).

Uniprot to PDB index mapping files will be automatically generated by EVcouplings based on the SIFTS database. You can either generate the files by running evcouplings_dbupdate (see above, preferred), or by pointing the sifts_mapping_table and sifts_sequence_db configuration parameters to file paths inside an already existing directory. If these files do not yet exist, they will be created by fetching and integrating data from the web (this may take a while) when the pipeline is first run and saved under the given file paths.

Documentation and tutorials

Please refer to the Jupyter notebooks in the notebooks subdirectory on how to

  • edit configuration files
  • run jobs
  • use EVcouplings as a Python library

Documentation for the source code is available at readthedocs.

License

EVcouplings is available under the MIT license, with the exception of the included CNS input scripts (please see LICENSE for details).

References

Please cite the following reference for the EVcouplings Python package;

Hopf T. A., Green A. G., Schubert B., et al. The EVcouplings Python framework for coevolutionary sequence analysis. Bioinformatics 35, 1582–1584 (2019)

Also consider citing the following references, which introduced the methods integrated by the EVcouplings Python package:

Marks D. S., Colwell, L. J., Sheridan, R., Hopf, T.A., Pagnani, A., Zecchina, R., Sander, C. Protein 3D structure computed from evolutionary sequence variation. PLOS ONE 6(12), e28766 (2011)

Hopf T. A., Colwell, L. J., Sheridan, R., Rost, B., Sander, C., Marks, D. S. Three-dimensional structures of membrane proteins from genomic sequencing. Cell 149, 1607-1621 (2012)

Marks, D. S., Hopf, T. A., Sander, C. Protein structure prediction from sequence variation. Nature Biotechnology 30, 1072–1080 (2012)

Hopf, T. A., Schärfe, C. P. I., Rodrigues, J. P. G. L. M., Green, A. G., Kohlbacher, O., Sander, C., Bonvin, A. M. J. J., Marks, D. S. Sequence co-evolution gives 3D contacts and structures of protein complexes. eLife Sep 25;3 (2014)

Hopf, T. A., Ingraham, J. B., Poelwijk, F.J., Schärfe, C.P.I., Springer, M., Sander, C., & Marks, D. S. (2017). Mutation effects predicted from sequence co-variation. Nature Biotechnology 35, 128–135 doi:10.1038/nbt.3769

Green, A. G. and Elhabashy, H., Brock, K. P., Maddamsetti, R., Kohlbacher, O., Marks, D. S. (2021) Large-scale discovery of protein interactions at residue resolution using co-evolution calculated from genomic sequences. Nature Communications 12, 1396. https://doi.org/10.1038/s41467-021-21636-z

Contributors

EVcouplings is developed in the labs of Debora Marks and Chris Sander at Harvard Medical School.

  • Thomas Hopf (development lead)
  • Anna G. Green
  • Benjamin Schubert
  • Sophia Mersmann
  • Charlotta Schärfe
  • Agnes Toth-Petroczy
  • John Ingraham
  • Rob Sheridan
  • Christian Dallago
  • Joe Min

More Repositories

1

DeepSequence

A generative latent variable model for biological sequence families.
Python
160
star
2

plmc

Inference of couplings in proteins and RNAs from sequence variation
C
98
star
3

SeqDesign

Protein design and variant prediction using autoregressive generative models
Python
65
star
4

EVmutation

Mutation effects predicted from sequence co-variation
HTML
45
star
5

EVzoom

Visually explore covariation in protein families
JavaScript
34
star
6

neural-fingerprint-theano

Visual Convolutional Neural Graph Fingerprints in Theano/Lasagne
HTML
32
star
7

variational-synthesis

Repository for the paper "Optimal design of stochastic DNA synthesis protocols based on generative sequence models" (Weinstein et al., AISTATS, 2022).
Python
25
star
8

NEMO

Learning protein structure with a differentiable simulator
Python
25
star
9

BEAR

This repository is for the paper "A generative nonparametric Bayesian model for whole genomes"
Python
12
star
10

MuE

A package for making MuE observation models in Edward2.
Python
12
star
11

3D_from_DMS_Extended_Data

Jupyter Notebook
10
star
12

variants_pharmacogenes

This repository contains the code used to analyse data and produce figures for the manuscript "Genetic variation in human drug-related genes"
Jupyter Notebook
8
star
13

persistent-vi

Variational Bayes for discrete undirected models
C
7
star
14

detectDesign

toolkit for finding likely cas9 off-target binding and effect on gene expression, designing sgRNAs and pairs of sgRNAs with minimal off-target effect on gene-expression
Jupyter Notebook
7
star
15

nanobody-polyreactivity

Polyreactivity Website
Python
6
star
16

GELMMnet

Generalized linear mixed model elastic net
Jupyter Notebook
3
star