EvoDiff · azureml v1

# Key capabilities ## About this model EvoDiff can unconditionally sample diverse structurally-plausible proteins, generate intrinsically disordered regions, and scaffold structural motifs using only…

azureFoundry/azureml/EvoDiff@1

Key capabilities

About this model

EvoDiff can unconditionally sample diverse structurally-plausible proteins, generate intrinsically disordered regions, and scaffold structural motifs using only sequence information, challenging a paradigm in structure-based protein design.

Key model capabilities

Below are several use cases for EvoDiff. Currently, Azure AI Foundry supports unconditional or conditional design with EvoDiff-Seq. To use EvoDiff-MSA, we point you to our github repository for more information.

  1. Unconditional generation with EvoDiff-Seq or EvoDiff-MSA(https://github.com/microsoft/evodiff/blob/main/README.md#unconditional-generation-with-evodiff-msa)
  2. Conditional sequence generation
    1. Evolution-guided protein generation with EvoDiff-MSA
    2. Generating intrinsically disordered regions with EvoDiff-Seq and EvoDiff-MSA
    3. Scaffolding functional motifs with EvoDiff-Seq and EvoDiff-MSA

Use cases

See Responsible AI for additional considerations for responsible use.

Key use cases

Below are several use cases for EvoDiff. Currently, Azure AI Foundry supports unconditional or conditional design with EvoDiff-Seq. To use EvoDiff-MSA, we point you to our github repository for more information.

Out of scope use cases

This model is intended for use on protein sequences. It is not meant for natural language or other biological sequences, such as DNA sequences. This model will not generate sequences that are not proteins. This includes cases such as trying to generate other biological sequences, such as DNA sequences, or natural language. In other words, the model will perform best on data within the data distribution, which includes protein sequences and multiple sequence alignments (MSAs).

Pricing

Pricing is based on a number of factors, including deployment type and tokens used. See pricing details here.

Technical specs

We trained all EvoDiff sequence models on 42M sequences from UniRef50 using a dilated convolutional neural network architecture introduced in the CARP protein masked language model. We trained 38M-parameter and 640M-parameter versions for each forward corruption scheme and for left-to-right autoregressive (LRAR) decoding.

Training cut-off date

The provider has not supplied this information.

Training time

  • Hardware Type: 32GB NVIDIA V100 GPUs
  • Hours used: 4,128 (14 days per sequence model, 10 days per MSA model)
  • Cloud Provider: Azure
  • Compute Region: East US
  • Carbon Emitted: 485.21 kg

Input formats

The provider has not supplied this information.

Output formats

The provider has not supplied this information.

Supported languages

The provider has not supplied this information.

Sample JSON response

The provider has not supplied this information.

Model architecture

We investigated two types of forward processes for diffusion over discrete data modalities to determine which would be most effective. In order-agnostic autoregressive diffusion OADM, one amino acid is converted to a special mask token at each step in the forward process. After T=LT=L steps, where LL is the length of the sequence, the entire sequence is masked. We additionally designed discrete denoising diffusion probabilistic models D3PM for protein sequences. In EvoDiff-D3PM, the forward process corrupts sequences by sampling mutations according to a transition matrix, such that after TT steps the sequence is indistinguishable from a uniform sample over the amino acids. In the reverse process for both, a neural network model is trained to undo the previous corruption. The trained model can then generate new sequences starting from sequences of masked tokens or of uniformly-sampled amino acids for EvoDiff-OADM or EvoDiff-D3PM, respectively.

Long context

The provider has not supplied this information.

Optimizing model performance

The provider has not supplied this information.

Additional assets

For all other models in the EvoDiff suite, please see our github repository. We provide all generated sequences on the EvoDiff Zenodo.

Training disclosure

Training, testing and validation

We obtain sequences from the Uniref50 dataset, which contains approximately 42 million protein sequences. The Multiple Sequence Alignments (MSAs) are from the OpenFold dataset, which contains 401,381 MSAs for 140,000 unique Protein Data Bank (PDB) chains and 16,000,000 UniClust30 clusters. The intrinsically disordered regions (IDR) data was obtained from the Reverse Homology GitHub. For the scaffolding structural motif benchmark, we provide pdb and fasta files used for conditionally generating sequences in the examples/scaffolding-pdbs folder. We also provide pdb files used for conditionally generating MSAs in the examples/scaffolding-msas folder.

Distribution

Distribution channels

The provider has not supplied this information.

More information

Start using EvoDiff on Azure AI Foundry with this Jupyter Notebook.

For full details, please refer to our preprint.

Specifications & capabilities

Input
text
Output
text
Max output · tokens
4096

Provider specifications & access

1–1 / 1

EvoDiff · azureml v1 ↗

source model id
azureml/EvoDiff@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
MIT
max output tokens
4096
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    Source specification observations

    1–1 / 1

    azureFoundry ↗

    field
    max_output_tokens
    value
    4096
    normalized value
    4096
    scope
    source-model
    source id
    azureFoundry
    confidence
    1

    Original sources

    1–3 / 3

    Microsoft Foundry · Model page ↗

    Microsoft Foundry · Model documentation ↗

    Microsoft Foundry · Catalog ↗

    Source links

    1–1 / 1

    Explore more models

    Models

    Loading
    EVIDENCE / COMPARISON

    Benchmarks

    Explore every benchmark

    Loading

    These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

    Install TensorTrace