Virchow2 · azureml v3 ↗
- source model id
- azureml/Virchow2@3
- hosting
- foundry-managed-compute
- platforms
- Microsoft Foundry
- license
- custom
- architecture
- input_modalities
- output_modalities
- capabilities
Virchow2 is a self-supervised vision transformer pretrained using 3.1M whole slide histopathology images. The model can be used as a tile-level feature extractor (frozen or finetuned) to achieve stat…
azureFoundry/azureml/Virchow2@3
Virchow2 is a self-supervised vision transformer pretrained using 3.1M whole slide histopathology images. The model can be used as a tile-level feature extractor (frozen or finetuned) to achieve state-of-the-art results for a wide variety of downstream computational pathology use cases.
Developed by: Paige, NYC, USA and Microsoft Research, Cambridge, MA USA Model Type: Image feature backbone Model Stats: Params (M): 632 Image size: 224 x 224 Model Architecture: Architecture: ViT-H/14 Patch size: 14 Layers: 32 Embedding dimension: 1280 Activation function: SwiGLU Attention heads: 16 LayerScale: true Register tokens: 4 Training Details: Precision: Mixed precision (fp16) Objective: Modified DINOv2 (https://doi.org/10.48550/arXiv.2304.07193) KoLeo regularizer replaced with kernel density estimator Crop-and-resize augmentation replaced with extended context translation Paper: Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathology https://arxiv.org/pdf/2408.00738 Pretraining Dataset: Internal dataset of 3.1 million whole slide images from Memorial Sloan Kettering Cancer Center, tiles sampled at 2.0, 1.0, 0.5 and 0.25 microns per pixel resolution (5x, 10x, 20x, and 40x magnification). License: CC-BY-NC-ND-4.0
Direct use Virchow2 intended to be used as a frozen feature extractor as the foundation for tile-level and whole slide-level classifiers.
Downstream use Virchow2 can be finetuned to adapt to specific tasks and/or datasets.
Terms of use
The Virchow2 Model and associated code are released under the CC-BY-NC-ND 4.0 license and may only be used for non-commercial, academic research purposes with proper attribution. Any commercial use, sale, or other monetization of the Virchow2 Model and its derivatives, which include models trained on outputs from the Virchow2 Model or datasets created from the Virchow2 Model, is prohibited and requires prior approval. By downloading /deploying the Virchow2 Model, you attest that all account information (affiliation, research use) is correct and up-to-date. By downloading/deploying the Virchow2 Model, you agree not to distribute, publish or reproduce a copy of the Virchow2 Model. If another user within your organization wishes to use the Virchow2 Model, they must register as an individual user and agree to comply with these terms of use. If you are a commercial entity, please contact the corresponding author. Further, by downloading/deploying the Virchow2 Model, you agree you will only use the Virchow2 Model for academic research purposes and will not use, or allow others to use, the Virchow2 Model to:
Citation
Please cite the following work if you used this model in your research.
Zimmermann, E., Vorontsov, E., Viret, J. et al. Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathology. arXiv preprint arXiv:2408.00738 (2024).
@article{zimmermann2024virchow2,
title={Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathology},
author={Eric Zimmermann and Eugene Vorontsov and Julian Viret and Adam Casson and Michal Zelechowski and George Shaikovski and Neil Tenenholtz and James Hall and Thomas Fuchs and Nicolo Fusi and Siqi Liu and Kristen Severson},
journal={arXiv preprint arXiv:2408.00738},
year={2024},
}
Disclaimer Virchow2 has been developed for research purposes and is not intended for diagnosis of real patients or projection/prediction of future disease possibilities.
Fairness evaluation cannot be completed due to limitations in the metadata. Underlying biases of the training datasets may not be well characterized and may not be representative of all demographics.
{
"input_data": {
"columns": [
"image"
],
"index":[0],
"data": [
["image1"]
]
}
}
Note:
[
{
"output": [
0.0, 0.0, 0.0, 0.0
]
}
]
Output will be image embeddings.
1–1 / 1
1–3 / 3
Microsoft Foundry · Model page ↗
1–1 / 1
These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.