BiomedCLIP-PubMedBERT_256-vit_base_patch16_224 · azureml v1
BiomedCLIP is a biomedical vision-language foundation model that is pretrained on PMC-15M, a dataset of 15 million figure-caption pairs extracted from biomedical research articles in PubMed Central, …
azureFoundry/azureml/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224@1
BiomedCLIP is a biomedical vision-language foundation model that is pretrained on PMC-15M, a dataset of 15 million figure-caption pairs extracted from biomedical research articles in PubMed Central, using contrastive learning. It uses PubMedBERT as the text encoder and Vision Transformer as the image encoder, with domain-specific adaptations. It can perform various vision-language processing (VLP) tasks such as cross-modal retrieval, image classification, and visual question answering. BiomedCLIP establishes new state of the art in a wide range of standard datasets, and substantially outperforms prior VLP approaches:
Citation
@misc{https://doi.org/10.48550/arXiv.2303.00915,
doi = {10.48550/ARXIV.2303.00915},
url = {https://arxiv.org/abs/2303.00915},
author = {Zhang,
Specifications & capabilities
Provider specifications & access
1–1 / 1
- source model id
- azureml/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224@1
- hosting
- foundry-managed-compute
- license
- mit
Explore more models