Salesforce-BLIP-2-opt-2-7b-image-to-text · azureml v5
The `BLIP-2` model, utilizing OPT-2.7b (a large language model with 2.7 billion parameters), is presented in the <a href='https://arxiv.org/abs/2201.12086' target='_blank'>paper</a> titled "BLIP-2: B…
azureFoundry/azureml/Salesforce-BLIP-2-opt-2-7b-image-to-text@5
The BLIP-2 model, utilizing OPT-2.7b (a large language model with 2.7 billion parameters), is presented in the paper titled "BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models". This is a generic and efficient pre-training strategy that easily harvests development of pre-trained vision models and large language models (LLMs) for Vision-Language Pre-training (VLP). This model was made available in this repository.
BLIP-2 consists of 3 models: a CLIP-like image encoder, a Querying Transformer (Q-Former) and a large language model. The authors initialize the weights of the image encoder and large language model from pre-trained checkpoints and keep them frozen while training the Querying Transformer, which is a BERT-like Transformer encoder that maps a set of "query tokens" to query
Specifications & capabilities
- Input
- image
- Output
- text
- Capabilities
- visionInput
Provider specifications & access
1–1 / 1
- source model id
- azureml/Salesforce-BLIP-2-opt-2-7b-image-to-text@5
- hosting
- foundry-managed-compute
- license
- mit
Explore more models