Salesforce-BLIP-2-opt-2-7b-image-to-text · azureml v3

The `BLIP-2` model, utilizing OPT-2.7b (a large language model with 2.7 billion parameters), is presented in the <a href='https://arxiv.org/abs/2201.12086' target='_blank'>paper</a> titled "BLIP-2: B…

azureFoundry/azureml/Salesforce-BLIP-2-opt-2-7b-image-to-text@3

The BLIP-2 model, utilizing OPT-2.7b (a large language model with 2.7 billion parameters), is presented in the paper titled "BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models". This is a generic and efficient pre-training strategy that easily harvests development of pre-trained vision models and large language models (LLMs) for Vision-Language Pre-training (VLP). This model was made available in this repository.

BLIP-2 consists of 3 models: a CLIP-like image encoder, a Querying Transformer (Q-Former) and a large language model. The authors initialize the weights of the image encoder and large language model from pre-trained checkpoints and keep them frozen while training the Querying Transformer, which is a BERT-like Transformer encoder that maps a set of "query tokens" to query

Specifications & capabilities

Input
image
Output
text
Capabilities
visionInput

Provider specifications & access

1–1 / 1

Original sources

1–3 / 3

Microsoft Foundry · Model page ↗

Microsoft Foundry · Model documentation ↗

Microsoft Foundry · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace