Jina AI: Jina Clip v1

Jina CLIP v1 revolutionizes multimodal AI by being the first model to excel equally in both text-to-text and text-to-image retrieval tasks. Unlike traditional CLIP models that struggle with text-only…

jina/jina-clip-v1

Jina CLIP v1 revolutionizes multimodal AI by being the first model to excel equally in both text-to-text and text-to-image retrieval tasks. Unlike traditional CLIP models that struggle with text-only scenarios, this model achieves state-of-the-art performance across all retrieval combinations while maintaining a remarkably compact 223M parameter size. The model addresses a critical industry challenge by eliminating the need for separate models for text and image processing, reducing system complexity and computational overhead. For teams building search systems, recommendation engines, or content analysis tools, Jina CLIP v1 offers a single, efficient solution that handles both text and visual content with exceptional accuracy.

Specifications & capabilities

Input
text, image
Output
embeddings
Context window · tokens
8192
Embedding dimensions
768
Published model ID
jina-clip-v1
Capabilities
embeddings, multimodal, visionInput

Evaluations

1–6 / 6

MTEB

69.955%

source id
mteb
leaderboard name
MTEB Clustering
dimension
embedding
metric
Average task score
rank
47
sample size
5
aggregation scope
splits
  • test
  • valid
subsets
  • default
task_count
5
task_names
  • CIFAR100Clustering
  • CIFAR10Clustering
  • ImageNet10Clustering
  • ImageNetDog15Clustering
  • TinyImageNetClustering
sample_size
5
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 06150c7c382d7a4faedc7d5a0d8cdb59308968f4
source model id
jinaai/jina-clip-v1
Original result ↗

MTEB

86.279%

source id
mteb
leaderboard name
MTEB Classification
dimension
embedding
metric
Average task score
rank
64
sample size
2
aggregation scope
splits
  • test
  • validation
subsets
  • default
task_count
2
task_names
  • Food101Classification
  • OxfordFlowersClassification
sample_size
2
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 06150c7c382d7a4faedc7d5a0d8cdb59308968f4
source model id
jinaai/jina-clip-v1
Original result ↗

MTEB

56.739%

source id
mteb
leaderboard name
MTEB Other
dimension
embedding
metric
Average task score
rank
321
sample size
57
aggregation scope
splits
  • test
  • validation
subsets
  • default
task_count
57
task_names
  • AROCocoOrder
  • AROFlickrOrder
  • AROVisualAttribution
  • AROVisualRelation
  • BLINKIT2IMultiChoice
  • BLINKIT2TMultiChoice
  • Birdsnap
  • BirdsnapZeroShot
  • CIFAR10
  • CIFAR100
  • CIFAR100ZeroShot
  • CIFAR10ZeroShot
  • CLEVRCountZeroShot
  • CLEVRZeroShot
  • CVBenchCount
  • CVBenchDepth
  • CVBenchDistance
  • CVBenchRelation
  • Caltech101
  • Caltech101ZeroShot
  • Country211
  • Country211ZeroShot
  • DTD
  • DTDZeroShot
  • EuroSAT
  • EuroSATZeroShot
  • FER2013
  • FER2013ZeroShot
  • FGVCAircraft
  • FGVCAircraftZeroShot
  • Food101ZeroShot
  • GTSRB
  • GTSRBZeroShot
  • ImageCoDe
  • Imagenet1k
  • Imagenet1kZeroShot
  • MNIST
  • MNISTZeroShot
  • OxfordPets
  • OxfordPetsZeroShot
  • PatchCamelyon
  • PatchCamelyonZeroShot
  • RESISC45
  • RESISC45ZeroShot
  • RenderedSST2
  • STL10
  • STL10ZeroShot
  • SUN397
  • SUN397ZeroShot
  • SciMMIR
  • StanfordCars
  • StanfordCarsZeroShot
  • SugarCrepe
  • UCF101
  • UCF101ZeroShot
  • VOC2007
  • Winoground
sample_size
57
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 06150c7c382d7a4faedc7d5a0d8cdb59308968f4
source model id
jinaai/jina-clip-v1
Original result ↗

MTEB

53.188%

source id
mteb
leaderboard name
MTEB Semantic Similarity
dimension
embedding
metric
Average task score
rank
456
sample size
40
aggregation scope
splits
  • dev
  • test
subsets
  • ar-ar
  • de
  • default
  • en
  • en-ar
  • en-de
  • en-en
  • en-tr
  • es
  • es-en
  • es-es
  • fr
  • fr-en
  • it
  • it-en
  • ko-ko
  • nl
  • nl-en
  • pl
  • pt
  • ru
  • zh
task_count
11
task_names
  • STS12VisualSTS
  • STS13VisualSTS
  • STS14VisualSTS
  • STS15VisualSTS
  • STS16VisualSTS
  • STS17MultilingualVisualSTS
  • STSBenchmarkMultilingualVisualSTS
  • VisualSTS-b-Eng
  • VisualSTS-b-Multilingual
  • VisualSTS17Eng
  • VisualSTS17Multilingual
sample_size
40
subset_count
22
subset_sample
  • ar-ar
  • de
  • default
  • en
  • en-ar
  • en-de
  • en-en
  • en-tr
  • es
  • es-en
  • es-es
  • fr
  • fr-en
  • it
  • it-en
  • ko-ko
  • nl
  • nl-en
  • pl
  • pt
  • ru
  • zh
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 06150c7c382d7a4faedc7d5a0d8cdb59308968f4
source model id
jinaai/jina-clip-v1
Original result ↗

MTEB

44.284%

source id
mteb
leaderboard name
MTEB Overall
dimension
embedding
metric
Average task score
rank
685
sample size
227
aggregation scope
splits
  • dev
  • test
  • valid
  • validation
subsets
  • ar
  • ar-ar
  • bg
  • bn
  • cs
  • da
  • de
  • default
  • el
  • en
  • en-ar
  • en-de
  • en-en
  • en-tr
  • english
  • es
  • es-en
  • es-es
  • et
  • fa
  • fi
  • fil
  • fr
  • fr-en
  • french
  • german
  • he
  • hi
  • hr
  • hu
  • id
  • it
  • it-en
  • ja
  • ko
  • ko-ko
  • mi
  • nl
  • nl-en
  • no
  • pl
  • pt
  • quz
  • ro
  • ru
  • spanish
  • sv
  • sw
  • te
  • th
  • tr
  • uk
  • vi
  • zh
task_count
137
task_names
  • AROCocoOrder
  • AROFlickrOrder
  • AROVisualAttribution
  • AROVisualRelation
  • BLINKIT2IMultiChoice
  • BLINKIT2IRetrieval
  • BLINKIT2TMultiChoice
  • BLINKIT2TRetrieval
  • Birdsnap
  • BirdsnapZeroShot
  • CIFAR10
  • CIFAR100
  • CIFAR100Clustering
  • CIFAR100ZeroShot
  • CIFAR10Clustering
  • CIFAR10ZeroShot
  • CIRRIT2IRetrieval
  • CLEVRCountZeroShot
  • CLEVRZeroShot
  • CUB200I2IRetrieval
  • CVBenchCount
  • CVBenchDepth
  • CVBenchDistance
  • CVBenchRelation
  • Caltech101
  • Caltech101ZeroShot
  • Country211
  • Country211ZeroShot
  • DTD
  • DTDZeroShot
  • EDIST2ITRetrieval
  • EuroSAT
  • EuroSATZeroShot
  • FER2013
  • FER2013ZeroShot
  • FGVCAircraft
  • FGVCAircraftZeroShot
  • FORBI2IRetrieval
  • Fashion200kI2TRetrieval
  • Fashion200kT2IRetrieval
  • FashionIQIT2IRetrieval
  • Flickr30kI2TRetrieval
  • Flickr30kT2IRetrieval
  • Food101Classification
  • Food101ZeroShot
  • GLDv2I2IRetrieval
  • GLDv2I2TRetrieval
  • GTSRB
  • GTSRBZeroShot
  • HatefulMemesI2TRetrieval
  • HatefulMemesT2IRetrieval
  • ImageCoDe
  • ImageCoDeT2IRetrieval
  • ImageNet10Clustering
  • ImageNetDog15Clustering
  • Imagenet1k
  • Imagenet1kZeroShot
  • InfoSeekIT2ITRetrieval
  • InfoSeekIT2TRetrieval
  • METI2IRetrieval
  • MNIST
  • MNISTZeroShot
  • MSCOCOI2TRetrieval
  • MSCOCOT2IRetrieval
  • MemotionI2TRetrieval
  • MemotionT2IRetrieval
  • NIGHTSI2IRetrieval
  • OVENIT2ITRetrieval
  • OVENIT2TRetrieval
  • OxfordFlowersClassification
  • OxfordPets
  • OxfordPetsZeroShot
  • PatchCamelyon
  • PatchCamelyonZeroShot
  • RESISC45
  • RESISC45ZeroShot
  • ROxfordEasyI2IRetrieval
  • ROxfordHardI2IRetrieval
  • ROxfordMediumI2IRetrieval
  • RP2kI2IRetrieval
  • RParisEasyI2IRetrieval
  • RParisHardI2IRetrieval
  • RParisMediumI2IRetrieval
  • RenderedSST2
  • SOPI2IRetrieval
  • STL10
  • STL10ZeroShot
  • STS12VisualSTS
  • STS13VisualSTS
  • STS14VisualSTS
  • STS15VisualSTS
  • STS16VisualSTS
  • STS17MultilingualVisualSTS
  • STSBenchmarkMultilingualVisualSTS
  • SUN397
  • SUN397ZeroShot
  • SciMMIR
  • SciMMIRI2TRetrieval
  • SciMMIRT2IRetrieval
  • SketchyI2IRetrieval
  • StanfordCars
  • StanfordCarsI2IRetrieval
  • StanfordCarsZeroShot
  • SugarCrepe
  • TUBerlinT2IRetrieval
  • TinyImageNetClustering
  • UCF101
  • UCF101ZeroShot
  • VOC2007
  • VQA2IT2TRetrieval
  • Vidore2BioMedicalLecturesRetrieval
  • Vidore2ESGReportsHLRetrieval
  • Vidore2ESGReportsRetrieval
  • Vidore2EconomicsReportsRetrieval
  • VidoreArxivQARetrieval
  • VidoreDocVQARetrieval
  • VidoreInfoVQARetrieval
  • VidoreShiftProjectRetrieval
  • VidoreSyntheticDocQAAIRetrieval
  • VidoreSyntheticDocQAEnergyRetrieval
  • VidoreSyntheticDocQAGovernmentReportsRetrieval
  • VidoreSyntheticDocQAHealthcareIndustryRetrieval
  • VidoreTabfquadRetrieval
  • VidoreTatdqaRetrieval
  • VisualNewsI2TRetrieval
  • VisualNewsT2IRetrieval
  • VisualSTS-b-Eng
  • VisualSTS-b-Multilingual
  • VisualSTS17Eng
  • VisualSTS17Multilingual
  • VizWizIT2TRetrieval
  • WITT2IRetrieval
  • WebQAT2ITRetrieval
  • WebQAT2TRetrieval
  • Winoground
  • XFlickr30kCoT2IRetrieval
  • XM3600T2IRetrieval
sample_size
227
subset_count
54
subset_sample
  • ar
  • ar-ar
  • bg
  • bn
  • cs
  • da
  • de
  • default
  • el
  • en
  • en-ar
  • en-de
  • en-en
  • en-tr
  • english
  • es
  • es-en
  • es-es
  • et
  • fa
  • fi
  • fil
  • fr
  • fr-en
  • french
  • german
  • he
  • hi
  • hr
  • hu
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 06150c7c382d7a4faedc7d5a0d8cdb59308968f4
source model id
jinaai/jina-clip-v1
Original result ↗

MTEB

27.829%

source id
mteb
leaderboard name
MTEB Retrieval
dimension
embedding
metric
Average task score
rank
749
sample size
123
aggregation scope
splits
  • test
subsets
  • ar
  • bg
  • bn
  • cs
  • da
  • de
  • default
  • el
  • en
  • english
  • es
  • et
  • fa
  • fi
  • fil
  • fr
  • french
  • german
  • he
  • hi
  • hr
  • hu
  • id
  • it
  • ja
  • ko
  • mi
  • nl
  • no
  • pl
  • pt
  • quz
  • ro
  • ru
  • spanish
  • sv
  • sw
  • te
  • th
  • tr
  • uk
  • vi
  • zh
task_count
62
task_names
  • BLINKIT2IRetrieval
  • BLINKIT2TRetrieval
  • CIRRIT2IRetrieval
  • CUB200I2IRetrieval
  • EDIST2ITRetrieval
  • FORBI2IRetrieval
  • Fashion200kI2TRetrieval
  • Fashion200kT2IRetrieval
  • FashionIQIT2IRetrieval
  • Flickr30kI2TRetrieval
  • Flickr30kT2IRetrieval
  • GLDv2I2IRetrieval
  • GLDv2I2TRetrieval
  • HatefulMemesI2TRetrieval
  • HatefulMemesT2IRetrieval
  • ImageCoDeT2IRetrieval
  • InfoSeekIT2ITRetrieval
  • InfoSeekIT2TRetrieval
  • METI2IRetrieval
  • MSCOCOI2TRetrieval
  • MSCOCOT2IRetrieval
  • MemotionI2TRetrieval
  • MemotionT2IRetrieval
  • NIGHTSI2IRetrieval
  • OVENIT2ITRetrieval
  • OVENIT2TRetrieval
  • ROxfordEasyI2IRetrieval
  • ROxfordHardI2IRetrieval
  • ROxfordMediumI2IRetrieval
  • RP2kI2IRetrieval
  • RParisEasyI2IRetrieval
  • RParisHardI2IRetrieval
  • RParisMediumI2IRetrieval
  • SOPI2IRetrieval
  • SciMMIRI2TRetrieval
  • SciMMIRT2IRetrieval
  • SketchyI2IRetrieval
  • StanfordCarsI2IRetrieval
  • TUBerlinT2IRetrieval
  • VQA2IT2TRetrieval
  • Vidore2BioMedicalLecturesRetrieval
  • Vidore2ESGReportsHLRetrieval
  • Vidore2ESGReportsRetrieval
  • Vidore2EconomicsReportsRetrieval
  • VidoreArxivQARetrieval
  • VidoreDocVQARetrieval
  • VidoreInfoVQARetrieval
  • VidoreShiftProjectRetrieval
  • VidoreSyntheticDocQAAIRetrieval
  • VidoreSyntheticDocQAEnergyRetrieval
  • VidoreSyntheticDocQAGovernmentReportsRetrieval
  • VidoreSyntheticDocQAHealthcareIndustryRetrieval
  • VidoreTabfquadRetrieval
  • VidoreTatdqaRetrieval
  • VisualNewsI2TRetrieval
  • VisualNewsT2IRetrieval
  • VizWizIT2TRetrieval
  • WITT2IRetrieval
  • WebQAT2ITRetrieval
  • WebQAT2TRetrieval
  • XFlickr30kCoT2IRetrieval
  • XM3600T2IRetrieval
sample_size
123
subset_count
43
subset_sample
  • ar
  • bg
  • bn
  • cs
  • da
  • de
  • default
  • el
  • en
  • english
  • es
  • et
  • fa
  • fi
  • fil
  • fr
  • french
  • german
  • he
  • hi
  • hr
  • hu
  • id
  • it
  • ja
  • ko
  • mi
  • nl
  • no
  • pl
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 06150c7c382d7a4faedc7d5a0d8cdb59308968f4
source model id
jinaai/jina-clip-v1
Original result ↗

Published prices

1–1 / 1

jina-ai/jina-clip-v1 ↗

$0.05

Inference provider
jina
Platform
Jina AI
Unit
input_tokens_per_million
Currency
USD
Billing conditions

Provider specifications & access

1–1 / 1

jina ↗

source model id
jina-ai/jina-clip-v1
hosting
jina-hosted
platforms
  • Jina AI
context length
8192
architecture
input_modalities
  • text
  • image
output_modalities
  • embeddings
capabilities
  • embeddings

Source specification observations

1–2 / 2

jina ↗

field
context_length
value
8192
normalized value
8192
scope
source-model
source id
jina
confidence
1

jina ↗

field
embedding_dimensions
value
768
normalized value
768
scope
source-model
source id
jina
confidence
1

Original sources

1–6 / 6

Jina AI · Model page ↗

Hugging Face · jinaai/jina-clip-v1 ↗

arXiv · Paper · 2405.20204 ↗

Jina AI · Source snapshot ↗

Hugging Face · Catalog ↗

Jina AI · Catalog ↗

Source links

1–3 / 3

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace