Embed v4.0

A model that allows for text, images, or mixed content to be classified or turned into embeddings.

vercelAIGatewayCatalog/cohere/embed-v4.0

A model that allows for text, images, or mixed content to be classified or turned into embeddings.

Specifications & capabilities

Input
text
Output
text
Context window · tokens
128000

Evaluations

1–12 / 12

MTEB

55.709%

source id
mteb
leaderboard name
MTEB Summarization
dimension
embedding
metric
Average task score
rank
61
sample size
1
aggregation scope
splits
  • test
subsets
  • default
task_count
1
task_names
  • LegalSummarization
sample_size
1
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 1
source model id
Cohere/Cohere-embed-v4.0 (output_dtype=binary)
Original result ↗

MTEB

54.226%

source id
mteb
leaderboard name
MTEB Summarization
dimension
embedding
metric
Average task score
rank
66
sample size
1
aggregation scope
splits
  • test
subsets
  • default
task_count
1
task_names
  • LegalSummarization
sample_size
1
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 1
source model id
Cohere/Cohere-embed-v4.0 (output_dtype=int8)
Original result ↗

MTEB

53.67%

source id
mteb
leaderboard name
MTEB Summarization
dimension
embedding
metric
Average task score
rank
70
sample size
1
aggregation scope
splits
  • test
subsets
  • default
task_count
1
task_names
  • LegalSummarization
sample_size
1
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 1
source model id
Cohere/Cohere-embed-v4.0
Original result ↗

MTEB

72.005%

source id
mteb
leaderboard name
MTEB Retrieval
dimension
embedding
metric
Average task score
rank
132
sample size
28
aggregation scope
splits
  • dev
  • test
subsets
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
task_count
11
task_names
  • AppsRetrieval
  • ChatDoctorRetrieval
  • DS1000Retrieval
  • FinQARetrieval
  • FinanceBenchRetrieval
  • FreshStackRetrieval
  • HC3FinanceRetrieval
  • HumanEvalRetrieval
  • MBPPRetrieval
  • MIRACLRetrievalHardNegatives
  • WikiSQLRetrieval
sample_size
28
subset_count
19
subset_sample
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 1
source model id
Cohere/Cohere-embed-v4.0 (output_dtype=int8)
Original result ↗

MTEB

71.939%

source id
mteb
leaderboard name
MTEB Retrieval
dimension
embedding
metric
Average task score
rank
134
sample size
28
aggregation scope
splits
  • dev
  • test
subsets
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
task_count
11
task_names
  • AppsRetrieval
  • ChatDoctorRetrieval
  • DS1000Retrieval
  • FinQARetrieval
  • FinanceBenchRetrieval
  • FreshStackRetrieval
  • HC3FinanceRetrieval
  • HumanEvalRetrieval
  • MBPPRetrieval
  • MIRACLRetrievalHardNegatives
  • WikiSQLRetrieval
sample_size
28
subset_count
19
subset_sample
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 1
source model id
Cohere/Cohere-embed-v4.0
Original result ↗

MTEB

68.761%

source id
mteb
leaderboard name
MTEB Retrieval
dimension
embedding
metric
Average task score
rank
183
sample size
28
aggregation scope
splits
  • dev
  • test
subsets
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
task_count
11
task_names
  • AppsRetrieval
  • ChatDoctorRetrieval
  • DS1000Retrieval
  • FinQARetrieval
  • FinanceBenchRetrieval
  • FreshStackRetrieval
  • HC3FinanceRetrieval
  • HumanEvalRetrieval
  • MBPPRetrieval
  • MIRACLRetrievalHardNegatives
  • WikiSQLRetrieval
sample_size
28
subset_count
19
subset_sample
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 1
source model id
Cohere/Cohere-embed-v4.0 (output_dtype=binary)
Original result ↗

MTEB

65.433%

source id
mteb
leaderboard name
MTEB Overall
dimension
embedding
metric
Average task score
rank
192
sample size
65
aggregation scope
splits
  • all
  • dentistry_and_oral_health
  • dermatology
  • dev
  • gastroenterology
  • genetics
  • neuroscience_and_neurology
  • orthopedic_surgery
  • otorhinolaryngology
  • plastic_surgery
  • psychiatry_and_psychology
  • pulmonology
  • test
subsets
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
task_count
16
task_names
  • AILACasedocs
  • AILAStatutes
  • AppsRetrieval
  • CUREv1
  • ChatDoctorRetrieval
  • DS1000Retrieval
  • FinQARetrieval
  • FinanceBenchRetrieval
  • FreshStackRetrieval
  • HC3FinanceRetrieval
  • HumanEvalRetrieval
  • LegalQuAD
  • LegalSummarization
  • MBPPRetrieval
  • MIRACLRetrievalHardNegatives
  • WikiSQLRetrieval
sample_size
65
subset_count
19
subset_sample
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 1
source model id
Cohere/Cohere-embed-v4.0 (output_dtype=int8)
Original result ↗

MTEB

65.344%

source id
mteb
leaderboard name
MTEB Overall
dimension
embedding
metric
Average task score
rank
195
sample size
65
aggregation scope
splits
  • all
  • dentistry_and_oral_health
  • dermatology
  • dev
  • gastroenterology
  • genetics
  • neuroscience_and_neurology
  • orthopedic_surgery
  • otorhinolaryngology
  • plastic_surgery
  • psychiatry_and_psychology
  • pulmonology
  • test
subsets
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
task_count
16
task_names
  • AILACasedocs
  • AILAStatutes
  • AppsRetrieval
  • CUREv1
  • ChatDoctorRetrieval
  • DS1000Retrieval
  • FinQARetrieval
  • FinanceBenchRetrieval
  • FreshStackRetrieval
  • HC3FinanceRetrieval
  • HumanEvalRetrieval
  • LegalQuAD
  • LegalSummarization
  • MBPPRetrieval
  • MIRACLRetrievalHardNegatives
  • WikiSQLRetrieval
sample_size
65
subset_count
19
subset_sample
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 1
source model id
Cohere/Cohere-embed-v4.0
Original result ↗

MTEB

62.567%

source id
mteb
leaderboard name
MTEB Overall
dimension
embedding
metric
Average task score
rank
253
sample size
65
aggregation scope
splits
  • all
  • dentistry_and_oral_health
  • dermatology
  • dev
  • gastroenterology
  • genetics
  • neuroscience_and_neurology
  • orthopedic_surgery
  • otorhinolaryngology
  • plastic_surgery
  • psychiatry_and_psychology
  • pulmonology
  • test
subsets
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
task_count
16
task_names
  • AILACasedocs
  • AILAStatutes
  • AppsRetrieval
  • CUREv1
  • ChatDoctorRetrieval
  • DS1000Retrieval
  • FinQARetrieval
  • FinanceBenchRetrieval
  • FreshStackRetrieval
  • HC3FinanceRetrieval
  • HumanEvalRetrieval
  • LegalQuAD
  • LegalSummarization
  • MBPPRetrieval
  • MIRACLRetrievalHardNegatives
  • WikiSQLRetrieval
sample_size
65
subset_count
19
subset_sample
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 1
source model id
Cohere/Cohere-embed-v4.0 (output_dtype=binary)
Original result ↗

MTEB

50.163%

source id
mteb
leaderboard name
MTEB Other
dimension
embedding
metric
Average task score
rank
479
sample size
36
aggregation scope
splits
  • all
  • dentistry_and_oral_health
  • dermatology
  • gastroenterology
  • genetics
  • neuroscience_and_neurology
  • orthopedic_surgery
  • otorhinolaryngology
  • plastic_surgery
  • psychiatry_and_psychology
  • pulmonology
  • test
subsets
  • default
  • en
  • es
  • fr
task_count
4
task_names
  • AILACasedocs
  • AILAStatutes
  • CUREv1
  • LegalQuAD
sample_size
36
subset_count
4
subset_sample
  • default
  • en
  • es
  • fr
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 1
source model id
Cohere/Cohere-embed-v4.0 (output_dtype=int8)
Original result ↗

MTEB

50.126%

source id
mteb
leaderboard name
MTEB Other
dimension
embedding
metric
Average task score
rank
480
sample size
36
aggregation scope
splits
  • all
  • dentistry_and_oral_health
  • dermatology
  • gastroenterology
  • genetics
  • neuroscience_and_neurology
  • orthopedic_surgery
  • otorhinolaryngology
  • plastic_surgery
  • psychiatry_and_psychology
  • pulmonology
  • test
subsets
  • default
  • en
  • es
  • fr
task_count
4
task_names
  • AILACasedocs
  • AILAStatutes
  • CUREv1
  • LegalQuAD
sample_size
36
subset_count
4
subset_sample
  • default
  • en
  • es
  • fr
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 1
source model id
Cohere/Cohere-embed-v4.0
Original result ↗

MTEB

47.251%

source id
mteb
leaderboard name
MTEB Other
dimension
embedding
metric
Average task score
rank
539
sample size
36
aggregation scope
splits
  • all
  • dentistry_and_oral_health
  • dermatology
  • gastroenterology
  • genetics
  • neuroscience_and_neurology
  • orthopedic_surgery
  • otorhinolaryngology
  • plastic_surgery
  • psychiatry_and_psychology
  • pulmonology
  • test
subsets
  • default
  • en
  • es
  • fr
task_count
4
task_names
  • AILACasedocs
  • AILAStatutes
  • CUREv1
  • LegalQuAD
sample_size
36
subset_count
4
subset_sample
  • default
  • en
  • es
  • fr
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 1
source model id
Cohere/Cohere-embed-v4.0 (output_dtype=binary)
Original result ↗

Original sources

1–1 / 1

Hugging Face · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace