deepvk/USER2-base

Explore deepvk/USER2-base: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/deepvk/USER2-base

Specifications & capabilities

Published model ID
USER2-base

Evaluations

1–7 / 7

MTEB

75.386%

source id
mteb
leaderboard name
MTEB Retrieval
dimension
embedding
metric
Average task score
rank
86
sample size
3
aggregation scope
splits
  • test
subsets
  • default
task_count
3
task_names
  • RiaNewsRetrieval
  • RiaNewsRetrievalHardNegatives.v2
  • RuBQRetrieval
sample_size
3
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 0942cf96909b6d52e61f79a01e2d30c7be640b27
source model id
deepvk/USER2-base
Original result ↗

MTEB

59.385%

source id
mteb
leaderboard name
MTEB Clustering
dimension
embedding
metric
Average task score
rank
94
sample size
3
aggregation scope
splits
  • test
subsets
  • default
task_count
3
task_names
  • GeoreviewClusteringP2P
  • RuSciBenchGRNTIClusteringP2P
  • RuSciBenchOECDClusteringP2P
sample_size
3
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 0942cf96909b6d52e61f79a01e2d30c7be640b27
source model id
deepvk/USER2-base
Original result ↗

MTEB

69.733%

source id
mteb
leaderboard name
MTEB Reranking
dimension
embedding
metric
Average task score
rank
106
sample size
1
aggregation scope
splits
  • test
subsets
  • default
task_count
1
task_names
  • RuBQReranking
sample_size
1
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 0942cf96909b6d52e61f79a01e2d30c7be640b27
source model id
deepvk/USER2-base
Original result ↗

MTEB

62.806%

source id
mteb
leaderboard name
MTEB Overall
dimension
embedding
metric
Average task score
rank
246
sample size
24
aggregation scope
splits
  • dev
  • test
  • validation
subsets
  • default
  • ru
task_count
22
task_names
  • CEDRClassification
  • GeoreviewClassification
  • GeoreviewClusteringP2P
  • HeadlineClassification
  • InappropriatenessClassification
  • KinopoiskClassification
  • MassiveIntentClassification
  • MassiveScenarioClassification
  • RUParaPhraserSTS
  • RiaNewsRetrieval
  • RiaNewsRetrievalHardNegatives.v2
  • RuBQReranking
  • RuBQRetrieval
  • RuReviewsClassification
  • RuSTSBenchmarkSTS
  • RuSciBenchGRNTIClassification
  • RuSciBenchGRNTIClusteringP2P
  • RuSciBenchOECDClassification
  • RuSciBenchOECDClusteringP2P
  • STS22
  • SensitiveTopicsClassification
  • TERRa
sample_size
24
subset_count
2
subset_sample
  • default
  • ru
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 0942cf96909b6d52e61f79a01e2d30c7be640b27
source model id
deepvk/USER2-base
Original result ↗

MTEB

74.274%

source id
mteb
leaderboard name
MTEB Semantic Similarity
dimension
embedding
metric
Average task score
rank
274
sample size
3
aggregation scope
splits
  • test
subsets
  • default
  • ru
task_count
3
task_names
  • RUParaPhraserSTS
  • RuSTSBenchmarkSTS
  • STS22
sample_size
3
subset_count
2
subset_sample
  • default
  • ru
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 0942cf96909b6d52e61f79a01e2d30c7be640b27
source model id
deepvk/USER2-base
Original result ↗

MTEB

56.383%

source id
mteb
leaderboard name
MTEB Other
dimension
embedding
metric
Average task score
rank
328
sample size
1
aggregation scope
splits
  • dev
subsets
  • default
task_count
1
task_names
  • TERRa
sample_size
1
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 0942cf96909b6d52e61f79a01e2d30c7be640b27
source model id
deepvk/USER2-base
Original result ↗

MTEB

57.134%

source id
mteb
leaderboard name
MTEB Classification
dimension
embedding
metric
Average task score
rank
370
sample size
13
aggregation scope
splits
  • test
  • validation
subsets
  • default
  • ru
task_count
11
task_names
  • CEDRClassification
  • GeoreviewClassification
  • HeadlineClassification
  • InappropriatenessClassification
  • KinopoiskClassification
  • MassiveIntentClassification
  • MassiveScenarioClassification
  • RuReviewsClassification
  • RuSciBenchGRNTIClassification
  • RuSciBenchOECDClassification
  • SensitiveTopicsClassification
sample_size
13
subset_count
2
subset_sample
  • default
  • ru
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 0942cf96909b6d52e61f79a01e2d30c7be640b27
source model id
deepvk/USER2-base
Original result ↗

Provider specifications & access

1–1 / 1

deepvk/USER2-base ↗

source model id
publishers/hf-deepvk/models/user2-base@001
hosting
vertex-self-deployed
platforms
  • Google Cloud Vertex AI
architecture
input_modalities
    output_modalities
      capabilities

        Original sources

        1–7 / 7

        Hugging Face · deepvk/USER2-base ↗

        Google Cloud · Model page ↗

        arXiv · Paper · 2205.13147 ↗

        arXiv · Paper · 2401.00368 ↗

        Google Cloud · Catalog ↗

        Hugging Face · Catalog ↗

        Hugging Face · Catalog ↗

        Source links

        1–3 / 3

        Hugging Face model card

        1–1 / 1

        deepvk/USER2-base ↗

        downloads
        1104224
        likes
        33
        pipeline tag
        sentence-similarity
        library name
        sentence-transformers
        License
        apache-2.0

        Explore more models

        Models

        Loading
        EVIDENCE / COMPARISON

        Benchmarks

        Explore every benchmark

        Loading

        These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

        Install TensorTrace