jhgan/ko-sroberta-multitask

Explore jhgan/ko-sroberta-multitask: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/jhgan/ko-sroberta-multitask

Specifications & capabilities

Published model ID
ko-sroberta-multitask
Capabilities
embeddings

Evaluations

1–3 / 3

MTEB

67.155%

source id
mteb
leaderboard name
MTEB Other
dimension
embedding
metric
Average task score
rank
112
sample size
2
aggregation scope
splits
  • dev
  • test
subsets
  • default
  • korean
task_count
2
task_names
  • Ko-StrategyQA
  • PublicHealthQA
sample_size
2
subset_count
2
subset_sample
  • default
  • korean
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 8fca7c9c98c26599be0e14b9916b11a756a26f19
source model id
jhgan/ko-sroberta-multitask
Original result ↗

MTEB

40.952%

source id
mteb
leaderboard name
MTEB Retrieval
dimension
embedding
metric
Average task score
rank
586
sample size
8
aggregation scope
splits
  • dev
  • test
subsets
  • default
  • eng_Latn-kor_Hang
  • ko
  • kor_Hang-eng_Latn
  • kor_Hang-kor_Hang
  • korean
task_count
5
task_names
  • AutoRAGRetrieval
  • BelebeleRetrieval
  • MIRACLRetrieval
  • MrTidyRetrieval
  • MultiLongDocRetrieval
sample_size
8
subset_count
6
subset_sample
  • default
  • eng_Latn-kor_Hang
  • ko
  • kor_Hang-eng_Latn
  • kor_Hang-kor_Hang
  • korean
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 8fca7c9c98c26599be0e14b9916b11a756a26f19
source model id
jhgan/ko-sroberta-multitask
Original result ↗

MTEB

48.438%

source id
mteb
leaderboard name
MTEB Overall
dimension
embedding
metric
Average task score
rank
604
sample size
10
aggregation scope
splits
  • dev
  • test
subsets
  • default
  • eng_Latn-kor_Hang
  • ko
  • kor_Hang-eng_Latn
  • kor_Hang-kor_Hang
  • korean
task_count
7
task_names
  • AutoRAGRetrieval
  • BelebeleRetrieval
  • Ko-StrategyQA
  • MIRACLRetrieval
  • MrTidyRetrieval
  • MultiLongDocRetrieval
  • PublicHealthQA
sample_size
10
subset_count
6
subset_sample
  • default
  • eng_Latn-kor_Hang
  • ko
  • kor_Hang-eng_Latn
  • kor_Hang-kor_Hang
  • korean
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 8fca7c9c98c26599be0e14b9916b11a756a26f19
source model id
jhgan/ko-sroberta-multitask
Original result ↗

Provider specifications & access

1–2 / 2

jhgan/ko-sroberta-multitask ↗

source model id
HuggingFace/jhgan-ko-sroberta-multitask@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
unknown
architecture
input_modalities
  • text
output_modalities
  • embeddings
capabilities

    jhgan/ko-sroberta-multitask ↗

    source model id
    publishers/hf-jhgan/models/ko-sroberta-multitask@001
    hosting
    vertex-self-deployed
    platforms
    • Google Cloud Vertex AI
    architecture
    input_modalities
      output_modalities
        capabilities

          Original sources

          1–9 / 9

          Hugging Face · jhgan/ko-sroberta-multitask ↗

          Google Cloud · Model page ↗

          Microsoft Foundry · Model page ↗

          Microsoft Foundry · Model documentation ↗

          arXiv · Paper · 2004.03289 ↗

          Google Cloud · Catalog ↗

          Hugging Face · Catalog ↗

          Hugging Face · Catalog ↗

          Microsoft Foundry · Catalog ↗

          Source links

          1–4 / 4

          Hugging Face model card

          1–1 / 1

          Explore more models

          Models

          Loading
          EVIDENCE / COMPARISON

          Benchmarks

          Explore every benchmark

          Loading

          These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

          Install TensorTrace