naver/splade_v2_distil

`naver/splade_v2_distil` powered by Hugging Face Inference Toolkit - [Original Model Card](https://huggingface.co/naver/splade_v2_distil) - [`fill-mask` Task on Hugging Face](https://huggingface.co/t…

azureFoundry/HuggingFace/naver-splade-v2-distil@3

naver/splade_v2_distil powered by Hugging Face Inference Toolkit

Send Request

You can use cURL or any REST Client to send a request to the AzureML endpoint with your AzureML token.

curl <AZUREML_ENDPOINT_URL> \
    -X POST \
    -H "Authorization: Bearer <AZUREML_TOKEN>" \
    -H "Content-Type: application/json" \
    -d '{"inputs":"The answer to the universe is undefined."}'

Supported Parameters

  • inputs (string): The text with masked tokens
  • parameters (object):
    • top_k (integer): When passed, overrides the number of predictions to return.
    • targets (string[]): When passed, the model will limit the scores to the passed targets instead of looking up in the whole vocabulary. If the provided targets are not in the model vocab, they will be tokenized and the first resulting token will be used (with a warning, and that might be slower).

Check the full API Specification at the Hugging Face Inference documentation.

Specifications & capabilities

Published model ID
splade_v2_distil

Evaluations

1–7 / 7

MTEB

49.712%

source id
mteb
leaderboard name
MTEB Pair Classification
dimension
embedding
metric
Average task score
rank
350
sample size
2
aggregation scope
splits
  • test
  • validation
subsets
  • ko
task_count
1
task_names
  • PawsXPairClassification
sample_size
2
subset_count
1
subset_sample
  • ko
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • b5e5ebfb992c31a99ba3be148fb9d841f5c6d6a1
source model id
naver/splade_v2_distil
Original result ↗

MTEB

39.966%

source id
mteb
leaderboard name
MTEB Semantic Similarity
dimension
embedding
metric
Average task score
rank
531
sample size
3
aggregation scope
splits
  • test
  • validation
subsets
  • default
  • ko-ko
task_count
3
task_names
  • KLUE-STS
  • KorSTS
  • STS17
sample_size
3
subset_count
2
subset_sample
  • default
  • ko-ko
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • b5e5ebfb992c31a99ba3be148fb9d841f5c6d6a1
source model id
naver/splade_v2_distil
Original result ↗

MTEB

16.371%

source id
mteb
leaderboard name
MTEB Reranking
dimension
embedding
metric
Average task score
rank
554
sample size
1
aggregation scope
splits
  • dev
subsets
  • ko
task_count
1
task_names
  • MIRACLReranking
sample_size
1
subset_count
1
subset_sample
  • ko
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • b5e5ebfb992c31a99ba3be148fb9d841f5c6d6a1
source model id
naver/splade_v2_distil
Original result ↗

MTEB

3.283%

source id
mteb
leaderboard name
MTEB Clustering
dimension
embedding
metric
Average task score
rank
704
sample size
3
aggregation scope
splits
  • test
subsets
  • default
  • kor_Hang
task_count
3
task_names
  • KlueMrcDomainClustering
  • KlueYnatMrcCategoryClustering
  • SIB200ClusteringS2S
sample_size
3
subset_count
2
subset_sample
  • default
  • kor_Hang
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • b5e5ebfb992c31a99ba3be148fb9d841f5c6d6a1
source model id
naver/splade_v2_distil
Original result ↗

MTEB

23.505%

source id
mteb
leaderboard name
MTEB Other
dimension
embedding
metric
Average task score
rank
781
sample size
6
aggregation scope
splits
  • dev
  • test
  • validation
subsets
  • default
  • korean
task_count
6
task_names
  • KLUE-NLI
  • KLUE-TC
  • Ko-StrategyQA
  • KorNLI
  • LawIRKo
  • PublicHealthQA
sample_size
6
subset_count
2
subset_sample
  • default
  • korean
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • b5e5ebfb992c31a99ba3be148fb9d841f5c6d6a1
source model id
naver/splade_v2_distil
Original result ↗

MTEB

3.8%

source id
mteb
leaderboard name
MTEB Retrieval
dimension
embedding
metric
Average task score
rank
879
sample size
9
aggregation scope
splits
  • dev
  • test
subsets
  • default
  • eng_Latn-kor_Hang
  • ko
  • kor_Hang-eng_Latn
  • kor_Hang-kor_Hang
  • korean
task_count
6
task_names
  • AutoRAGRetrieval
  • BelebeleRetrieval
  • MIRACLRetrieval
  • MrTidyRetrieval
  • MultiLongDocRetrieval
  • SQuADKorV1Retrieval
sample_size
9
subset_count
6
subset_sample
  • default
  • eng_Latn-kor_Hang
  • ko
  • kor_Hang-eng_Latn
  • kor_Hang-kor_Hang
  • korean
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • b5e5ebfb992c31a99ba3be148fb9d841f5c6d6a1
source model id
naver/splade_v2_distil
Original result ↗

MTEB

17.983%

source id
mteb
leaderboard name
MTEB Overall
dimension
embedding
metric
Average task score
rank
964
sample size
24
aggregation scope
splits
  • dev
  • test
  • validation
subsets
  • default
  • eng_Latn-kor_Hang
  • ko
  • ko-ko
  • kor_Hang
  • kor_Hang-eng_Latn
  • kor_Hang-kor_Hang
  • korean
task_count
20
task_names
  • AutoRAGRetrieval
  • BelebeleRetrieval
  • KLUE-NLI
  • KLUE-STS
  • KLUE-TC
  • KlueMrcDomainClustering
  • KlueYnatMrcCategoryClustering
  • Ko-StrategyQA
  • KorNLI
  • KorSTS
  • LawIRKo
  • MIRACLReranking
  • MIRACLRetrieval
  • MrTidyRetrieval
  • MultiLongDocRetrieval
  • PawsXPairClassification
  • PublicHealthQA
  • SIB200ClusteringS2S
  • SQuADKorV1Retrieval
  • STS17
sample_size
24
subset_count
8
subset_sample
  • default
  • eng_Latn-kor_Hang
  • ko
  • ko-ko
  • kor_Hang
  • kor_Hang-eng_Latn
  • kor_Hang-kor_Hang
  • korean
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • b5e5ebfb992c31a99ba3be148fb9d841f5c6d6a1
source model id
naver/splade_v2_distil
Original result ↗

Provider specifications & access

1–1 / 1

naver/splade_v2_distil ↗

source model id
HuggingFace/naver-splade-v2-distil@3
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
cc-by-nc-sa-4.0
architecture
input_modalities
    output_modalities
      capabilities

        Original sources

        1–5 / 5

        Hugging Face · naver/splade_v2_distil ↗

        Microsoft Foundry · Model page ↗

        Microsoft Foundry · Model documentation ↗

        Hugging Face · Catalog ↗

        Microsoft Foundry · Catalog ↗

        Source links

        1–2 / 2

        Explore more models

        Models

        Loading
        EVIDENCE / COMPARISON

        Benchmarks

        Explore every benchmark

        Loading

        These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

        Install TensorTrace