shibing624/text2vec-base-chinese

Explore shibing624/text2vec-base-chinese: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/shibing624/text2vec-base-chinese

Specifications & capabilities

Published model ID
text2vec-base-chinese
Capabilities
embeddings

Evaluations

1–12 / 12

MTEB

36.862%

source id
mteb
leaderboard name
MTEB Summarization
dimension
embedding
metric
Average task score
rank
231
sample size
1
aggregation scope
splits
  • test
subsets
  • default
task_count
1
task_names
  • LegalSummarization
sample_size
1
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 183bb99aa7af74355fb58d16edf8c13ae7c5433e
source model id
shibing624/text2vec-base-chinese
Original result ↗

MTEB

50.971%

source id
mteb
leaderboard name
MTEB Pair Classification
dimension
embedding
metric
Average task score
rank
343
sample size
2
aggregation scope
splits
  • test
  • validation
subsets
  • de
task_count
1
task_names
  • PawsXPairClassification
sample_size
2
subset_count
1
subset_sample
  • de
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 183bb99aa7af74355fb58d16edf8c13ae7c5433e
source model id
shibing624/text2vec-base-chinese
Original result ↗

MTEB

67.323%

source id
mteb
leaderboard name
MTEB Semantic Similarity
dimension
embedding
metric
Average task score
rank
363
sample size
2
aggregation scope
splits
  • test
subsets
  • default
  • zh
task_count
2
task_names
  • STS22
  • STSB
sample_size
2
subset_count
2
subset_sample
  • default
  • zh
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • no_revision_available
source model id
shibing624/text2vec-base-chinese
Original result ↗

MTEB

37.656%

source id
mteb
leaderboard name
MTEB Clustering
dimension
embedding
metric
Average task score
rank
437
sample size
4
aggregation scope
splits
  • test
subsets
  • default
task_count
4
task_names
  • CLSClusteringP2P
  • CLSClusteringS2S
  • ThuNewsClusteringP2P
  • ThuNewsClusteringS2S
sample_size
4
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • no_revision_available
source model id
shibing624/text2vec-base-chinese
Original result ↗

MTEB

52.1%

source id
mteb
leaderboard name
MTEB Other
dimension
embedding
metric
Average task score
rank
439
sample size
14
aggregation scope
splits
  • test
  • validation
subsets
  • default
task_count
14
task_names
  • AFQMC
  • ATEC
  • BQ
  • Cmnli
  • IFlyTek
  • JDReview
  • LCQMC
  • MultilingualSentiment
  • Ocnli
  • OnlineShopping
  • PAWSX
  • QBQTC
  • TNews
  • Waimai
sample_size
14
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • no_revision_available
source model id
shibing624/text2vec-base-chinese
Original result ↗

MTEB

42.958%

source id
mteb
leaderboard name
MTEB Classification
dimension
embedding
metric
Average task score
rank
560
sample size
12
aggregation scope
splits
  • test
  • validation
subsets
  • de
task_count
6
task_names
  • AmazonCounterfactualClassification
  • AmazonReviewsClassification
  • MTOPDomainClassification
  • MTOPIntentClassification
  • MassiveIntentClassification
  • MassiveScenarioClassification
sample_size
12
subset_count
1
subset_sample
  • de
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 183bb99aa7af74355fb58d16edf8c13ae7c5433e
source model id
shibing624/text2vec-base-chinese
Original result ↗

MTEB

38.794%

source id
mteb
leaderboard name
MTEB Retrieval
dimension
embedding
metric
Average task score
rank
618
sample size
8
aggregation scope
splits
  • dev
subsets
  • default
task_count
8
task_names
  • CmedqaRetrieval
  • CovidRetrieval
  • DuRetrieval
  • EcomRetrieval
  • MMarcoRetrieval
  • MedicalRetrieval
  • T2Retrieval
  • VideoRetrieval
sample_size
8
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • no_revision_available
source model id
shibing624/text2vec-base-chinese
Original result ↗

MTEB

47.322%

source id
mteb
leaderboard name
MTEB Overall
dimension
embedding
metric
Average task score
rank
624
sample size
28
aggregation scope
splits
  • dev
  • test
  • validation
subsets
  • default
  • zh
task_count
28
task_names
  • AFQMC
  • ATEC
  • BQ
  • CLSClusteringP2P
  • CLSClusteringS2S
  • CmedqaRetrieval
  • Cmnli
  • CovidRetrieval
  • DuRetrieval
  • EcomRetrieval
  • IFlyTek
  • JDReview
  • LCQMC
  • MMarcoRetrieval
  • MedicalRetrieval
  • MultilingualSentiment
  • Ocnli
  • OnlineShopping
  • PAWSX
  • QBQTC
  • STS22
  • STSB
  • T2Retrieval
  • TNews
  • ThuNewsClusteringP2P
  • ThuNewsClusteringS2S
  • VideoRetrieval
  • Waimai
sample_size
28
subset_count
2
subset_sample
  • default
  • zh
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • no_revision_available
source model id
shibing624/text2vec-base-chinese
Original result ↗

MTEB

7.63%

source id
mteb
leaderboard name
MTEB Clustering
dimension
embedding
metric
Average task score
rank
690
sample size
4
aggregation scope
splits
  • test
subsets
  • default
task_count
4
task_names
  • BlurbsClusteringP2P
  • BlurbsClusteringS2S
  • TenKGnadClusteringP2P
  • TenKGnadClusteringS2S
sample_size
4
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 183bb99aa7af74355fb58d16edf8c13ae7c5433e
source model id
shibing624/text2vec-base-chinese
Original result ↗

MTEB

14.264%

source id
mteb
leaderboard name
MTEB Other
dimension
embedding
metric
Average task score
rank
805
sample size
37
aggregation scope
splits
  • all
  • dentistry_and_oral_health
  • dermatology
  • gastroenterology
  • genetics
  • neuroscience_and_neurology
  • orthopedic_surgery
  • otorhinolaryngology
  • plastic_surgery
  • psychiatry_and_psychology
  • pulmonology
  • test
subsets
  • default
  • en
  • es
  • fr
task_count
5
task_names
  • AILACasedocs
  • AILAStatutes
  • CUREv1
  • FalseFriendsGermanEnglish
  • LegalQuAD
sample_size
37
subset_count
4
subset_sample
  • default
  • en
  • es
  • fr
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 183bb99aa7af74355fb58d16edf8c13ae7c5433e
source model id
shibing624/text2vec-base-chinese
Original result ↗

MTEB

12.76%

source id
mteb
leaderboard name
MTEB Retrieval
dimension
embedding
metric
Average task score
rank
834
sample size
28
aggregation scope
splits
  • dev
  • test
subsets
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
task_count
11
task_names
  • AppsRetrieval
  • ChatDoctorRetrieval
  • DS1000Retrieval
  • FinQARetrieval
  • FinanceBenchRetrieval
  • FreshStackRetrieval
  • HC3FinanceRetrieval
  • HumanEvalRetrieval
  • MBPPRetrieval
  • MIRACLRetrievalHardNegatives
  • WikiSQLRetrieval
sample_size
28
subset_count
19
subset_sample
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 183bb99aa7af74355fb58d16edf8c13ae7c5433e
source model id
shibing624/text2vec-base-chinese
Original result ↗

MTEB

20.992%

source id
mteb
leaderboard name
MTEB Overall
dimension
embedding
metric
Average task score
rank
945
sample size
84
aggregation scope
splits
  • all
  • dentistry_and_oral_health
  • dermatology
  • dev
  • gastroenterology
  • genetics
  • neuroscience_and_neurology
  • orthopedic_surgery
  • otorhinolaryngology
  • plastic_surgery
  • psychiatry_and_psychology
  • pulmonology
  • test
  • validation
subsets
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
task_count
28
task_names
  • AILACasedocs
  • AILAStatutes
  • AmazonCounterfactualClassification
  • AmazonReviewsClassification
  • AppsRetrieval
  • BlurbsClusteringP2P
  • BlurbsClusteringS2S
  • CUREv1
  • ChatDoctorRetrieval
  • DS1000Retrieval
  • FalseFriendsGermanEnglish
  • FinQARetrieval
  • FinanceBenchRetrieval
  • FreshStackRetrieval
  • HC3FinanceRetrieval
  • HumanEvalRetrieval
  • LegalQuAD
  • LegalSummarization
  • MBPPRetrieval
  • MIRACLRetrievalHardNegatives
  • MTOPDomainClassification
  • MTOPIntentClassification
  • MassiveIntentClassification
  • MassiveScenarioClassification
  • PawsXPairClassification
  • TenKGnadClusteringP2P
  • TenKGnadClusteringS2S
  • WikiSQLRetrieval
sample_size
84
subset_count
19
subset_sample
  • ar
  • bn
  • de
  • default
  • en
  • es
  • fa
  • fi
  • fr
  • hi
  • id
  • ja
  • ko
  • ru
  • sw
  • te
  • th
  • yo
  • zh
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • 183bb99aa7af74355fb58d16edf8c13ae7c5433e
source model id
shibing624/text2vec-base-chinese
Original result ↗

Published prices

1–1 / 1

Provider specifications & access

1–1 / 1

shibing624/text2vec-base-chinese ↗

source model id
HuggingFace/shibing624-text2vec-base-chinese@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
apache-2.0
architecture
input_modalities
  • text
output_modalities
  • embeddings
capabilities

    Original sources

    1–8 / 8

    Hugging Face · shibing624/text2vec-base-chinese ↗

    DeepInfra · Model page ↗

    Microsoft Foundry · Model page ↗

    Microsoft Foundry · Model documentation ↗

    DeepInfra · Catalog ↗

    Hugging Face · Catalog ↗

    Hugging Face · Catalog ↗

    Microsoft Foundry · Catalog ↗

    Source links

    1–4 / 4

    Hugging Face model card

    1–1 / 1

    Explore more models

    Models

    Loading
    EVIDENCE / COMPARISON

    Benchmarks

    Explore every benchmark

    Loading

    These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

    Install TensorTrace