speechbrain/m-ctc-t-large

`speechbrain/m-ctc-t-large` powered by Hugging Face Inference Toolkit - [Original Model Card](https://huggingface.co/speechbrain/m-ctc-t-large) - [`automatic-speech-recognition` Task on Hugging Face]…

azureFoundry/HuggingFace/speechbrain-m-ctc-t-large@1

`speechbrain/m-ctc-t-large` powered by Hugging Face Inference Toolkit

- [Original Model Card](https://huggingface.co/speechbrain/m-ctc-t-large) - [`automatic-speech-recognition` Task on Hugging Face](https://huggingface.co/tasks/automatic-speech-recognition)

### Send Request

You can use cURL or any REST Client to send a request to the AzureML endpoint with your AzureML token.

```bash curl <AZUREML_ENDPOINT_URL> \ -X POST \ -H "Authorization: Bearer <AZUREML_TOKEN>" \ -H "Content-Type: audio/flac" \ --data-binary @"audio.flac" ```

### Supported Parameters

- **inputs** (string): The input audio data as a base64-encoded string. If no parameters are provided, you can also provide the audio data as a raw bytes payload. - **parameters** (object): - **return_timestamps** (boolean): Whether to output corresponding timestamps with the generated text - **generation_parameters** (object): - **temperature** (float): The value used to modulate the next token probabilities. - **top_k** (integer): The number of highest probability vocabulary tokens to keep for top-k-filtering. - **top_p** (float): If set to float < 1, only the smallest set of most probable tokens with probabilities that add up to top_p or higher are kept for generation. - **typical_p** (float): Local typicality measures how similar the conditional probability of predicting a target token next is to the expected conditional probability of predicting a random token next, given the partial text already generated. If set to float < 1, the smallest set of the most locally typical tokens with probabilities that add up to typical_p or higher are kept for generation. See this paper for more details. - **epsilon_cutoff** (float): If set to float strictly between 0 and 1, only tokens with a conditional probability greater than epsilon_cutoff will be sampled. In the paper, suggested values range from 3e-4 to 9e-4, depending on the size of the model. See Truncation Sampling as Language Model Desmoothing for more details. - **eta_cutoff** (float): Eta sampling is a hybrid of locally typical sampling and epsilon sampling. If set to float strictly between 0 and 1, a token is only considered if it is greater than either eta_cutoff or sqrt(eta_cutoff) * exp(-entropy(softmax(next_token_logits))). The latter term is intuitively the expected next token probability, scaled by sqrt(eta_cutoff). In the paper, suggested values range from 3e-4 to 2e-3, depending on the size of the model. See Truncation Sampling as Language Model Desmoothing for more details. - **max_length** (integer): The maximum length (in tokens) of the generated text, including the input. - **max_new_tokens** (integer): The maximum number of tokens to generate. Takes precedence over max_length. - **min_length** (integer): The minimum length (in tokens) of the generated text, including the input. - **min_new_tokens** (integer): The minimum number of tokens to generate. Takes precedence over min_length. - **do_sample** (boolean): Whether to use sampling instead of greedy decoding when generating new tokens. - **early_stopping** (enum): Possible values: never, true, false. - **num_beams** (integer): Number of beams to use for beam search. - **num_beam_groups** (integer): Number of groups to divide num_beams into in order to ensure diversity among different groups of beams. See this paper for more details. - **penalty_alpha** (float): The value balances the model confidence and the degeneration penalty in contrastive search decoding. - **use_cache** (boolean): Whether the model should use the past last key/values attentions to speed up decoding

Check the full API Specification at [the Hugging Face Inference documentation](https://huggingface.co/docs/inference-providers/tasks/automatic-speech-recognition#api-specification).

Specifications & capabilities

Input
audio
Output
text
Published model ID
m-ctc-t-large
Capabilities
audioInput

Evaluations

1–6 / 6

MTEB

56.336%

source id
mteb
leaderboard name
MTEB Pair Classification
dimension
embedding
metric
Average task score
rank
262
sample size
5
aggregation scope
splits
  • test
subsets
  • default
task_count
5
task_names
  • CREMADPairClassification
  • ESC50PairClassification
  • NMSQAPairClassification
  • VocalSoundPairClassification
  • VoxPopuliAccentPairClassification
sample_size
5
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • ed014c8255cea2c36f87a71cf2533b665ba00863
source model id
speechbrain/m-ctc-t-large
Original result ↗

MTEB

44.396%

source id
mteb
leaderboard name
MTEB Reranking
dimension
embedding
metric
Average task score
rank
350
sample size
5
aggregation scope
splits
  • test
subsets
  • default
task_count
5
task_names
  • ESC50AudioReranking
  • FSDnoisy18kAudioReranking
  • GTZANAudioReranking
  • UrbanSound8KAudioReranking
  • VocalSoundAudioReranking
sample_size
5
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • ed014c8255cea2c36f87a71cf2533b665ba00863
source model id
speechbrain/m-ctc-t-large
Original result ↗

MTEB

46.851%

source id
mteb
leaderboard name
MTEB Retrieval
dimension
embedding
metric
Average task score
rank
515
sample size
4
aggregation scope
splits
  • test
subsets
  • de
  • en
  • es
  • fr
task_count
1
task_names
  • JamAltArtistA2ARetrieval
sample_size
4
subset_count
4
subset_sample
  • de
  • en
  • es
  • fr
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • ed014c8255cea2c36f87a71cf2533b665ba00863
source model id
speechbrain/m-ctc-t-large
Original result ↗

MTEB

39.383%

source id
mteb
leaderboard name
MTEB Other
dimension
embedding
metric
Average task score
rank
659
sample size
144
aggregation scope
splits
  • test
  • train
subsets
  • afr_Latn
  • amh_Ethi
  • arb_Arab
  • asm_Beng
  • ast_Latn
  • azj_Latn
  • bel_Cyrl
  • ben_Beng
  • bos_Latn
  • bul_Cyrl
  • cat_Latn
  • ceb_Latn
  • ces_Latn
  • ckb_Arab
  • cs-CZ
  • curated
  • cym_Latn
  • dan_Latn
  • de-DE
  • default
  • deu_Latn
  • ell_Grek
  • en-GB
  • eng_Latn
  • es-ES
  • est_Latn
  • fin_Latn
  • fr-FR
  • fra_Latn
  • fuv_Latn
  • gaz_Latn
  • gle_Latn
  • glg_Latn
  • guj_Gujr
  • hau_Latn
  • heb_Hebr
  • hin_Deva
  • hrv_Latn
  • hun_Latn
  • hye_Armn
  • ibo_Latn
  • ind_Latn
  • isl_Latn
  • it-IT
  • ita_Latn
  • jav_Latn
  • jpn_Jpan
  • kam_Latn
  • kan_Knda
  • kat_Geor
  • kaz_Cyrl
  • kea_Latn
  • khk_Cyrl
  • khm_Khmr
  • kir_Cyrl
  • ko-KR
  • kor_Hang
  • lao_Laoo
  • lin_Latn
  • lit_Latn
  • ltz_Latn
  • lug_Latn
  • luo_Latn
  • lvs_Latn
  • mal_Mlym
  • mar_Deva
  • mkd_Cyrl
  • mlt_Latn
  • mri_Latn
  • mya_Mymr
  • nl-NL
  • nld_Latn
  • nob_Latn
  • noisy
  • npi_Deva
  • nso_Latn
  • nya_Latn
  • oci_Latn
  • ory_Orya
  • pan_Guru
  • pbt_Arab
  • pes_Arab
  • pl-PL
  • pol_Latn
  • por_Latn
  • pt-PT
  • ron_Latn
  • ru-RU
  • rus_Cyrl
  • slk_Latn
  • slv_Latn
  • sna_Latn
  • snd_Arab
  • som_Latn
  • spa_Latn
  • srp_Cyrl
  • swe_Latn
  • swh_Latn
  • tam_Taml
  • tel_Telu
  • tgk_Cyrl
  • tgl_Latn
  • tha_Thai
  • tur_Latn
  • ukr_Cyrl
  • umb_Latn
  • urd_Arab
  • uzn_Latn
  • vie_Latn
  • wol_Latn
  • xho_Latn
  • yor_Latn
  • zh-CN
  • zho_Hans
  • zho_Hant
  • zsm_Latn
  • zul_Latn
task_count
31
task_names
  • AmbientAcousticContext
  • AudioSetMini
  • BeijingOpera
  • BirdCLEF
  • CREMA_D
  • CommonLanguageAgeDetection
  • CommonLanguageGenderDetection
  • CommonLanguageLanguageDetection
  • ESC50
  • FSD2019Kaggle
  • FSD50K
  • FSDD
  • GTZANGenre
  • GunshotTriangulation
  • IEMOCAPEmotion
  • IEMOCAPGender
  • LibriCount
  • MInDS14
  • MridinghamStroke
  • MridinghamTonic
  • NSynth
  • SIBFLEURS
  • SpeechCommands
  • SpokeNEnglish
  • SpokenQAForIC
  • TUTAcousticScenes
  • VocalSound
  • VoxCelebSA
  • VoxLingua107_Top10
  • VoxPopuliAccentID
  • VoxPopuliGenderID
sample_size
144
subset_count
117
subset_sample
  • afr_Latn
  • amh_Ethi
  • arb_Arab
  • asm_Beng
  • ast_Latn
  • azj_Latn
  • bel_Cyrl
  • ben_Beng
  • bos_Latn
  • bul_Cyrl
  • cat_Latn
  • ceb_Latn
  • ces_Latn
  • ckb_Arab
  • cs-CZ
  • curated
  • cym_Latn
  • dan_Latn
  • de-DE
  • default
  • deu_Latn
  • ell_Grek
  • en-GB
  • eng_Latn
  • es-ES
  • est_Latn
  • fin_Latn
  • fr-FR
  • fra_Latn
  • fuv_Latn
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • ed014c8255cea2c36f87a71cf2533b665ba00863
source model id
speechbrain/m-ctc-t-large
Original result ↗

MTEB

10.428%

source id
mteb
leaderboard name
MTEB Clustering
dimension
embedding
metric
Average task score
rank
679
sample size
10
aggregation scope
splits
  • test
  • train
subsets
  • default
task_count
10
task_names
  • AmbientAcousticContextClustering
  • CREMA_DClustering
  • ESC50Clustering
  • GTZANGenreClustering
  • MusicGenreClustering
  • VehicleSoundClustering
  • VoiceGenderClustering
  • VoxCelebClustering
  • VoxPopuliAccentClustering
  • VoxPopuliGenderClustering
sample_size
10
subset_count
1
subset_sample
  • default
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • ed014c8255cea2c36f87a71cf2533b665ba00863
source model id
speechbrain/m-ctc-t-large
Original result ↗

MTEB

36.071%

source id
mteb
leaderboard name
MTEB Overall
dimension
embedding
metric
Average task score
rank
840
sample size
168
aggregation scope
splits
  • test
  • train
subsets
  • afr_Latn
  • amh_Ethi
  • arb_Arab
  • asm_Beng
  • ast_Latn
  • azj_Latn
  • bel_Cyrl
  • ben_Beng
  • bos_Latn
  • bul_Cyrl
  • cat_Latn
  • ceb_Latn
  • ces_Latn
  • ckb_Arab
  • cs-CZ
  • curated
  • cym_Latn
  • dan_Latn
  • de
  • de-DE
  • default
  • deu_Latn
  • ell_Grek
  • en
  • en-GB
  • eng_Latn
  • es
  • es-ES
  • est_Latn
  • fin_Latn
  • fr
  • fr-FR
  • fra_Latn
  • fuv_Latn
  • gaz_Latn
  • gle_Latn
  • glg_Latn
  • guj_Gujr
  • hau_Latn
  • heb_Hebr
  • hin_Deva
  • hrv_Latn
  • hun_Latn
  • hye_Armn
  • ibo_Latn
  • ind_Latn
  • isl_Latn
  • it-IT
  • ita_Latn
  • jav_Latn
  • jpn_Jpan
  • kam_Latn
  • kan_Knda
  • kat_Geor
  • kaz_Cyrl
  • kea_Latn
  • khk_Cyrl
  • khm_Khmr
  • kir_Cyrl
  • ko-KR
  • kor_Hang
  • lao_Laoo
  • lin_Latn
  • lit_Latn
  • ltz_Latn
  • lug_Latn
  • luo_Latn
  • lvs_Latn
  • mal_Mlym
  • mar_Deva
  • mkd_Cyrl
  • mlt_Latn
  • mri_Latn
  • mya_Mymr
  • nl-NL
  • nld_Latn
  • nob_Latn
  • noisy
  • npi_Deva
  • nso_Latn
  • nya_Latn
  • oci_Latn
  • ory_Orya
  • pan_Guru
  • pbt_Arab
  • pes_Arab
  • pl-PL
  • pol_Latn
  • por_Latn
  • pt-PT
  • ron_Latn
  • ru-RU
  • rus_Cyrl
  • slk_Latn
  • slv_Latn
  • sna_Latn
  • snd_Arab
  • som_Latn
  • spa_Latn
  • srp_Cyrl
  • swe_Latn
  • swh_Latn
  • tam_Taml
  • tel_Telu
  • tgk_Cyrl
  • tgl_Latn
  • tha_Thai
  • tur_Latn
  • ukr_Cyrl
  • umb_Latn
  • urd_Arab
  • uzn_Latn
  • vie_Latn
  • wol_Latn
  • xho_Latn
  • yor_Latn
  • zh-CN
  • zho_Hans
  • zho_Hant
  • zsm_Latn
  • zul_Latn
task_count
52
task_names
  • AmbientAcousticContext
  • AmbientAcousticContextClustering
  • AudioSetMini
  • BeijingOpera
  • BirdCLEF
  • CREMADPairClassification
  • CREMA_D
  • CREMA_DClustering
  • CommonLanguageAgeDetection
  • CommonLanguageGenderDetection
  • CommonLanguageLanguageDetection
  • ESC50
  • ESC50AudioReranking
  • ESC50Clustering
  • ESC50PairClassification
  • FSD2019Kaggle
  • FSD50K
  • FSDD
  • FSDnoisy18kAudioReranking
  • GTZANAudioReranking
  • GTZANGenre
  • GTZANGenreClustering
  • GunshotTriangulation
  • IEMOCAPEmotion
  • IEMOCAPGender
  • JamAltArtistA2ARetrieval
  • LibriCount
  • MInDS14
  • MridinghamStroke
  • MridinghamTonic
  • MusicGenreClustering
  • NMSQAPairClassification
  • NSynth
  • SIBFLEURS
  • SpeechCommands
  • SpokeNEnglish
  • SpokenQAForIC
  • TUTAcousticScenes
  • UrbanSound8KAudioReranking
  • VehicleSoundClustering
  • VocalSound
  • VocalSoundAudioReranking
  • VocalSoundPairClassification
  • VoiceGenderClustering
  • VoxCelebClustering
  • VoxCelebSA
  • VoxLingua107_Top10
  • VoxPopuliAccentClustering
  • VoxPopuliAccentID
  • VoxPopuliAccentPairClassification
  • VoxPopuliGenderClustering
  • VoxPopuliGenderID
sample_size
168
subset_count
121
subset_sample
  • afr_Latn
  • amh_Ethi
  • arb_Arab
  • asm_Beng
  • ast_Latn
  • azj_Latn
  • bel_Cyrl
  • ben_Beng
  • bos_Latn
  • bul_Cyrl
  • cat_Latn
  • ceb_Latn
  • ces_Latn
  • ckb_Arab
  • cs-CZ
  • curated
  • cym_Latn
  • dan_Latn
  • de
  • de-DE
  • default
  • deu_Latn
  • ell_Grek
  • en
  • en-GB
  • eng_Latn
  • es
  • es-ES
  • est_Latn
  • fin_Latn
aggregation_method
mean-of-task-means
model_revision_count
1
model_revision_sample
  • ed014c8255cea2c36f87a71cf2533b665ba00863
source model id
speechbrain/m-ctc-t-large
Original result ↗

Provider specifications & access

1–1 / 1

speechbrain/m-ctc-t-large ↗

source model id
HuggingFace/speechbrain-m-ctc-t-large@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
apache-2.0
architecture
input_modalities
  • audio
output_modalities
  • text
capabilities

    Original sources

    1–5 / 5

    Hugging Face · speechbrain/m-ctc-t-large ↗

    Microsoft Foundry · Model page ↗

    Microsoft Foundry · Model documentation ↗

    Hugging Face · Catalog ↗

    Microsoft Foundry · Catalog ↗

    Source links

    1–2 / 2

    Explore more models

    Models

    Loading
    EVIDENCE / COMPARISON

    Benchmarks

    Explore every benchmark

    Loading

    These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

    Install TensorTrace