facebook/data2vec-audio-large-960h
`facebook/data2vec-audio-large-960h` powered by Hugging Face Inference Toolkit - [Original Model Card](https://huggingface.co/facebook/data2vec-audio-large-960h) - [`automatic-speech-recognition` Tas…
azureFoundry/HuggingFace/facebook-data2vec-audio-large-960h@1
facebook/data2vec-audio-large-960h powered by Hugging Face Inference Toolkit
Send Request
You can use cURL or any REST Client to send a request to the AzureML endpoint with your AzureML token.
curl <AZUREML_ENDPOINT_URL> \
-X POST \
-H "Authorization: Bearer <AZUREML_TOKEN>" \
-H "Content-Type: audio/flac" \
--data-binary @"audio.flac"
Supported Parameters
- inputs (string): The input audio data as a base64-encoded string. If no parameters are provided, you can also provide the audio data as a raw bytes payload.
- parameters (object):
- return_timestamps (boolean): Whether to output corresponding timestamps with the generated text
- generation_parameters (object):
- temperature (float): The value used to modulate the next token probabilities.
- top_k (integer): The number of highest probability vocabulary tokens to keep for top-k-filtering.
- top_p (float): If set to float < 1, only the smallest set of most probable tokens with probabilities that add up to top_p or higher are kept for generation.
- typical_p (float): Local typicality measures how similar the conditional probability of predicting a target token next is to the expected conditional probability of predicting a random token next, given the partial text already generated. If set to float < 1, the smallest set of the most locally typical tokens with probabilities that add up to typical_p or higher are kept for generation. See this paper for more details.
- epsilon_cutoff (float): If set to float strictly between 0 and 1, only tokens with a conditional probability greater than epsilon_cutoff will be sampled. In the paper, suggested values range from 3e-4 to 9e-4, depending on the size of the model. See Truncation Sampling as Language Model Desmoothing for more details.
- eta_cutoff (float): Eta sampling is a hybrid of locally typical sampling and epsilon sampling. If set to float strictly between 0 and 1, a token is only considered if it is greater than either eta_cutoff or sqrt(eta_cutoff) * exp(-entropy(softmax(next_token_logits))). The latter term is intuitively the expected next token probability, scaled by sqrt(eta_cutoff). In the paper, suggested values range from 3e-4 to 2e-3, depending on the size of the model. See Truncation Sampling as Language Model Desmoothing for more details.
- max_length (integer): The maximum length (in tokens) of the generated text, including the input.
- max_new_tokens (integer): The maximum number of tokens to generate. Takes precedence over max_length.
- min_length (integer): The minimum length (in tokens) of the generated text, including the input.
- min_new_tokens (integer): The minimum number of tokens to generate. Takes precedence over min_length.
- do_sample (boolean): Whether to use sampling instead of greedy decoding when generating new tokens.
- early_stopping (enum): Possible values: never, true, false.
- num_beams (integer): Number of beams to use for beam search.
- num_beam_groups (integer): Number of groups to divide num_beams into in order to ensure diversity among different groups of beams. See this paper for more details.
- penalty_alpha (float): The value balances the model confidence and the degeneration penalty in contrastive search decoding.
- use_cache (boolean): Whether the model should use the past last key/values attentions to speed up decoding
Check the full API Specification at the Hugging Face Inference documentation.
Specifications & capabilities
- Input
- audio
- Output
- text
- Published model ID
- data2vec-audio-large-960h
- Capabilities
- audioInput
Evaluations
1–6 / 6
57.05%
- source id
- mteb
- leaderboard name
- MTEB Pair Classification
- dimension
- embedding
- metric
- Average task score
- rank
- 244
- sample size
- 5
- aggregation scope
- task_count
- 5
- task_names
- CREMADPairClassification
- ESC50PairClassification
- NMSQAPairClassification
- VocalSoundPairClassification
- VoxPopuliAccentPairClassification
- sample_size
- 5
- subset_count
- 1
- aggregation_method
- mean-of-task-means
- model_revision_count
- 1
- model_revision_sample
- 27aba26eed532b86dcd0f17284a0307de4b51f39
- source model id
- facebook/data2vec-audio-large-960h
Original result ↗45.558%
- source id
- mteb
- leaderboard name
- MTEB Reranking
- dimension
- embedding
- metric
- Average task score
- rank
- 334
- sample size
- 5
- aggregation scope
- task_count
- 5
- task_names
- ESC50AudioReranking
- FSDnoisy18kAudioReranking
- GTZANAudioReranking
- UrbanSound8KAudioReranking
- VocalSoundAudioReranking
- sample_size
- 5
- subset_count
- 1
- aggregation_method
- mean-of-task-means
- model_revision_count
- 1
- model_revision_sample
- 27aba26eed532b86dcd0f17284a0307de4b51f39
- source model id
- facebook/data2vec-audio-large-960h
Original result ↗42.466%
- source id
- mteb
- leaderboard name
- MTEB Retrieval
- dimension
- embedding
- metric
- Average task score
- rank
- 566
- sample size
- 4
- aggregation scope
- task_count
- 1
- sample_size
- 4
- subset_count
- 4
- aggregation_method
- mean-of-task-means
- model_revision_count
- 1
- model_revision_sample
- 27aba26eed532b86dcd0f17284a0307de4b51f39
- source model id
- facebook/data2vec-audio-large-960h
Original result ↗9.678%
- source id
- mteb
- leaderboard name
- MTEB Clustering
- dimension
- embedding
- metric
- Average task score
- rank
- 684
- sample size
- 10
- aggregation scope
- task_count
- 10
- task_names
- AmbientAcousticContextClustering
- CREMA_DClustering
- ESC50Clustering
- GTZANGenreClustering
- MusicGenreClustering
- VehicleSoundClustering
- VoiceGenderClustering
- VoxCelebClustering
- VoxPopuliAccentClustering
- VoxPopuliGenderClustering
- sample_size
- 10
- subset_count
- 1
- aggregation_method
- mean-of-task-means
- model_revision_count
- 1
- model_revision_sample
- 27aba26eed532b86dcd0f17284a0307de4b51f39
- source model id
- facebook/data2vec-audio-large-960h
Original result ↗36.302%
- source id
- mteb
- leaderboard name
- MTEB Other
- dimension
- embedding
- metric
- Average task score
- rank
- 702
- sample size
- 147
- aggregation scope
- task_count
- 34
- task_names
- AmbientAcousticContext
- AudioSetMini
- BeijingOpera
- BirdCLEF
- BirdSet
- CREMA_D
- CommonLanguageAgeDetection
- CommonLanguageGenderDetection
- CommonLanguageLanguageDetection
- ESC50
- FSD2019Kaggle
- FSD50K
- FSDD
- GTZANGenre
- GunshotTriangulation
- IEMOCAPEmotion
- IEMOCAPGender
- LibriCount
- MInDS14
- MridinghamStroke
- MridinghamTonic
- NSynth
- SIBFLEURS
- SpeechCommands
- SpokeNEnglish
- SpokenQAForIC
- TUTAcousticScenes
- UrbanSound8k
- VocalSound
- VoxCelebSA
- VoxLingua107_Top10
- VoxPopuliAccentID
- VoxPopuliGenderID
- VoxPopuliLanguageID
- sample_size
- 147
- subset_count
- 117
- subset_sample
- afr_Latn
- amh_Ethi
- arb_Arab
- asm_Beng
- ast_Latn
- azj_Latn
- bel_Cyrl
- ben_Beng
- bos_Latn
- bul_Cyrl
- cat_Latn
- ceb_Latn
- ces_Latn
- ckb_Arab
- cs-CZ
- curated
- cym_Latn
- dan_Latn
- de-DE
- default
- deu_Latn
- ell_Grek
- en-GB
- eng_Latn
- es-ES
- est_Latn
- fin_Latn
- fr-FR
- fra_Latn
- fuv_Latn
- aggregation_method
- mean-of-task-means
- model_revision_count
- 1
- model_revision_sample
- 27aba26eed532b86dcd0f17284a0307de4b51f39
- source model id
- facebook/data2vec-audio-large-960h
Original result ↗34.301%
- source id
- mteb
- leaderboard name
- MTEB Overall
- dimension
- embedding
- metric
- Average task score
- rank
- 865
- sample size
- 171
- aggregation scope
- task_count
- 55
- task_names
- AmbientAcousticContext
- AmbientAcousticContextClustering
- AudioSetMini
- BeijingOpera
- BirdCLEF
- BirdSet
- CREMADPairClassification
- CREMA_D
- CREMA_DClustering
- CommonLanguageAgeDetection
- CommonLanguageGenderDetection
- CommonLanguageLanguageDetection
- ESC50
- ESC50AudioReranking
- ESC50Clustering
- ESC50PairClassification
- FSD2019Kaggle
- FSD50K
- FSDD
- FSDnoisy18kAudioReranking
- GTZANAudioReranking
- GTZANGenre
- GTZANGenreClustering
- GunshotTriangulation
- IEMOCAPEmotion
- IEMOCAPGender
- JamAltArtistA2ARetrieval
- LibriCount
- MInDS14
- MridinghamStroke
- MridinghamTonic
- MusicGenreClustering
- NMSQAPairClassification
- NSynth
- SIBFLEURS
- SpeechCommands
- SpokeNEnglish
- SpokenQAForIC
- TUTAcousticScenes
- UrbanSound8KAudioReranking
- UrbanSound8k
- VehicleSoundClustering
- VocalSound
- VocalSoundAudioReranking
- VocalSoundPairClassification
- VoiceGenderClustering
- VoxCelebClustering
- VoxCelebSA
- VoxLingua107_Top10
- VoxPopuliAccentClustering
- VoxPopuliAccentID
- VoxPopuliAccentPairClassification
- VoxPopuliGenderClustering
- VoxPopuliGenderID
- VoxPopuliLanguageID
- sample_size
- 171
- subset_count
- 121
- subset_sample
- afr_Latn
- amh_Ethi
- arb_Arab
- asm_Beng
- ast_Latn
- azj_Latn
- bel_Cyrl
- ben_Beng
- bos_Latn
- bul_Cyrl
- cat_Latn
- ceb_Latn
- ces_Latn
- ckb_Arab
- cs-CZ
- curated
- cym_Latn
- dan_Latn
- de
- de-DE
- default
- deu_Latn
- ell_Grek
- en
- en-GB
- eng_Latn
- es
- es-ES
- est_Latn
- fin_Latn
- aggregation_method
- mean-of-task-means
- model_revision_count
- 1
- model_revision_sample
- 27aba26eed532b86dcd0f17284a0307de4b51f39
- source model id
- facebook/data2vec-audio-large-960h
Original result ↗Provider specifications & access
1–1 / 1
- source model id
- HuggingFace/facebook-data2vec-audio-large-960h@1
- hosting
- foundry-managed-compute
- license
- apache-2.0
Safety assessments
1–1 / 1
31 / 100
- source id
- stanfordFMTI
- canonical model id
- azureFoundry/HuggingFace/facebook-data2vec-audio-large-960h@1
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Meta
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 31 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Explore more models