Open ASR Leaderboard

Indexed results from Open ASR Leaderboard. Each ranking retains its own metric and evaluation conditions.

🇦🇲 Armenian · RTFx

openASR · Open ASR Leaderboard · 🇦🇲 Armenian · RTFx · realTimeFactor · Higher is better

  1. facebook/mms-1b-allmeta-llama973.6
  2. OpenAI: Whisper Large V3openai73.36

🇮🇹 Italian · FLEURS (WER)

openASR · Open ASR Leaderboard · 🇮🇹 Italian · FLEURS (WER) · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai1.29%
  2. NVIDIA: Nemotron 3.5 Transcribenvidia1.48%
  3. Mistral: Voxtral Mini 3B 2507mistralai1.8%
  4. OpenAI: Whisper Large V3openai2.28%
  5. CohereLabs/cohere-transcribe-03-2026coherelabs2.34%
  6. nvidia/canary-1b-v2nvidia2.36%
  7. NVIDIA: Parakeet TDT 0.6B v3nvidia2.48%
  8. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai2.99%
  9. OpenAI: Whisper Large V3 Turboopenai3.3%
  10. google/gemma-4-E4B-itgoogle3.34%
  11. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia4.9%
  12. microsoft/VibeVoice-ASR-HFmicrosoft5.91%

RTFx

openASR · Open ASR Leaderboard · RTFx · realTimeFactor · Higher is better

  1. NVIDIA: Parakeet TDT 0.6B v3nvidia3,427.19
  2. nvidia/canary-1b-v2nvidia1,361.57
  3. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,205.22
  4. CohereLabs/cohere-transcribe-03-2026coherelabs687.45
  5. OpenAI: Whisper Large V3 Turboopenai423
  6. OpenAI: Whisper Large V3openai368.86
  7. Mistral: Voxtral Mini 3B 2507mistralai169.73
  8. google/gemma-4-E4B-itgoogle141.14
  9. microsoft/VibeVoice-ASR-HFmicrosoft126
  10. Mistral: Voxtral Small 24B 2507 STTmistralai97.63
  11. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai49.22

fr_mls (WER)

openASR · Open ASR Leaderboard · fr_mls (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs2.39%
  2. Mistral: Voxtral Small 24B 2507 STTmistralai3.22%
  3. nvidia/canary-1b-v2nvidia3.44%
  4. OpenAI: Whisper Large V3openai3.92%
  5. OpenAI: Whisper Large V3 Turboopenai4.27%
  6. Mistral: Voxtral Mini 3B 2507mistralai5%
  7. Qwen: Qwen3 ASR 1.7Bqwen5.09%
  8. NVIDIA: Parakeet TDT 0.6B v3nvidia5.12%
  9. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai5.64%
  10. Qwen: Qwen3 ASR 0.6Bqwen8.52%

FLEURS WER (WER)

openASR · Open ASR Leaderboard · FLEURS WER (WER) · percent · Lower is better

  1. OpenAI: Whisper Large V3openai2.3%
  2. nvidia/canary-1b-v2nvidia2.63%
  3. OpenAI: Whisper Large V3 Turboopenai2.73%
  4. Mistral: Voxtral Small 24B 2507 STTmistralai2.79%
  5. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai2.8%
  6. Mistral: Voxtral Mini 3B 2507mistralai3.25%
  7. NVIDIA: Parakeet TDT 0.6B v3nvidia3.25%
  8. CohereLabs/cohere-transcribe-03-2026coherelabs3.26%
  9. microsoft/VibeVoice-ASR-HFmicrosoft3.58%
  10. google/gemma-4-E4B-itgoogle3.64%
  11. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia4.23%

AMI-Cleaned RTFx

openASR · Open ASR Leaderboard · AMI-Cleaned RTFx · realTimeFactor · Higher is better

  1. nvidia/parakeet-tdt-0.6b-v2nvidia4,086.941
  2. NVIDIA: Parakeet TDT 0.6B v3nvidia3,757.274
  3. nvidia/parakeet-ctc-1.1bnvidia3,584.114
  4. nvidia/canary-1b-v2nvidia1,509.446
  5. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,122.433
  6. CohereLabs/cohere-transcribe-03-2026coherelabs822.662
  7. ibm-granite/granite-4.0-1b-speechibm-granite596.814
  8. ibm-granite/granite-speech-4.1-2bibm-granite449.611
  9. ibm-granite/granite-speech-3.3-2bibm-granite448.14
  10. OpenAI: Whisper Large V3 Turboopenai372.662
  11. OpenAI: Whisper Large V3openai284.247
  12. google/gemma-4-E2B-itgoogle130.799

🇳🇱 Dutch · MLS (WER)

openASR · Open ASR Leaderboard · 🇳🇱 Dutch · MLS (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs3.5%
  2. OpenAI: Whisper Large V3openai4.82%
  3. OpenAI: Whisper Large V3 Turboopenai5.02%
  4. Mistral: Voxtral Small 24B 2507 STTmistralai5.62%
  5. Mistral: Voxtral Mini 3B 2507mistralai8.04%
  6. NVIDIA: Nemotron 3.5 Transcribenvidia8.41%
  7. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai9.06%
  8. nvidia/canary-1b-v2nvidia9.33%
  9. NVIDIA: Parakeet TDT 0.6B v3nvidia10.78%
  10. microsoft/VibeVoice-ASR-HFmicrosoft11.27%
  11. google/gemma-4-E4B-itgoogle13.81%
  12. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia15.9%

🇮🇹 Italian · RTFx

openASR · Open ASR Leaderboard · 🇮🇹 Italian · RTFx · realTimeFactor · Higher is better

  1. NVIDIA: Parakeet TDT 0.6B v3nvidia3,427.19
  2. nvidia/canary-1b-v2nvidia1,361.57
  3. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,205.22
  4. CohereLabs/cohere-transcribe-03-2026coherelabs687.45
  5. OpenAI: Whisper Large V3 Turboopenai423
  6. NVIDIA: Nemotron 3.5 Transcribenvidia381.16
  7. OpenAI: Whisper Large V3openai368.86
  8. Mistral: Voxtral Mini 3B 2507mistralai169.73
  9. google/gemma-4-E4B-itgoogle141.14
  10. microsoft/VibeVoice-ASR-HFmicrosoft126
  11. Mistral: Voxtral Small 24B 2507 STTmistralai97.63
  12. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai49.22

🇩🇪 German · Average WER

openASR · Open ASR Leaderboard · 🇩🇪 German · Average WER · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai2.58%
  2. NVIDIA: Nemotron 3.5 Transcribenvidia2.79%
  3. CohereLabs/cohere-transcribe-03-2026coherelabs3.1%
  4. OpenAI: Whisper Large V3openai4%
  5. nvidia/canary-1b-v2nvidia4.06%
  6. NVIDIA: Parakeet TDT 0.6B v3nvidia4.12%
  7. Mistral: Voxtral Mini 3B 2507mistralai4.27%
  8. OpenAI: Whisper Large V3 Turboopenai6.12%
  9. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai6.34%
  10. google/gemma-4-E4B-itgoogle7.59%
  11. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia8.94%
  12. microsoft/VibeVoice-ASR-HFmicrosoft14.12%

Gigaspeech-Cleaned RTFx

openASR · Open ASR Leaderboard · Gigaspeech-Cleaned RTFx · realTimeFactor · Higher is better

  1. nvidia/parakeet-tdt-0.6b-v2nvidia6,201.137
  2. NVIDIA: Parakeet TDT 0.6B v3nvidia5,682.681
  3. nvidia/parakeet-ctc-1.1bnvidia4,911.226
  4. nvidia/canary-1b-v2nvidia1,562.163
  5. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,281.035
  6. CohereLabs/cohere-transcribe-03-2026coherelabs895.091
  7. OpenAI: Whisper Large V3 Turboopenai647.763
  8. ibm-granite/granite-4.0-1b-speechibm-granite629.272
  9. ibm-granite/granite-speech-4.1-2bibm-granite557.978
  10. ibm-granite/granite-speech-3.3-2bibm-granite427.389
  11. OpenAI: Whisper Large V3openai377.186
  12. microsoft/VibeVoice-ASR-HFmicrosoft203.851

MCV WER (WER)

openASR · Open ASR Leaderboard · MCV WER (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs2.79%
  2. Mistral: Voxtral Small 24B 2507 STTmistralai2.9%
  3. NVIDIA: Parakeet TDT 0.6B v3nvidia3.53%
  4. nvidia/canary-1b-v2nvidia3.94%
  5. OpenAI: Whisper Large V3openai4.29%
  6. Mistral: Voxtral Mini 3B 2507mistralai4.36%
  7. OpenAI: Whisper Large V3 Turboopenai4.98%
  8. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai5.02%
  9. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia6.91%
  10. google/gemma-4-E4B-itgoogle7.98%
  11. microsoft/VibeVoice-ASR-HFmicrosoft11.87%

🇪🇸 Spanish · FLEURS (WER)

openASR · Open ASR Leaderboard · 🇪🇸 Spanish · FLEURS (WER) · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai1.87%
  2. OpenAI: Whisper Large V3openai2.3%
  3. NVIDIA: Nemotron 3.5 Transcribenvidia2.35%
  4. Mistral: Voxtral Mini 3B 2507mistralai2.51%
  5. nvidia/canary-1b-v2nvidia2.63%
  6. OpenAI: Whisper Large V3 Turboopenai2.72%
  7. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai2.8%
  8. NVIDIA: Parakeet TDT 0.6B v3nvidia3.25%
  9. CohereLabs/cohere-transcribe-03-2026coherelabs3.26%
  10. microsoft/VibeVoice-ASR-HFmicrosoft3.58%
  11. google/gemma-4-E4B-itgoogle3.71%
  12. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia4.23%

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace