Open ASR Leaderboard
Indexed results from Open ASR Leaderboard. Each ranking retains its own metric and evaluation conditions.
🇵🇹 Portuguese · Average WER
openASR · Open ASR Leaderboard · 🇵🇹 Portuguese · Average WER · percent · Lower is better
- Mistral: Voxtral Small 24B 2507 STTmistralai3.77%
- NVIDIA: Nemotron 3.5 Transcribenvidia4.08%
- OpenAI: Whisper Large V3 Turboopenai4.62%
- Mistral: Voxtral Mini 3B 2507mistralai4.9%
- OpenAI: Whisper Large V3openai4.94%
- CohereLabs/cohere-transcribe-03-2026coherelabs6%
- NVIDIA: Parakeet TDT 0.6B v3nvidia6.08%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai6.22%
- nvidia/canary-1b-v2nvidia6.26%
- microsoft/VibeVoice-ASR-HFmicrosoft7.78%
- nvidia/nemotron-3.5-asr-streaming-0.6bnvidia8.25%
- google/gemma-4-E4B-itgoogle8.62%
🇪🇸 Spanish · Average WER
openASR · Open ASR Leaderboard · 🇪🇸 Spanish · Average WER · percent · Lower is better
- Mistral: Voxtral Small 24B 2507 STTmistralai2.6%
- CohereLabs/cohere-transcribe-03-2026coherelabs2.81%
- NVIDIA: Nemotron 3.5 Transcribenvidia2.82%
- nvidia/canary-1b-v2nvidia3.23%
- OpenAI: Whisper Large V3openai3.35%
- NVIDIA: Parakeet TDT 0.6B v3nvidia3.71%
- OpenAI: Whisper Large V3 Turboopenai3.85%
- Mistral: Voxtral Mini 3B 2507mistralai3.91%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai4.19%
- nvidia/nemotron-3.5-asr-streaming-0.6bnvidia5.44%
- google/gemma-4-E4B-itgoogle6.3%
- microsoft/VibeVoice-ASR-HFmicrosoft6.59%
Long-form · RTFx
openASR · Open ASR Leaderboard · Long-form · RTFx · realTimeFactor · Higher is better
es_fleurs (WER)
openASR · Open ASR Leaderboard · es_fleurs (WER) · percent · Lower is better
- OpenAI: Whisper Large V3openai2.31%
- nvidia/canary-1b-v2nvidia2.63%
- OpenAI: Whisper Large V3 Turboopenai2.7%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai2.82%
- Mistral: Voxtral Small 24B 2507 STTmistralai2.86%
- Qwen: Qwen3 ASR 1.7Bqwen3%
- NVIDIA: Parakeet TDT 0.6B v3nvidia3.24%
- CohereLabs/cohere-transcribe-03-2026coherelabs3.44%
- Mistral: Voxtral Mini 3B 2507mistralai3.47%
- Qwen: Qwen3 ASR 0.6Bqwen4.46%
English · LS Clean (WER)
openASR · Open ASR Leaderboard · English · LS Clean (WER) · percent · Lower is better
- CohereLabs/cohere-transcribe-03-2026coherelabs0.97%
- ibm-granite/granite-speech-4.1-2bibm-granite1.03%
- NVIDIA: Nemotron 3.5 Transcribenvidia1.09%
- ibm-granite/granite-4.0-1b-speechibm-granite1.11%
- Mistral: Voxtral Small 24B 2507 STTmistralai1.23%
- nvidia/parakeet-tdt-0.6b-v2nvidia1.28%
- Mistral: Voxtral Mini 3B 2507mistralai1.48%
- NVIDIA: Parakeet TDT 0.6B v3nvidia1.52%
- microsoft/VibeVoice-ASR-HFmicrosoft1.56%
- OpenAI: Whisper Large V3openai1.56%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai1.62%
- nvidia/canary-1b-v2nvidia1.76%
🇵🇹 Portuguese · MLS (WER)
openASR · Open ASR Leaderboard · 🇵🇹 Portuguese · MLS (WER) · percent · Lower is better
- NVIDIA: Nemotron 3.5 Transcribenvidia5.05%
- Mistral: Voxtral Small 24B 2507 STTmistralai5.07%
- OpenAI: Whisper Large V3 Turboopenai5.47%
- OpenAI: Whisper Large V3openai6.37%
- Mistral: Voxtral Mini 3B 2507mistralai6.62%
- NVIDIA: Parakeet TDT 0.6B v3nvidia7.69%
- CohereLabs/cohere-transcribe-03-2026coherelabs7.76%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai7.98%
- nvidia/canary-1b-v2nvidia8.34%
- microsoft/VibeVoice-ASR-HFmicrosoft9.9%
- nvidia/nemotron-3.5-asr-streaming-0.6bnvidia10.69%
- google/gemma-4-E4B-itgoogle12.83%
URGENT2024 WER (WER)
openASR · Open ASR Leaderboard · URGENT2024 WER (WER) · percent · Lower is better
- CohereLabs/cohere-transcribe-03-2026coherelabs9.5%
- ibm-granite/granite-speech-4.1-2bibm-granite11.25%
- nvidia/parakeet-tdt-0.6b-v2nvidia11.42%
- NVIDIA: Parakeet TDT 0.6B v3nvidia11.52%
- ibm-granite/granite-4.0-1b-speechibm-granite11.99%
- Mistral: Voxtral Small 24B 2507 STTmistralai12.35%
- OpenAI: Whisper Large V3 Turboopenai13.69%
- OpenAI: Whisper Large V3openai13.73%
- nvidia/canary-1b-v2nvidia14.56%
- nvidia/parakeet-ctc-1.1bnvidia14.88%
- Mistral: Voxtral Mini 3B 2507mistralai15.66%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai17.95%
fr_covost (WER)
openASR · Open ASR Leaderboard · fr_covost (WER) · percent · Lower is better
- CohereLabs/cohere-transcribe-03-2026coherelabs4.96%
- Mistral: Voxtral Small 24B 2507 STTmistralai5.6%
- NVIDIA: Parakeet TDT 0.6B v3nvidia6.38%
- nvidia/canary-1b-v2nvidia6.62%
- Qwen: Qwen3 ASR 1.7Bqwen7.97%
- Mistral: Voxtral Mini 3B 2507mistralai8.07%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai9.68%
- OpenAI: Whisper Large V3openai10.18%
- Qwen: Qwen3 ASR 0.6Bqwen10.85%
- OpenAI: Whisper Large V3 Turboopenai11.4%
English · LS Other (WER)
openASR · Open ASR Leaderboard · English · LS Other (WER) · percent · Lower is better
- CohereLabs/cohere-transcribe-03-2026coherelabs2.05%
- ibm-granite/granite-speech-4.1-2bibm-granite2.19%
- ibm-granite/granite-4.0-1b-speechibm-granite2.5%
- NVIDIA: Nemotron 3.5 Transcribenvidia2.62%
- nvidia/parakeet-tdt-0.6b-v2nvidia2.73%
- Mistral: Voxtral Small 24B 2507 STTmistralai2.8%
- nvidia/canary-1b-v2nvidia3.07%
- NVIDIA: Parakeet TDT 0.6B v3nvidia3.13%
- OpenAI: Whisper Large V3openai3.52%
- Mistral: Voxtral Mini 3B 2507mistralai3.63%
- OpenAI: Whisper Large V3 Turboopenai3.71%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai4.94%
English · Gigaspeech-Cleaned (WER)
openASR · Open ASR Leaderboard · English · Gigaspeech-Cleaned (WER) · percent · Lower is better
- NVIDIA: Nemotron 3.5 Transcribenvidia7.18%
- microsoft/VibeVoice-ASR-HFmicrosoft7.87%
- CohereLabs/cohere-transcribe-03-2026coherelabs7.88%
- NVIDIA: Parakeet TDT 0.6B v3nvidia7.99%
- nvidia/parakeet-tdt-0.6b-v2nvidia8.15%
- ibm-granite/granite-speech-4.1-2bibm-granite8.18%
- Mistral: Voxtral Small 24B 2507 STTmistralai8.32%
- OpenAI: Whisper Large V3openai8.35%
- ibm-granite/granite-4.0-1b-speechibm-granite8.44%
- OpenAI: Whisper Large V3 Turboopenai8.47%
- Mistral: Voxtral Mini 3B 2507mistralai8.7%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai8.8%
FLEURS WER (WER)
openASR · Open ASR Leaderboard · FLEURS WER (WER) · percent · Lower is better
- Mistral: Voxtral Small 24B 2507 STTmistralai2.61%
- OpenAI: Whisper Large V3openai3.2%
- CohereLabs/cohere-transcribe-03-2026coherelabs3.33%
- nvidia/canary-1b-v2nvidia3.43%
- Mistral: Voxtral Mini 3B 2507mistralai3.64%
- OpenAI: Whisper Large V3 Turboopenai3.67%
- NVIDIA: Parakeet TDT 0.6B v3nvidia4.16%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai4.87%
- google/gemma-4-E4B-itgoogle5.75%
- microsoft/VibeVoice-ASR-HFmicrosoft7.44%
- nvidia/nemotron-3.5-asr-streaming-0.6bnvidia8.46%
🇫🇷 French · FLEURS (WER)
openASR · Open ASR Leaderboard · 🇫🇷 French · FLEURS (WER) · percent · Lower is better
- Mistral: Voxtral Small 24B 2507 STTmistralai2.99%
- NVIDIA: Nemotron 3.5 Transcribenvidia3.46%
- Mistral: Voxtral Mini 3B 2507mistralai4%
- CohereLabs/cohere-transcribe-03-2026coherelabs4.33%
- nvidia/canary-1b-v2nvidia4.35%
- NVIDIA: Parakeet TDT 0.6B v3nvidia4.7%
- OpenAI: Whisper Large V3openai4.83%
- OpenAI: Whisper Large V3 Turboopenai4.92%
- google/gemma-4-E4B-itgoogle7.41%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai8.2%
- nvidia/nemotron-3.5-asr-streaming-0.6bnvidia9.86%
- microsoft/VibeVoice-ASR-HFmicrosoft11.3%
Models
LoadingBenchmarks
Explore every benchmark
LoadingThese charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.