Open ASR Leaderboard
Indexed results from Open ASR Leaderboard. Each ranking retains its own metric and evaluation conditions.
🇵🇹 Portuguese · RTFx
openASR · Open ASR Leaderboard · 🇵🇹 Portuguese · RTFx · realTimeFactor · Higher is better
- NVIDIA: Parakeet TDT 0.6B v3nvidia3,256.94
- nvidia/canary-1b-v2nvidia1,367.04
- OpenAI: Whisper Large V3 Turboopenai974.13
- nvidia/nemotron-3.5-asr-streaming-0.6bnvidia869.33
- CohereLabs/cohere-transcribe-03-2026coherelabs571.98
- OpenAI: Whisper Large V3openai351.92
- NVIDIA: Nemotron 3.5 Transcribenvidia346.04
- Mistral: Voxtral Mini 3B 2507mistralai194.13
- google/gemma-4-E4B-itgoogle130.77
- microsoft/VibeVoice-ASR-HFmicrosoft123.34
- Mistral: Voxtral Small 24B 2507 STTmistralai122.84
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai39.75
English · URGENT24 (WER)
openASR · Open ASR Leaderboard · English · URGENT24 (WER) · percent · Lower is better
- CohereLabs/cohere-transcribe-03-2026coherelabs9.5%
- NVIDIA: Nemotron 3.5 Transcribenvidia10.94%
- ibm-granite/granite-speech-4.1-2bibm-granite11.25%
- nvidia/parakeet-tdt-0.6b-v2nvidia11.42%
- NVIDIA: Parakeet TDT 0.6B v3nvidia11.52%
- ibm-granite/granite-4.0-1b-speechibm-granite11.99%
- Mistral: Voxtral Small 24B 2507 STTmistralai12.34%
- OpenAI: Whisper Large V3 Turboopenai13.69%
- OpenAI: Whisper Large V3openai13.73%
- nvidia/canary-1b-v2nvidia14.56%
- Mistral: Voxtral Mini 3B 2507mistralai15.66%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai17.94%
RTFx
openASR · Open ASR Leaderboard · RTFx · realTimeFactor · Higher is better
- NVIDIA: Parakeet TDT 0.6B v3nvidia2,782.68
- nvidia/canary-1b-v2nvidia1,057.91
- nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,002.89
- OpenAI: Whisper Large V3 Turboopenai608.53
- CohereLabs/cohere-transcribe-03-2026coherelabs590.79
- OpenAI: Whisper Large V3openai300.76
- Mistral: Voxtral Mini 3B 2507mistralai149.59
- google/gemma-4-E4B-itgoogle113.04
- microsoft/VibeVoice-ASR-HFmicrosoft111.78
- Mistral: Voxtral Small 24B 2507 STTmistralai87.56
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai45.1
English · Voxpopuli-AA-Cleaned (WER)
openASR · Open ASR Leaderboard · English · Voxpopuli-AA-Cleaned (WER) · percent · Lower is better
- NVIDIA: Nemotron 3.5 Transcribenvidia1.89%
- Mistral: Voxtral Small 24B 2507 STTmistralai2%
- microsoft/VibeVoice-ASR-HFmicrosoft2.02%
- Mistral: Voxtral Mini 3B 2507mistralai2.22%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai2.6%
- NVIDIA: Parakeet TDT 0.6B v3nvidia3.05%
- nvidia/parakeet-tdt-0.6b-v2nvidia3.78%
- google/gemma-4-E4B-itgoogle4.09%
- ibm-granite/granite-speech-4.1-2bibm-granite4.18%
- nvidia/nemotron-3.5-asr-streaming-0.6bnvidia4.24%
- nvidia/canary-1b-v2nvidia4.39%
- ibm-granite/granite-4.0-1b-speechibm-granite4.41%
MLS WER (WER)
openASR · Open ASR Leaderboard · MLS WER (WER) · percent · Lower is better
- CohereLabs/cohere-transcribe-03-2026coherelabs2.44%
- Mistral: Voxtral Small 24B 2507 STTmistralai3.22%
- nvidia/canary-1b-v2nvidia3.45%
- OpenAI: Whisper Large V3openai3.9%
- OpenAI: Whisper Large V3 Turboopenai4.22%
- NVIDIA: Parakeet TDT 0.6B v3nvidia5.12%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai5.59%
- Mistral: Voxtral Mini 3B 2507mistralai5.96%
- microsoft/VibeVoice-ASR-HFmicrosoft6.96%
- nvidia/nemotron-3.5-asr-streaming-0.6bnvidia7.36%
- google/gemma-4-E4B-itgoogle9.53%
URGENT2024-Clean WER (WER)
openASR · Open ASR Leaderboard · URGENT2024-Clean WER (WER) · percent · Lower is better
- CohereLabs/cohere-transcribe-03-2026coherelabs4.45%
- ibm-granite/granite-speech-4.1-2bibm-granite4.95%
- ibm-granite/granite-4.0-1b-speechibm-granite5.16%
- Mistral: Voxtral Small 24B 2507 STTmistralai5.33%
- nvidia/parakeet-tdt-0.6b-v2nvidia5.38%
- NVIDIA: Parakeet TDT 0.6B v3nvidia5.52%
- nvidia/parakeet-ctc-1.1bnvidia5.72%
- OpenAI: Whisper Large V3 Turboopenai5.73%
- OpenAI: Whisper Large V3openai5.77%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai6.56%
- Mistral: Voxtral Mini 3B 2507mistralai6.56%
- nvidia/canary-1b-v2nvidia6.63%
URGENT2024 RTFx
openASR · Open ASR Leaderboard · URGENT2024 RTFx · realTimeFactor · Higher is better
- NVIDIA: Parakeet TDT 0.6B v3nvidia3,948.535
- nvidia/parakeet-tdt-0.6b-v2nvidia3,943.875
- nvidia/parakeet-ctc-1.1bnvidia3,431.419
- nvidia/canary-1b-v2nvidia1,498.604
- nvidia/nemotron-3.5-asr-streaming-0.6bnvidia981.722
- OpenAI: Whisper Large V3 Turboopenai709.07
- CohereLabs/cohere-transcribe-03-2026coherelabs652.179
- ibm-granite/granite-4.0-1b-speechibm-granite562.609
- ibm-granite/granite-speech-4.1-2bibm-granite490.931
- OpenAI: Whisper Large V3openai437.121
- google/gemma-4-E4B-itgoogle169.012
- Mistral: Voxtral Mini 3B 2507mistralai127.186
Earnings22 WER (WER)
openASR · Open ASR Leaderboard · Earnings22 WER (WER) · percent · Lower is better
- ibm-granite/granite-speech-4.1-2bibm-granite8.23%
- ibm-granite/granite-4.0-1b-speechibm-granite8.32%
- ibm-granite/granite-speech-3.3-2bibm-granite9.73%
- Mistral: Voxtral Small 24B 2507 STTmistralai10.16%
- Mistral: Voxtral Mini 3B 2507mistralai10.35%
- CohereLabs/cohere-transcribe-03-2026coherelabs10.37%
- NVIDIA: Parakeet TDT 0.6B v3nvidia10.77%
- nvidia/parakeet-tdt-0.6b-v2nvidia10.78%
- OpenAI: Whisper Large V3 Turboopenai11.07%
- nvidia/canary-1b-v2nvidia11.34%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai11.46%
- OpenAI: Whisper Large V3openai11.59%
Voice Arena Monsoon RTFx
openASR · Open ASR Leaderboard · Voice Arena Monsoon RTFx · realTimeFactor · Higher is better
- nvidia/parakeet-tdt-0.6b-v2nvidia5,032.582
- NVIDIA: Parakeet TDT 0.6B v3nvidia4,959.369
- nvidia/parakeet-ctc-1.1bnvidia4,455.626
- nvidia/canary-1b-v2nvidia1,987.691
- nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,495.864
- OpenAI: Whisper Large V3 Turboopenai1,002.476
- CohereLabs/cohere-transcribe-03-2026coherelabs757.855
- ibm-granite/granite-4.0-1b-speechibm-granite514.678
- OpenAI: Whisper Large V3openai506.069
- ibm-granite/granite-speech-3.3-2bibm-granite463.31
- ibm-granite/granite-speech-4.1-2bibm-granite454.555
- Mistral: Voxtral Mini 3B 2507mistralai181.576
fr_fleurs (WER)
openASR · Open ASR Leaderboard · fr_fleurs (WER) · percent · Lower is better
- Mistral: Voxtral Small 24B 2507 STTmistralai3.57%
- Qwen: Qwen3 ASR 1.7Bqwen4.17%
- Mistral: Voxtral Mini 3B 2507mistralai4.33%
- nvidia/canary-1b-v2nvidia4.43%
- NVIDIA: Parakeet TDT 0.6B v3nvidia4.76%
- CohereLabs/cohere-transcribe-03-2026coherelabs4.8%
- OpenAI: Whisper Large V3openai4.98%
- OpenAI: Whisper Large V3 Turboopenai5.04%
- Qwen: Qwen3 ASR 0.6Bqwen7.07%
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai8.44%
🇳🇱 Dutch · RTFx
openASR · Open ASR Leaderboard · 🇳🇱 Dutch · RTFx · realTimeFactor · Higher is better
- NVIDIA: Parakeet TDT 0.6B v3nvidia2,782.68
- nvidia/canary-1b-v2nvidia1,057.91
- nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,002.89
- OpenAI: Whisper Large V3 Turboopenai608.53
- CohereLabs/cohere-transcribe-03-2026coherelabs590.79
- NVIDIA: Nemotron 3.5 Transcribenvidia314.89
- OpenAI: Whisper Large V3openai300.76
- Mistral: Voxtral Mini 3B 2507mistralai149.59
- google/gemma-4-E4B-itgoogle113.04
- microsoft/VibeVoice-ASR-HFmicrosoft111.78
- Mistral: Voxtral Small 24B 2507 STTmistralai87.56
- mistralai/Voxtral-Mini-4B-Realtime-2602mistralai45.1
tedlium (WER)
openASR · Open ASR Leaderboard · tedlium (WER) · percent · Lower is better
Models
LoadingBenchmarks
Explore every benchmark
LoadingThese charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.