Open ASR Leaderboard

Indexed results from Open ASR Leaderboard. Each ranking retains its own metric and evaluation conditions.

🇵🇹 Portuguese · RTFx

openASR · Open ASR Leaderboard · 🇵🇹 Portuguese · RTFx · realTimeFactor · Higher is better

  1. NVIDIA: Parakeet TDT 0.6B v3nvidia3,256.94
  2. nvidia/canary-1b-v2nvidia1,367.04
  3. OpenAI: Whisper Large V3 Turboopenai974.13
  4. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia869.33
  5. CohereLabs/cohere-transcribe-03-2026coherelabs571.98
  6. OpenAI: Whisper Large V3openai351.92
  7. NVIDIA: Nemotron 3.5 Transcribenvidia346.04
  8. Mistral: Voxtral Mini 3B 2507mistralai194.13
  9. google/gemma-4-E4B-itgoogle130.77
  10. microsoft/VibeVoice-ASR-HFmicrosoft123.34
  11. Mistral: Voxtral Small 24B 2507 STTmistralai122.84
  12. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai39.75

English · URGENT24 (WER)

openASR · Open ASR Leaderboard · English · URGENT24 (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs9.5%
  2. NVIDIA: Nemotron 3.5 Transcribenvidia10.94%
  3. ibm-granite/granite-speech-4.1-2bibm-granite11.25%
  4. nvidia/parakeet-tdt-0.6b-v2nvidia11.42%
  5. NVIDIA: Parakeet TDT 0.6B v3nvidia11.52%
  6. ibm-granite/granite-4.0-1b-speechibm-granite11.99%
  7. Mistral: Voxtral Small 24B 2507 STTmistralai12.34%
  8. OpenAI: Whisper Large V3 Turboopenai13.69%
  9. OpenAI: Whisper Large V3openai13.73%
  10. nvidia/canary-1b-v2nvidia14.56%
  11. Mistral: Voxtral Mini 3B 2507mistralai15.66%
  12. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai17.94%

RTFx

openASR · Open ASR Leaderboard · RTFx · realTimeFactor · Higher is better

  1. NVIDIA: Parakeet TDT 0.6B v3nvidia2,782.68
  2. nvidia/canary-1b-v2nvidia1,057.91
  3. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,002.89
  4. OpenAI: Whisper Large V3 Turboopenai608.53
  5. CohereLabs/cohere-transcribe-03-2026coherelabs590.79
  6. OpenAI: Whisper Large V3openai300.76
  7. Mistral: Voxtral Mini 3B 2507mistralai149.59
  8. google/gemma-4-E4B-itgoogle113.04
  9. microsoft/VibeVoice-ASR-HFmicrosoft111.78
  10. Mistral: Voxtral Small 24B 2507 STTmistralai87.56
  11. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai45.1

English · Voxpopuli-AA-Cleaned (WER)

openASR · Open ASR Leaderboard · English · Voxpopuli-AA-Cleaned (WER) · percent · Lower is better

  1. NVIDIA: Nemotron 3.5 Transcribenvidia1.89%
  2. Mistral: Voxtral Small 24B 2507 STTmistralai2%
  3. microsoft/VibeVoice-ASR-HFmicrosoft2.02%
  4. Mistral: Voxtral Mini 3B 2507mistralai2.22%
  5. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai2.6%
  6. NVIDIA: Parakeet TDT 0.6B v3nvidia3.05%
  7. nvidia/parakeet-tdt-0.6b-v2nvidia3.78%
  8. google/gemma-4-E4B-itgoogle4.09%
  9. ibm-granite/granite-speech-4.1-2bibm-granite4.18%
  10. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia4.24%
  11. nvidia/canary-1b-v2nvidia4.39%
  12. ibm-granite/granite-4.0-1b-speechibm-granite4.41%

MLS WER (WER)

openASR · Open ASR Leaderboard · MLS WER (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs2.44%
  2. Mistral: Voxtral Small 24B 2507 STTmistralai3.22%
  3. nvidia/canary-1b-v2nvidia3.45%
  4. OpenAI: Whisper Large V3openai3.9%
  5. OpenAI: Whisper Large V3 Turboopenai4.22%
  6. NVIDIA: Parakeet TDT 0.6B v3nvidia5.12%
  7. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai5.59%
  8. Mistral: Voxtral Mini 3B 2507mistralai5.96%
  9. microsoft/VibeVoice-ASR-HFmicrosoft6.96%
  10. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia7.36%
  11. google/gemma-4-E4B-itgoogle9.53%

URGENT2024-Clean WER (WER)

openASR · Open ASR Leaderboard · URGENT2024-Clean WER (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs4.45%
  2. ibm-granite/granite-speech-4.1-2bibm-granite4.95%
  3. ibm-granite/granite-4.0-1b-speechibm-granite5.16%
  4. Mistral: Voxtral Small 24B 2507 STTmistralai5.33%
  5. nvidia/parakeet-tdt-0.6b-v2nvidia5.38%
  6. NVIDIA: Parakeet TDT 0.6B v3nvidia5.52%
  7. nvidia/parakeet-ctc-1.1bnvidia5.72%
  8. OpenAI: Whisper Large V3 Turboopenai5.73%
  9. OpenAI: Whisper Large V3openai5.77%
  10. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai6.56%
  11. Mistral: Voxtral Mini 3B 2507mistralai6.56%
  12. nvidia/canary-1b-v2nvidia6.63%

URGENT2024 RTFx

openASR · Open ASR Leaderboard · URGENT2024 RTFx · realTimeFactor · Higher is better

  1. NVIDIA: Parakeet TDT 0.6B v3nvidia3,948.535
  2. nvidia/parakeet-tdt-0.6b-v2nvidia3,943.875
  3. nvidia/parakeet-ctc-1.1bnvidia3,431.419
  4. nvidia/canary-1b-v2nvidia1,498.604
  5. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia981.722
  6. OpenAI: Whisper Large V3 Turboopenai709.07
  7. CohereLabs/cohere-transcribe-03-2026coherelabs652.179
  8. ibm-granite/granite-4.0-1b-speechibm-granite562.609
  9. ibm-granite/granite-speech-4.1-2bibm-granite490.931
  10. OpenAI: Whisper Large V3openai437.121
  11. google/gemma-4-E4B-itgoogle169.012
  12. Mistral: Voxtral Mini 3B 2507mistralai127.186

Earnings22 WER (WER)

openASR · Open ASR Leaderboard · Earnings22 WER (WER) · percent · Lower is better

  1. ibm-granite/granite-speech-4.1-2bibm-granite8.23%
  2. ibm-granite/granite-4.0-1b-speechibm-granite8.32%
  3. ibm-granite/granite-speech-3.3-2bibm-granite9.73%
  4. Mistral: Voxtral Small 24B 2507 STTmistralai10.16%
  5. Mistral: Voxtral Mini 3B 2507mistralai10.35%
  6. CohereLabs/cohere-transcribe-03-2026coherelabs10.37%
  7. NVIDIA: Parakeet TDT 0.6B v3nvidia10.77%
  8. nvidia/parakeet-tdt-0.6b-v2nvidia10.78%
  9. OpenAI: Whisper Large V3 Turboopenai11.07%
  10. nvidia/canary-1b-v2nvidia11.34%
  11. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai11.46%
  12. OpenAI: Whisper Large V3openai11.59%

Voice Arena Monsoon RTFx

openASR · Open ASR Leaderboard · Voice Arena Monsoon RTFx · realTimeFactor · Higher is better

  1. nvidia/parakeet-tdt-0.6b-v2nvidia5,032.582
  2. NVIDIA: Parakeet TDT 0.6B v3nvidia4,959.369
  3. nvidia/parakeet-ctc-1.1bnvidia4,455.626
  4. nvidia/canary-1b-v2nvidia1,987.691
  5. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,495.864
  6. OpenAI: Whisper Large V3 Turboopenai1,002.476
  7. CohereLabs/cohere-transcribe-03-2026coherelabs757.855
  8. ibm-granite/granite-4.0-1b-speechibm-granite514.678
  9. OpenAI: Whisper Large V3openai506.069
  10. ibm-granite/granite-speech-3.3-2bibm-granite463.31
  11. ibm-granite/granite-speech-4.1-2bibm-granite454.555
  12. Mistral: Voxtral Mini 3B 2507mistralai181.576

fr_fleurs (WER)

openASR · Open ASR Leaderboard · fr_fleurs (WER) · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai3.57%
  2. Qwen: Qwen3 ASR 1.7Bqwen4.17%
  3. Mistral: Voxtral Mini 3B 2507mistralai4.33%
  4. nvidia/canary-1b-v2nvidia4.43%
  5. NVIDIA: Parakeet TDT 0.6B v3nvidia4.76%
  6. CohereLabs/cohere-transcribe-03-2026coherelabs4.8%
  7. OpenAI: Whisper Large V3openai4.98%
  8. OpenAI: Whisper Large V3 Turboopenai5.04%
  9. Qwen: Qwen3 ASR 0.6Bqwen7.07%
  10. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai8.44%

🇳🇱 Dutch · RTFx

openASR · Open ASR Leaderboard · 🇳🇱 Dutch · RTFx · realTimeFactor · Higher is better

  1. NVIDIA: Parakeet TDT 0.6B v3nvidia2,782.68
  2. nvidia/canary-1b-v2nvidia1,057.91
  3. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,002.89
  4. OpenAI: Whisper Large V3 Turboopenai608.53
  5. CohereLabs/cohere-transcribe-03-2026coherelabs590.79
  6. NVIDIA: Nemotron 3.5 Transcribenvidia314.89
  7. OpenAI: Whisper Large V3openai300.76
  8. Mistral: Voxtral Mini 3B 2507mistralai149.59
  9. google/gemma-4-E4B-itgoogle113.04
  10. microsoft/VibeVoice-ASR-HFmicrosoft111.78
  11. Mistral: Voxtral Small 24B 2507 STTmistralai87.56
  12. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai45.1

tedlium (WER)

openASR · Open ASR Leaderboard · tedlium (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs2.23%
  2. NVIDIA: Parakeet TDT 0.6B v3nvidia2.77%
  3. nvidia/parakeet-tdt-0.6b-v2nvidia3.07%
  4. OpenAI: Whisper Large V3openai3.15%
  5. OpenAI: Whisper Large V3 Turboopenai3.23%

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace