Open ASR Leaderboard

Indexed results from Open ASR Leaderboard. Each ranking retains its own metric and evaluation conditions.

🇳🇱 Dutch · MCV (WER)

openASR · Open ASR Leaderboard · 🇳🇱 Dutch · MCV (WER) · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai3.25%
  2. CohereLabs/cohere-transcribe-03-2026coherelabs4.1%
  3. OpenAI: Whisper Large V3openai4.11%
  4. NVIDIA: Nemotron 3.5 Transcribenvidia5.37%
  5. NVIDIA: Parakeet TDT 0.6B v3nvidia5.42%
  6. Mistral: Voxtral Mini 3B 2507mistralai5.53%
  7. nvidia/canary-1b-v2nvidia5.57%
  8. OpenAI: Whisper Large V3 Turboopenai7.11%
  9. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai10.88%
  10. google/gemma-4-E4B-itgoogle11.32%
  11. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia15.56%
  12. microsoft/VibeVoice-ASR-HFmicrosoft27.15%

pt_fleurs (WER)

openASR · Open ASR Leaderboard · pt_fleurs (WER) · percent · Lower is better

  1. OpenAI: Whisper Large V3openai3.53%
  2. Mistral: Voxtral Small 24B 2507 STTmistralai3.75%
  3. Mistral: Voxtral Mini 3B 2507mistralai3.76%
  4. OpenAI: Whisper Large V3 Turboopenai3.8%
  5. Qwen: Qwen3 ASR 1.7Bqwen4.02%
  6. nvidia/canary-1b-v2nvidia4.14%
  7. NVIDIA: Parakeet TDT 0.6B v3nvidia4.53%
  8. CohereLabs/cohere-transcribe-03-2026coherelabs4.58%
  9. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai4.58%
  10. Qwen: Qwen3 ASR 0.6Bqwen6.12%

🇦🇲 Armenian · FLEURS (WER)

openASR · Open ASR Leaderboard · 🇦🇲 Armenian · FLEURS (WER) · percent · Lower is better

  1. facebook/mms-1b-allmeta-llama13.54%
  2. OpenAI: Whisper Large V3openai43.22%

LS Other RTFx

openASR · Open ASR Leaderboard · LS Other RTFx · realTimeFactor · Higher is better

  1. NVIDIA: Parakeet TDT 0.6B v3nvidia4,353.569
  2. nvidia/parakeet-tdt-0.6b-v2nvidia4,238.397
  3. nvidia/parakeet-ctc-1.1bnvidia3,556.474
  4. nvidia/canary-1b-v2nvidia1,431.023
  5. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,180.549
  6. OpenAI: Whisper Large V3 Turboopenai682.454
  7. CohereLabs/cohere-transcribe-03-2026coherelabs629.907
  8. ibm-granite/granite-4.0-1b-speechibm-granite584.542
  9. ibm-granite/granite-speech-4.1-2bibm-granite475.876
  10. ibm-granite/granite-speech-3.3-2bibm-granite455.068
  11. OpenAI: Whisper Large V3openai430.961
  12. google/gemma-4-E2B-itgoogle203.959

English · URGENT24 Clean (WER)

openASR · Open ASR Leaderboard · English · URGENT24 Clean (WER) · percent · Lower is better

  1. NVIDIA: Nemotron 3.5 Transcribenvidia4.36%
  2. CohereLabs/cohere-transcribe-03-2026coherelabs4.45%
  3. ibm-granite/granite-speech-4.1-2bibm-granite4.95%
  4. ibm-granite/granite-4.0-1b-speechibm-granite5.16%
  5. Mistral: Voxtral Small 24B 2507 STTmistralai5.32%
  6. nvidia/parakeet-tdt-0.6b-v2nvidia5.38%
  7. NVIDIA: Parakeet TDT 0.6B v3nvidia5.52%
  8. OpenAI: Whisper Large V3 Turboopenai5.73%
  9. OpenAI: Whisper Large V3openai5.77%
  10. Mistral: Voxtral Mini 3B 2507mistralai6.54%
  11. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai6.55%
  12. nvidia/canary-1b-v2nvidia6.63%

Long-form · Earnings21 (WER)

openASR · Open ASR Leaderboard · Long-form · Earnings21 (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs8.31%
  2. OpenAI: Whisper Large V3openai9.2%
  3. OpenAI: Whisper Large V3 Turboopenai9.28%
  4. NVIDIA: Parakeet TDT 0.6B v3nvidia9.72%
  5. nvidia/parakeet-tdt-0.6b-v2nvidia10.22%

MCV WER (WER)

openASR · Open ASR Leaderboard · MCV WER (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs2.51%
  2. Mistral: Voxtral Small 24B 2507 STTmistralai3.12%
  3. NVIDIA: Parakeet TDT 0.6B v3nvidia3.38%
  4. nvidia/canary-1b-v2nvidia4.51%
  5. OpenAI: Whisper Large V3openai4.82%
  6. Mistral: Voxtral Mini 3B 2507mistralai5.52%
  7. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai6.17%
  8. OpenAI: Whisper Large V3 Turboopenai6.57%
  9. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia7.84%
  10. google/gemma-4-E4B-itgoogle9.33%
  11. microsoft/VibeVoice-ASR-HFmicrosoft20.6%

RTFx

openASR · Open ASR Leaderboard · RTFx · realTimeFactor · Higher is better

  1. NVIDIA: Parakeet TDT 0.6B v3nvidia3,256.94
  2. nvidia/canary-1b-v2nvidia1,367.04
  3. OpenAI: Whisper Large V3 Turboopenai974.13
  4. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia869.33
  5. CohereLabs/cohere-transcribe-03-2026coherelabs571.98
  6. OpenAI: Whisper Large V3openai351.92
  7. Mistral: Voxtral Mini 3B 2507mistralai194.13
  8. google/gemma-4-E4B-itgoogle130.77
  9. microsoft/VibeVoice-ASR-HFmicrosoft123.34
  10. Mistral: Voxtral Small 24B 2507 STTmistralai122.84
  11. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai39.75

MLS WER (WER)

openASR · Open ASR Leaderboard · MLS WER (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs3.5%
  2. OpenAI: Whisper Large V3openai4.8%
  3. OpenAI: Whisper Large V3 Turboopenai5.03%
  4. Mistral: Voxtral Small 24B 2507 STTmistralai5.64%
  5. Mistral: Voxtral Mini 3B 2507mistralai8.05%
  6. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai9.07%
  7. nvidia/canary-1b-v2nvidia9.33%
  8. NVIDIA: Parakeet TDT 0.6B v3nvidia10.79%
  9. microsoft/VibeVoice-ASR-HFmicrosoft11.26%
  10. google/gemma-4-E4B-itgoogle13.87%
  11. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia15.99%

MLS WER (WER)

openASR · Open ASR Leaderboard · MLS WER (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs2.38%
  2. Mistral: Voxtral Small 24B 2507 STTmistralai3.05%
  3. nvidia/canary-1b-v2nvidia3.13%
  4. OpenAI: Whisper Large V3openai3.47%
  5. OpenAI: Whisper Large V3 Turboopenai3.85%
  6. NVIDIA: Parakeet TDT 0.6B v3nvidia4.36%
  7. microsoft/VibeVoice-ASR-HFmicrosoft4.6%
  8. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai4.73%
  9. Mistral: Voxtral Mini 3B 2507mistralai4.86%
  10. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia5.16%
  11. google/gemma-4-E4B-itgoogle7.23%

Long-form · Average WER

openASR · Open ASR Leaderboard · Long-form · Average WER · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs11.88%
  2. NVIDIA: Parakeet TDT 0.6B v3nvidia12.6%
  3. OpenAI: Whisper Large V3 Turboopenai12.82%
  4. nvidia/parakeet-tdt-0.6b-v2nvidia13.08%
  5. OpenAI: Whisper Large V3openai13.1%

Monsoon WER (WER)

openASR · Open ASR Leaderboard · Monsoon WER (WER) · percent · Lower is better

  1. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia13.85%
  2. google/gemma-4-E4B-itgoogle14.07%
  3. Mistral: Voxtral Mini 3B 2507mistralai22.9%
  4. Mistral: Voxtral Small 24B 2507 STTmistralai23.2%
  5. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai24.73%
  6. OpenAI: Whisper Large V3openai28.17%
  7. microsoft/VibeVoice-ASR-HFmicrosoft39.21%
  8. OpenAI: Whisper Large V3 Turboopenai40.79%

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace