Open ASR Leaderboard

Indexed results from Open ASR Leaderboard. Each ranking retains its own metric and evaluation conditions.

🇩🇪 German · RTFx

openASR · Open ASR Leaderboard · 🇩🇪 German · RTFx · realTimeFactor · Higher is better

  1. NVIDIA: Parakeet TDT 0.6B v3nvidia3,362.94
  2. nvidia/canary-1b-v2nvidia1,307.83
  3. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,109.98
  4. CohereLabs/cohere-transcribe-03-2026coherelabs606.88
  5. NVIDIA: Nemotron 3.5 Transcribenvidia432.43
  6. OpenAI: Whisper Large V3 Turboopenai338.32
  7. OpenAI: Whisper Large V3openai327.55
  8. Mistral: Voxtral Mini 3B 2507mistralai149.66
  9. google/gemma-4-E4B-itgoogle135.79
  10. microsoft/VibeVoice-ASR-HFmicrosoft113.69
  11. Mistral: Voxtral Small 24B 2507 STTmistralai82.96
  12. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai42.1

Avg (WER)

openASR · Open ASR Leaderboard · Avg (WER) · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai3.697%
  2. CohereLabs/cohere-transcribe-03-2026coherelabs3.83%
  3. nvidia/canary-1b-v2nvidia4.595%
  4. OpenAI: Whisper Large V3openai4.81%
  5. NVIDIA: Parakeet TDT 0.6B v3nvidia4.814%
  6. Mistral: Voxtral Mini 3B 2507mistralai5.102%
  7. Qwen: Qwen3 ASR 1.7Bqwen5.115%
  8. OpenAI: Whisper Large V3 Turboopenai5.557%
  9. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai6.322%
  10. Qwen: Qwen3 ASR 0.6Bqwen8.238%

🇩🇪 German · FLEURS (WER)

openASR · Open ASR Leaderboard · 🇩🇪 German · FLEURS (WER) · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai1.98%
  2. NVIDIA: Nemotron 3.5 Transcribenvidia2.62%
  3. OpenAI: Whisper Large V3openai3.2%
  4. Mistral: Voxtral Mini 3B 2507mistralai3.25%
  5. CohereLabs/cohere-transcribe-03-2026coherelabs3.33%
  6. nvidia/canary-1b-v2nvidia3.43%
  7. OpenAI: Whisper Large V3 Turboopenai3.67%
  8. NVIDIA: Parakeet TDT 0.6B v3nvidia4.16%
  9. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai4.87%
  10. google/gemma-4-E4B-itgoogle5.7%
  11. microsoft/VibeVoice-ASR-HFmicrosoft7.42%
  12. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia8.44%

URGENT2024-Clean RTFx

openASR · Open ASR Leaderboard · URGENT2024-Clean RTFx · realTimeFactor · Higher is better

  1. nvidia/parakeet-tdt-0.6b-v2nvidia4,123.812
  2. NVIDIA: Parakeet TDT 0.6B v3nvidia4,115.929
  3. nvidia/parakeet-ctc-1.1bnvidia3,430.021
  4. nvidia/canary-1b-v2nvidia1,487.96
  5. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,030.076
  6. OpenAI: Whisper Large V3 Turboopenai732.933
  7. ibm-granite/granite-4.0-1b-speechibm-granite646.586
  8. CohereLabs/cohere-transcribe-03-2026coherelabs567.217
  9. ibm-granite/granite-speech-4.1-2bibm-granite485.626
  10. OpenAI: Whisper Large V3openai436.993
  11. microsoft/VibeVoice-ASR-HFmicrosoft170.761
  12. Mistral: Voxtral Mini 3B 2507mistralai164.094

MCV WER (WER)

openASR · Open ASR Leaderboard · MCV WER (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs2.87%
  2. Mistral: Voxtral Small 24B 2507 STTmistralai3.19%
  3. NVIDIA: Parakeet TDT 0.6B v3nvidia4.07%
  4. nvidia/canary-1b-v2nvidia4.69%
  5. OpenAI: Whisper Large V3openai4.79%
  6. Mistral: Voxtral Mini 3B 2507mistralai5.29%
  7. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai7.81%
  8. OpenAI: Whisper Large V3 Turboopenai8.58%
  9. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia9.46%
  10. google/gemma-4-E4B-itgoogle9.49%
  11. microsoft/VibeVoice-ASR-HFmicrosoft20.97%

avg (WER)

openASR · Open ASR Leaderboard · avg (WER) · percent · Lower is better

  1. ibm-granite/granite-speech-3.3-2bibm-granite5.358%
  2. CohereLabs/cohere-transcribe-03-2026coherelabs6.263%
  3. ibm-granite/granite-speech-4.1-2bibm-granite6.421%
  4. nvidia/parakeet-tdt-0.6b-v2nvidia6.433%
  5. NVIDIA: Parakeet TDT 0.6B v3nvidia6.514%
  6. Mistral: Voxtral Small 24B 2507 STTmistralai6.896%
  7. ibm-granite/granite-4.0-1b-speechibm-granite7.02%
  8. Mistral: Voxtral Mini 3B 2507mistralai7.837%
  9. OpenAI: Whisper Large V3openai7.841%
  10. nvidia/canary-1b-v2nvidia7.911%
  11. nvidia/parakeet-ctc-1.1bnvidia8.216%
  12. microsoft/VibeVoice-ASR-HFmicrosoft8.227%

🇵🇹 Portuguese · FLEURS (WER)

openASR · Open ASR Leaderboard · 🇵🇹 Portuguese · FLEURS (WER) · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai2.47%
  2. NVIDIA: Nemotron 3.5 Transcribenvidia3.11%
  3. Mistral: Voxtral Mini 3B 2507mistralai3.19%
  4. OpenAI: Whisper Large V3openai3.5%
  5. OpenAI: Whisper Large V3 Turboopenai3.77%
  6. nvidia/canary-1b-v2nvidia4.17%
  7. CohereLabs/cohere-transcribe-03-2026coherelabs4.24%
  8. google/gemma-4-E4B-itgoogle4.41%
  9. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai4.45%
  10. NVIDIA: Parakeet TDT 0.6B v3nvidia4.47%
  11. microsoft/VibeVoice-ASR-HFmicrosoft5.67%
  12. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia5.81%

RTFx

openASR · Open ASR Leaderboard · RTFx · realTimeFactor · Higher is better

  1. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia517.39
  2. OpenAI: Whisper Large V3 Turboopenai251.74
  3. Mistral: Voxtral Mini 3B 2507mistralai98.24
  4. OpenAI: Whisper Large V3openai89.58
  5. google/gemma-4-E4B-itgoogle82.3
  6. microsoft/VibeVoice-ASR-HFmicrosoft58.31
  7. Mistral: Voxtral Small 24B 2507 STTmistralai52.97
  8. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai33.77

es_mls (WER)

openASR · Open ASR Leaderboard · es_mls (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs2.31%
  2. nvidia/canary-1b-v2nvidia3.15%
  3. Mistral: Voxtral Small 24B 2507 STTmistralai3.23%
  4. OpenAI: Whisper Large V3 Turboopenai3.96%
  5. OpenAI: Whisper Large V3openai4.16%
  6. NVIDIA: Parakeet TDT 0.6B v3nvidia4.41%
  7. Qwen: Qwen3 ASR 1.7Bqwen4.48%
  8. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai4.9%
  9. Mistral: Voxtral Mini 3B 2507mistralai4.97%
  10. Qwen: Qwen3 ASR 0.6Bqwen6.98%

🇳🇱 Dutch · FLEURS (WER)

openASR · Open ASR Leaderboard · 🇳🇱 Dutch · FLEURS (WER) · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai3.24%
  2. NVIDIA: Nemotron 3.5 Transcribenvidia3.86%
  3. OpenAI: Whisper Large V3openai4.36%
  4. CohereLabs/cohere-transcribe-03-2026coherelabs4.91%
  5. OpenAI: Whisper Large V3 Turboopenai4.95%
  6. Mistral: Voxtral Mini 3B 2507mistralai5.07%
  7. nvidia/canary-1b-v2nvidia5.26%
  8. NVIDIA: Parakeet TDT 0.6B v3nvidia6.38%
  9. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai7.59%
  10. google/gemma-4-E4B-itgoogle8.94%
  11. microsoft/VibeVoice-ASR-HFmicrosoft10.69%
  12. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia11.84%

Average (WER)

openASR · Open ASR Leaderboard · Average (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs9.733%
  2. NVIDIA: Parakeet TDT 0.6B v3nvidia10.72%
  3. OpenAI: Whisper Large V3 Turboopenai11.01%
  4. nvidia/parakeet-tdt-0.6b-v2nvidia11.178%
  5. OpenAI: Whisper Large V3openai11.228%

English · SPGISpeech (WER)

openASR · Open ASR Leaderboard · English · SPGISpeech (WER) · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai1.84%
  2. NVIDIA: Nemotron 3.5 Transcribenvidia1.91%
  3. nvidia/parakeet-tdt-0.6b-v2nvidia1.94%
  4. nvidia/canary-1b-v2nvidia2.03%
  5. Mistral: Voxtral Mini 3B 2507mistralai2.15%
  6. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai2.23%
  7. OpenAI: Whisper Large V3openai2.71%
  8. CohereLabs/cohere-transcribe-03-2026coherelabs2.74%
  9. OpenAI: Whisper Large V3 Turboopenai2.79%
  10. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia3.27%
  11. ibm-granite/granite-speech-4.1-2bibm-granite3.47%
  12. microsoft/VibeVoice-ASR-HFmicrosoft3.47%

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace