Open ASR Leaderboard

Indexed results from Open ASR Leaderboard. Each ranking retains its own metric and evaluation conditions.

MCV WER (WER)

openASR · Open ASR Leaderboard · MCV WER (WER) · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai3.25%
  2. CohereLabs/cohere-transcribe-03-2026coherelabs4.1%
  3. OpenAI: Whisper Large V3openai4.1%
  4. NVIDIA: Parakeet TDT 0.6B v3nvidia5.41%
  5. Mistral: Voxtral Mini 3B 2507mistralai5.52%
  6. nvidia/canary-1b-v2nvidia5.58%
  7. OpenAI: Whisper Large V3 Turboopenai7.12%
  8. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai10.9%
  9. google/gemma-4-E4B-itgoogle11.3%
  10. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia15.61%
  11. microsoft/VibeVoice-ASR-HFmicrosoft27.19%

pt_mls (WER)

openASR · Open ASR Leaderboard · pt_mls (WER) · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai5.06%
  2. OpenAI: Whisper Large V3 Turboopenai5.55%
  3. OpenAI: Whisper Large V3openai6.39%
  4. CohereLabs/cohere-transcribe-03-2026coherelabs6.62%
  5. Mistral: Voxtral Mini 3B 2507mistralai6.71%
  6. NVIDIA: Parakeet TDT 0.6B v3nvidia7.78%
  7. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai8.01%
  8. nvidia/canary-1b-v2nvidia8.52%
  9. Qwen: Qwen3 ASR 1.7Bqwen8.55%
  10. Qwen: Qwen3 ASR 0.6Bqwen14.05%

Earnings22-Cleaned-AA-chunked RTFx

openASR · Open ASR Leaderboard · Earnings22-Cleaned-AA-chunked RTFx · realTimeFactor · Higher is better

  1. nvidia/parakeet-tdt-0.6b-v2nvidia3,087.431
  2. NVIDIA: Parakeet TDT 0.6B v3nvidia3,012.602
  3. nvidia/parakeet-ctc-1.1bnvidia2,641.218
  4. nvidia/canary-1b-v2nvidia1,019.363
  5. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia997.384
  6. OpenAI: Whisper Large V3 Turboopenai951.092
  7. OpenAI: Whisper Large V3openai685.051
  8. CohereLabs/cohere-transcribe-03-2026coherelabs613.228
  9. ibm-granite/granite-speech-3.3-2bibm-granite266.894
  10. Mistral: Voxtral Mini 3B 2507mistralai254.409
  11. ibm-granite/granite-speech-4.1-2bibm-granite240.309
  12. ibm-granite/granite-4.0-1b-speechibm-granite238.798

FLEURS WER (WER)

openASR · Open ASR Leaderboard · FLEURS WER (WER) · percent · Lower is better

  1. facebook/mms-1b-allmeta-llama13.43%
  2. OpenAI: Whisper Large V3openai43.03%

es_covost (WER)

openASR · Open ASR Leaderboard · es_covost (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs2.68%
  2. Mistral: Voxtral Small 24B 2507 STTmistralai3.02%
  3. NVIDIA: Parakeet TDT 0.6B v3nvidia3.55%
  4. nvidia/canary-1b-v2nvidia3.96%
  5. Qwen: Qwen3 ASR 1.7Bqwen4.13%
  6. Mistral: Voxtral Mini 3B 2507mistralai4.31%
  7. OpenAI: Whisper Large V3openai4.47%
  8. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai5.09%
  9. OpenAI: Whisper Large V3 Turboopenai6.35%
  10. Qwen: Qwen3 ASR 0.6Bqwen6.56%

🇩🇪 German · MCV (WER)

openASR · Open ASR Leaderboard · 🇩🇪 German · MCV (WER) · percent · Lower is better

  1. CohereLabs/cohere-transcribe-03-2026coherelabs2.87%
  2. NVIDIA: Nemotron 3.5 Transcribenvidia2.96%
  3. Mistral: Voxtral Small 24B 2507 STTmistralai3.19%
  4. NVIDIA: Parakeet TDT 0.6B v3nvidia4.07%
  5. nvidia/canary-1b-v2nvidia4.69%
  6. OpenAI: Whisper Large V3openai4.79%
  7. Mistral: Voxtral Mini 3B 2507mistralai5.29%
  8. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai7.81%
  9. OpenAI: Whisper Large V3 Turboopenai8.58%
  10. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia9.44%
  11. google/gemma-4-E4B-itgoogle9.47%
  12. microsoft/VibeVoice-ASR-HFmicrosoft20.82%

🇪🇸 Spanish · RTFx

openASR · Open ASR Leaderboard · 🇪🇸 Spanish · RTFx · realTimeFactor · Higher is better

  1. NVIDIA: Parakeet TDT 0.6B v3nvidia3,786.16
  2. nvidia/canary-1b-v2nvidia1,466.05
  3. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,165.44
  4. CohereLabs/cohere-transcribe-03-2026coherelabs737.32
  5. OpenAI: Whisper Large V3 Turboopenai660.78
  6. NVIDIA: Nemotron 3.5 Transcribenvidia483.64
  7. OpenAI: Whisper Large V3openai386.26
  8. Mistral: Voxtral Mini 3B 2507mistralai183.34
  9. google/gemma-4-E4B-itgoogle146.32
  10. microsoft/VibeVoice-ASR-HFmicrosoft136.35
  11. Mistral: Voxtral Small 24B 2507 STTmistralai101.48
  12. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai53.15

FLEURS WER (WER)

openASR · Open ASR Leaderboard · FLEURS WER (WER) · percent · Lower is better

  1. OpenAI: Whisper Large V3openai3.5%
  2. Mistral: Voxtral Mini 3B 2507mistralai3.52%
  3. Mistral: Voxtral Small 24B 2507 STTmistralai3.64%
  4. OpenAI: Whisper Large V3 Turboopenai3.77%
  5. nvidia/canary-1b-v2nvidia4.16%
  6. CohereLabs/cohere-transcribe-03-2026coherelabs4.24%
  7. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai4.46%
  8. NVIDIA: Parakeet TDT 0.6B v3nvidia4.46%
  9. google/gemma-4-E4B-itgoogle4.52%
  10. microsoft/VibeVoice-ASR-HFmicrosoft5.67%
  11. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia5.8%

FLEURS WER (WER)

openASR · Open ASR Leaderboard · FLEURS WER (WER) · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai3.61%
  2. Mistral: Voxtral Mini 3B 2507mistralai4.13%
  3. CohereLabs/cohere-transcribe-03-2026coherelabs4.33%
  4. nvidia/canary-1b-v2nvidia4.35%
  5. NVIDIA: Parakeet TDT 0.6B v3nvidia4.68%
  6. OpenAI: Whisper Large V3openai4.84%
  7. OpenAI: Whisper Large V3 Turboopenai4.9%
  8. google/gemma-4-E4B-itgoogle7.42%
  9. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai8.19%
  10. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia9.86%
  11. microsoft/VibeVoice-ASR-HFmicrosoft11.3%

de_covost (WER)

openASR · Open ASR Leaderboard · de_covost (WER) · percent · Lower is better

  1. Mistral: Voxtral Small 24B 2507 STTmistralai3.43%
  2. CohereLabs/cohere-transcribe-03-2026coherelabs3.53%
  3. NVIDIA: Parakeet TDT 0.6B v3nvidia4.13%
  4. nvidia/canary-1b-v2nvidia4.73%
  5. Qwen: Qwen3 ASR 1.7Bqwen4.92%
  6. OpenAI: Whisper Large V3openai5.25%
  7. Mistral: Voxtral Mini 3B 2507mistralai5.78%
  8. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai8.08%
  9. Qwen: Qwen3 ASR 0.6Bqwen8.43%
  10. OpenAI: Whisper Large V3 Turboopenai8.64%

LS Clean RTFx

openASR · Open ASR Leaderboard · LS Clean RTFx · realTimeFactor · Higher is better

  1. nvidia/parakeet-tdt-0.6b-v2nvidia4,474.083
  2. NVIDIA: Parakeet TDT 0.6B v3nvidia4,218.041
  3. nvidia/parakeet-ctc-1.1bnvidia3,597.973
  4. nvidia/canary-1b-v2nvidia1,465.251
  5. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,251.753
  6. CohereLabs/cohere-transcribe-03-2026coherelabs733.404
  7. ibm-granite/granite-4.0-1b-speechibm-granite691.504
  8. OpenAI: Whisper Large V3 Turboopenai586.275
  9. ibm-granite/granite-speech-4.1-2bibm-granite569.914
  10. ibm-granite/granite-speech-3.3-2bibm-granite500.285
  11. OpenAI: Whisper Large V3openai485.126
  12. google/gemma-4-E2B-itgoogle213.738

RTFx

openASR · Open ASR Leaderboard · RTFx · realTimeFactor · Higher is better

  1. NVIDIA: Parakeet TDT 0.6B v3nvidia3,362.94
  2. nvidia/canary-1b-v2nvidia1,307.83
  3. nvidia/nemotron-3.5-asr-streaming-0.6bnvidia1,109.98
  4. CohereLabs/cohere-transcribe-03-2026coherelabs606.88
  5. OpenAI: Whisper Large V3 Turboopenai338.32
  6. OpenAI: Whisper Large V3openai327.55
  7. Mistral: Voxtral Mini 3B 2507mistralai149.66
  8. google/gemma-4-E4B-itgoogle135.79
  9. microsoft/VibeVoice-ASR-HFmicrosoft113.69
  10. Mistral: Voxtral Small 24B 2507 STTmistralai82.96
  11. mistralai/Voxtral-Mini-4B-Realtime-2602mistralai42.1

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace