HELM Capabilities
Indexed results from HELM. Each ranking retains its own metric and evaluation conditions.
HELM Omni-MATH
helm · HELM Capabilities · omni_math_accuracy · percent
- Qwen3-235B-A22B-Instruct-2507-FP8qwen71.833%
- OpenAI: gpt-oss-120bopenai68.833%
- MoonshotAI: Kimi K2 0711moonshotai65.4%
- OpenAI: gpt-oss-20bopenai56.467%
- gemini-3-pro-previewgoogle55.55%
- Claude Sonnet 4anthropic51.25%
- Claude Opus 4anthropic51.117%
- Google: Gemini 2.5 Flash Litegoogle47.967%
- Qwen: Qwen3 Next 80B A3B Thinkingqwen46.683%
- DeepSeek: R1 0528deepseek42.4%
- Llama-4-Maverick-17B-128E-Instruct-FP8meta-llama42.233%
- Writer: Palmyra X5writer41.45%
Models
LoadingBenchmarks
Explore every benchmark
LoadingThese charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.