HELM Capabilities
Indexed results from HELM. Each ranking retains its own metric and evaluation conditions.
HELM IFEval
helm · HELM Capabilities · ifeval_strict_accuracy · percent
- Claude Opus 4anthropic91.774%
- Llama-4-Maverick-17B-128E-Instruct-FP8meta-llama90.758%
- gemini-3-pro-previewgoogle87.646%
- MoonshotAI: Kimi K2 0711moonshotai85.028%
- Claude Sonnet 4anthropic83.888%
- OpenAI: gpt-oss-120bopenai83.611%
- Qwen3-235B-A22B-Instruct-2507-FP8qwen83.518%
- DeepSeek: DeepSeek V3deepseek83.241%
- Writer: Palmyra X5writer82.286%
- OpenAI: GPT-4o (2024-11-20)openai81.731%
- Amazon: Nova Pro 1.0amazon81.547%
- GLM-4.5-Air-FP8z-ai81.177%
Models
LoadingBenchmarks
Explore every benchmark
LoadingThese charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.