MMBench
Indexed results from MMBench. Each ranking retains its own metric and evaluation conditions.
structuralized_imagetext_understanding
mmBench · MMBench · structuralized_imagetext_understanding · percent · Higher is better
- Qwen: Qwen2.5 VL 72B Instructqwen91.1%
- OpenGVLab/InternVL2-40Bopengvlab79.2%
- Qwen/Qwen2-VL-72B-Instructqwen78.2%
- OpenGVLab/InternVL3-8Bopengvlab72.3%
- rhymes-ai/Ariarhymes-ai72.3%
- mistralai/Pixtral-12B-2409mistralai71.3%
- Qwen/Qwen2.5-VL-3B-Instructqwen71.3%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai69.3%
- Qwen/Qwen2.5-VL-7B-Instructqwen69.3%
- DeepSeek: DeepSeek-VL2deepseek68.3%
- nvidia/NVLM-D-72Bnvidia68.3%
- Google: Gemma 3 12Bgoogle67.3%
spatial_relationship
mmBench · MMBench · spatial_relationship · percent · Higher is better
- Qwen: Qwen2.5 VL 72B Instructqwen84%
- Qwen/Qwen2-VL-72B-Instructqwen84%
- Qwen/Qwen2.5-VL-32B-Instructqwen73.3%
- YannQi/R-4Byannqi72%
- nvidia/NVLM-D-72Bnvidia69.3%
- XiaomiMiMo/MiMo-VL-7B-RLxiaomi69.3%
- Llama-3.2-90B-Vision-Instructmeta-llama68%
- OpenGVLab/InternVL2-40Bopengvlab66.7%
- Qwen/Qwen2.5-VL-7B-Instructqwen66.7%
- moonshotai/Kimi-VL-A3B-Thinking-2506moonshotai64%
- NCSOFT/VARCO-VISION-2.0-14Bncsoft62.7%
- OpenGVLab/InternVL3-8Bopengvlab61.3%
attribute_recognition
mmBench · MMBench · attribute_recognition · percent · Higher is better
- OpenGVLab/InternVL2-40Bopengvlab98%
- Qwen: Qwen2.5 VL 72B Instructqwen97%
- nvidia/NVLM-D-72Bnvidia94.9%
- Qwen/Qwen2-VL-72B-Instructqwen93.9%
- OpenGVLab/InternVL3-8Bopengvlab92.9%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai90.9%
- rhymes-ai/Ariarhymes-ai90.9%
- DeepSeek: DeepSeek-VL2deepseek89.9%
- OpenGVLab/InternVL3-2Bopengvlab88.9%
- Qwen/Qwen2-VL-7B-Instructqwen88.9%
- Qwen/Qwen2.5-VL-3B-Instructqwen86.9%
- Qwen/Qwen2.5-VL-7B-Instructqwen86.9%
object_localization
mmBench · MMBench · object_localization · percent · Higher is better
- Qwen: Qwen2.5 VL 72B Instructqwen92.4%
- Qwen/Qwen2-VL-72B-Instructqwen86.7%
- Qwen/Qwen2.5-VL-32B-Instructqwen84.8%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai83.8%
- OpenGVLab/InternVL2-40Bopengvlab83.8%
- OpenGVLab/InternVL2_5-8Bopengvlab83.8%
- NCSOFT/VARCO-VISION-2.0-14Bncsoft82.9%
- Qwen/Qwen2.5-VL-7B-Instructqwen82.9%
- YannQi/R-4Byannqi81%
- OpenGVLab/InternVL3-8Bopengvlab79%
- DeepSeek: DeepSeek-VL2deepseek78.1%
- XiaomiMiMo/MiMo-VL-7B-RLxiaomi78.1%
FP-S
mmBench · MMBench · FP-S · percent · Higher is better
- Qwen: Qwen2.5 VL 72B Instructqwen96.2%
- Qwen/Qwen2-VL-72B-Instructqwen93.5%
- OpenGVLab/InternVL2-40Bopengvlab92.2%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai89.4%
- Qwen/Qwen2.5-VL-7B-Instructqwen88.9%
- nvidia/NVLM-D-72Bnvidia87.7%
- OpenGVLab/InternVL3-8Bopengvlab86.7%
- Llama-3.2-90B-Vision-Instructmeta-llama86.2%
- rhymes-ai/Ariarhymes-ai86.2%
- DeepSeek: DeepSeek-VL2deepseek85.9%
- Qwen/Qwen2-VL-7B-Instructqwen85.2%
- Qwen/Qwen2.5-VL-3B-Instructqwen83.9%
calligraphy_painting
mmBench · MMBench · calligraphy_painting · percent · Higher is better
- OpenGVLab/InternVL2-1Bopengvlab91.2%
- OpenGVLab/InternVL3-8Bopengvlab91.2%
- OpenGVLab/InternVL3-2Bopengvlab89.5%
- OpenGVLab/InternVL2-40Bopengvlab87.7%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai71.9%
- Qwen: Qwen2.5 VL 72B Instructqwen71.9%
- Qwen/Qwen2-VL-72B-Instructqwen70.2%
- Qwen/Qwen2-VL-7B-Instructqwen70.2%
- DeepSeek: DeepSeek-VL2deepseek66.7%
- Qwen/Qwen2.5-VL-3B-Instructqwen63.2%
- nvidia/NVLM-D-72Bnvidia59.6%
- Google: Gemma 3 12Bgoogle57.9%
identity_reasoning
mmBench · MMBench · identity_reasoning · percent · Higher is better
- Qwen/Qwen2-VL-72B-Instructqwen100%
- OpenGVLab/InternVL3-8Bopengvlab98.8%
- DeepSeek: DeepSeek-VL2deepseek97.6%
- microsoft/Phi-3.5-vision-instructmicrosoft97.6%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai97.6%
- OpenGVLab/InternVL3-2Bopengvlab97.6%
- Qwen/Qwen2.5-VL-3B-Instructqwen97.6%
- Qwen: Qwen2.5 VL 72B Instructqwen97.6%
- vikhyatk/moondream2vikhyatk97.6%
- ibm-granite/granite-vision-3.2-2bibm-granite96.3%
- Qwen/Qwen2.5-VL-7B-Instructqwen96.3%
- tiiuae/falcon-11B-vlmtiiuae96.3%
AR
mmBench · MMBench · AR · percent · Higher is better
- OpenGVLab/InternVL2-40Bopengvlab87.5%
- Qwen/Qwen2-VL-72B-Instructqwen85.1%
- Qwen: Qwen2.5 VL 72B Instructqwen84.4%
- DeepSeek: DeepSeek-VL2deepseek84%
- OpenGVLab/InternVL3-8Bopengvlab84%
- nvidia/NVLM-D-72Bnvidia83.7%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai83.3%
- Qwen/Qwen2.5-VL-7B-Instructqwen83.3%
- OpenGVLab/InternVL3-2Bopengvlab83%
- rhymes-ai/Ariarhymes-ai83%
- Qwen/Qwen2-VL-7B-Instructqwen82.6%
- Google: Gemma 3 12Bgoogle81.6%
image_quality
mmBench · MMBench · image_quality · percent · Higher is better
- Qwen: Qwen2.5 VL 72B Instructqwen71%
- XiaomiMiMo/MiMo-VL-7B-RLxiaomi68.5%
- Qwen/Qwen2.5-VL-32B-Instructqwen63.7%
- Qwen/Qwen2-VL-72B-Instructqwen63.7%
- DeepSeek: DeepSeek-VL2deepseek62.9%
- moonshotai/Kimi-VL-A3B-Thinking-2506moonshotai62.1%
- OpenGVLab/InternVL2-40Bopengvlab61.3%
- NCSOFT/VARCO-VISION-2.0-14Bncsoft60.5%
- Qwen/Qwen2.5-VL-7B-Instructqwen60.5%
- YannQi/R-4Byannqi60.5%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai59.7%
- Qwen/Qwen2-VL-7B-Instructqwen59.7%
traditional_show
mmBench · MMBench · traditional_show · percent · Higher is better
- OpenGVLab/InternVL3-8Bopengvlab90.9%
- OpenGVLab/InternVL2-40Bopengvlab84.8%
- OpenGVLab/InternVL2-1Bopengvlab83.3%
- OpenGVLab/InternVL3-2Bopengvlab75.8%
- Qwen: Qwen2.5 VL 72B Instructqwen71.2%
- Qwen/Qwen2-VL-72B-Instructqwen69.7%
- Qwen/Qwen2-VL-7B-Instructqwen63.6%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai62.1%
- DeepSeek: DeepSeek-VL2deepseek60.6%
- nvidia/NVLM-D-72Bnvidia57.6%
- 5CD-AI/Vintern-3B-beta5cd-ai56.1%
- Qwen/Qwen2.5-VL-3B-Instructqwen56.1%
scenery_building
mmBench · MMBench · scenery_building · percent · Higher is better
- Qwen: Qwen2.5 VL 72B Instructqwen94.7%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai90.5%
- Qwen/Qwen2-VL-72B-Instructqwen88.4%
- OpenGVLab/InternVL3-2Bopengvlab83.2%
- Qwen/Qwen2.5-VL-3B-Instructqwen83.2%
- Qwen/Qwen2.5-VL-7B-Instructqwen83.2%
- OpenGVLab/InternVL2-1Bopengvlab80%
- OpenGVLab/InternVL2-40Bopengvlab80%
- Qwen/Qwen2-VL-7B-Instructqwen77.9%
- OpenGVLab/InternVL3-8Bopengvlab76.8%
- Llama-3.2-90B-Vision-Instructmeta-llama70.5%
- Qwen/Qwen2-VL-2B-Instructqwen62.1%
Overall
mmBench · MMBench · Overall · percent · Higher is better
- OpenGVLab/InternVL2-40Bopengvlab80.2%
- OpenGVLab/InternVL3-8Bopengvlab77.8%
- OpenGVLab/InternVL2-1Bopengvlab76.3%
- OpenGVLab/InternVL3-2Bopengvlab75.3%
- Qwen: Qwen2.5 VL 72B Instructqwen73.9%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai72%
- Qwen/Qwen2-VL-72B-Instructqwen69.8%
- Qwen/Qwen2-VL-7B-Instructqwen65.7%
- Qwen/Qwen2.5-VL-3B-Instructqwen62%
- Qwen/Qwen2.5-VL-7B-Instructqwen59.2%
- nvidia/NVLM-D-72Bnvidia59%
- DeepSeek: DeepSeek-VL2deepseek55.7%
Models
LoadingBenchmarks
Explore every benchmark
LoadingThese charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.