MMBench
Indexed results from MMBench. Each ranking retains its own metric and evaluation conditions.
physical_relation
mmBench · MMBench · physical_relation · percent · Higher is better
- OpenGVLab/InternVL2-40Bopengvlab75%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai73.1%
- OpenGVLab/InternVL3-8Bopengvlab73.1%
- DeepSeek: DeepSeek-VL2deepseek71.2%
- nvidia/NVLM-D-72Bnvidia71.2%
- rhymes-ai/Ariarhymes-ai69.2%
- OpenGVLab/InternVL3-2Bopengvlab67.3%
- allenai/Molmo-7B-O-0924allenai63.5%
- h2oai/h2ovl-mississippi-2bh2oai61.5%
- ibm-granite/granite-vision-3.2-2bibm-granite61.5%
- Llama-3.2-90B-Vision-Instructmeta-llama61.5%
- mistralai/Pixtral-12B-2409mistralai59.6%
celebrity_recognition
mmBench · MMBench · celebrity_recognition · percent · Higher is better
- Qwen: Qwen2.5 VL 72B Instructqwen96.6%
- Qwen/Qwen2-VL-72B-Instructqwen96.6%
- Qwen/Qwen2-VL-7B-Instructqwen93.2%
- OpenGVLab/InternVL2-40Bopengvlab91.8%
- Qwen/Qwen2.5-VL-3B-Instructqwen91.8%
- Qwen/Qwen2.5-VL-7B-Instructqwen91.2%
- Google: Gemma 3 27Bgoogle90.5%
- Llama-3.2-90B-Vision-Instructmeta-llama89.8%
- XiaomiMiMo/MiMo-VL-7B-RLxiaomi89.8%
- HuggingFaceM4/idefics2-8bhuggingfacem489.1%
- Qwen/Qwen2.5-VL-32B-Instructqwen89.1%
- Xkev/Llama-3.2V-11B-cotxkev89.1%
image_emotion
mmBench · MMBench · image_emotion · percent · Higher is better
- Qwen/Qwen2-VL-7B-Instructqwen83.1%
- DeepSeek: DeepSeek-VL2deepseek80.7%
- OpenGVLab/InternVL2-40Bopengvlab80.7%
- OpenGVLab/InternVL3-8Bopengvlab80.7%
- microsoft/Phi-3.5-vision-instructmicrosoft78.3%
- Qwen/Qwen2-VL-2B-Instructqwen78.3%
- OpenGVLab/InternVL3-2Bopengvlab77.1%
- Qwen: Qwen2.5 VL 72B Instructqwen77.1%
- Qwen/Qwen2.5-VL-7B-Instructqwen77.1%
- Qwen/Qwen2-VL-72B-Instructqwen77.1%
- tiiuae/falcon-11B-vlmtiiuae77.1%
- HuggingFaceM4/Idefics3-8B-Llama3huggingfacem475.9%
attribute_comparison
mmBench · MMBench · attribute_comparison · percent · Higher is better
- Qwen/Qwen2-VL-72B-Instructqwen90.7%
- YannQi/R-4Byannqi90.7%
- NCSOFT/VARCO-VISION-2.0-14Bncsoft88%
- Qwen: Qwen2.5 VL 72B Instructqwen86.7%
- openbmb/MiniCPM-V-4openbmb84%
- OpenGVLab/InternVL2_5-8Bopengvlab84%
- Qwen/Qwen2.5-VL-32B-Instructqwen82.7%
- DeepSeek: DeepSeek-VL2deepseek81.3%
- OpenGVLab/InternVL3-8Bopengvlab78.7%
- XiaomiMiMo/MiMo-VL-7B-RLxiaomi78.7%
- OpenGVLab/InternVL2-40Bopengvlab76%
- Qwen/Qwen2.5-VL-7B-Instructqwen76%
RR
mmBench · MMBench · RR · percent · Higher is better
- OpenGVLab/InternVL2-40Bopengvlab89.1%
- OpenGVLab/InternVL3-2Bopengvlab84.4%
- Qwen: Qwen2.5 VL 72B Instructqwen82.9%
- OpenGVLab/InternVL3-8Bopengvlab82.5%
- DeepSeek: DeepSeek-VL2deepseek82%
- Qwen/Qwen2-VL-72B-Instructqwen82%
- nvidia/NVLM-D-72Bnvidia80.6%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai79.6%
- rhymes-ai/Ariarhymes-ai79.6%
- Qwen/Qwen2.5-VL-7B-Instructqwen78.2%
- Llama-3.2-90B-Vision-Instructmeta-llama77.7%
- microsoft/Phi-3.5-vision-instructmicrosoft74.9%
spatial_relationship
mmBench · MMBench · spatial_relationship · percent · Higher is better
- Qwen: Qwen2.5 VL 72B Instructqwen79%
- Qwen/Qwen2-VL-72B-Instructqwen77.8%
- nvidia/NVLM-D-72Bnvidia63%
- OpenGVLab/InternVL2-40Bopengvlab63%
- Qwen/Qwen2.5-VL-7B-Instructqwen59.3%
- DeepSeek: DeepSeek-VL2deepseek55.6%
- OpenGVLab/InternVL3-8Bopengvlab55.6%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai53.1%
- Qwen/Qwen2-VL-7B-Instructqwen51.9%
- Llama-3.2-90B-Vision-Instructmeta-llama50.6%
- mistralai/Pixtral-12B-2409mistralai50.6%
- rhymes-ai/Ariarhymes-ai43.2%
identity_reasoning
mmBench · MMBench · identity_reasoning · percent · Higher is better
- Qwen/Qwen2-VL-72B-Instructqwen100%
- Google: Gemma 3 27Bgoogle98.7%
- moonshotai/Kimi-VL-A3B-Thinking-2506moonshotai98.7%
- OpenGVLab/InternVL3-8Bopengvlab98.7%
- Xkev/Llama-3.2V-11B-cotxkev98.7%
- DeepSeek: DeepSeek-VL2deepseek97.4%
- HuggingFaceM4/idefics2-8bhuggingfacem497.4%
- microsoft/Phi-3.5-vision-instructmicrosoft97.4%
- Qwen/Qwen2.5-VL-3B-Instructqwen97.4%
- Qwen: Qwen2.5 VL 72B Instructqwen97.4%
- Qwen/Qwen2-VL-2B-Instructqwen97.4%
- vikhyatk/moondream2vikhyatk97.4%
celebrity_recognition
mmBench · MMBench · celebrity_recognition · percent · Higher is better
- Qwen: Qwen2.5 VL 72B Instructqwen97.5%
- Qwen/Qwen2-VL-72B-Instructqwen96.6%
- OpenGVLab/InternVL2-40Bopengvlab94.1%
- Qwen/Qwen2.5-VL-3B-Instructqwen93.2%
- Qwen/Qwen2.5-VL-7B-Instructqwen92.4%
- Llama-3.2-90B-Vision-Instructmeta-llama90.7%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai90.7%
- Qwen/Qwen2-VL-7B-Instructqwen90.7%
- nvidia/NVLM-D-72Bnvidia88.1%
- rhymes-ai/Ariarhymes-ai86.4%
- Qwen/Qwen2-VL-2B-Instructqwen85.6%
- Google: Gemma 3 12Bgoogle84.7%
spatial_relationship
mmBench · MMBench · spatial_relationship · percent · Higher is better
- Qwen: Qwen2.5 VL 72B Instructqwen84%
- Qwen/Qwen2-VL-72B-Instructqwen80%
- Qwen/Qwen2.5-VL-32B-Instructqwen73.3%
- OpenGVLab/InternVL2-40Bopengvlab69.3%
- YannQi/R-4Byannqi68%
- NCSOFT/VARCO-VISION-2.0-14Bncsoft66.7%
- nvidia/NVLM-D-72Bnvidia66.7%
- DeepSeek: DeepSeek-VL2deepseek62.7%
- Qwen/Qwen2.5-VL-7B-Instructqwen62.7%
- OpenGVLab/InternVL3-8Bopengvlab58.7%
- XiaomiMiMo/MiMo-VL-7B-RLxiaomi57.3%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai56%
future_prediction
mmBench · MMBench · future_prediction · percent · Higher is better
- Qwen/Qwen2-VL-72B-Instructqwen85.3%
- OpenGVLab/InternVL2-40Bopengvlab84%
- NCSOFT/VARCO-VISION-2.0-14Bncsoft82.7%
- Google: Gemma 3 27Bgoogle81.3%
- Qwen: Qwen2.5 VL 72B Instructqwen81.3%
- DeepSeek: DeepSeek-VL2deepseek80%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai80%
- Qwen/Qwen2.5-VL-7B-Instructqwen80%
- Google: Gemma 3 12Bgoogle78.7%
- OpenGVLab/InternVL2_5-4Bopengvlab78.7%
- OpenGVLab/InternVL2_5-8Bopengvlab78.7%
- Qwen/Qwen2.5-VL-32B-Instructqwen77.3%
image_topic
mmBench · MMBench · image_topic · percent · Higher is better
- HuggingFaceM4/Idefics3-8B-Llama3huggingfacem497.6%
- OpenGVLab/InternVL2-40Bopengvlab97.6%
- OpenGVLab/InternVL3-8Bopengvlab97.6%
- Google: Gemma 3 12Bgoogle96.5%
- Google: Gemma 3 4Bgoogle96.5%
- Llama-3.2-90B-Vision-Instructmeta-llama96.5%
- mistralai/Pixtral-12B-2409mistralai96.5%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai96.5%
- OpenGVLab/InternVL3-2Bopengvlab96.5%
- Qwen/Qwen2.5-VL-3B-Instructqwen96.5%
- Qwen: Qwen2.5 VL 72B Instructqwen96.5%
- Qwen/Qwen2-VL-72B-Instructqwen96.5%
FP-S
mmBench · MMBench · FP-S · percent · Higher is better
- Qwen: Qwen2.5 VL 72B Instructqwen96.3%
- Qwen/Qwen2-VL-72B-Instructqwen92.8%
- OpenGVLab/InternVL2-40Bopengvlab91.6%
- Qwen/Qwen2.5-VL-32B-Instructqwen90.3%
- Qwen/Qwen2.5-VL-7B-Instructqwen89.6%
- moonshotai/Kimi-VL-A3B-Instructmoonshotai89.3%
- OpenGVLab/InternVL2_5-8Bopengvlab88.9%
- nvidia/NVLM-D-72Bnvidia87.7%
- XiaomiMiMo/MiMo-VL-7B-RLxiaomi87%
- OpenGVLab/InternVL3-8Bopengvlab86.8%
- NCSOFT/VARCO-VISION-2.0-14Bncsoft86.5%
- DeepSeek: DeepSeek-VL2deepseek86.1%
Models
LoadingBenchmarks
Explore every benchmark
LoadingThese charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.