Open LLM Leaderboard v2 · Archive
Indexed results from Open LLM Leaderboard v2 · Archive. Each ranking retains its own metric and evaluation conditions.
Open LLM v2 Average
openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized six-task average · percent
- MaziyarPanahi/calme-3.2-instruct-78bmaziyarpanahi52.081%
- MaziyarPanahi/calme-3.1-instruct-78bmaziyarpanahi51.287%
- dfurman/CalmeRys-78B-Orpo-v0.1dfurman51.231%
- MaziyarPanahi/calme-2.4-rys-78bmaziyarpanahi50.765%
- huihui-ai/Qwen2.5-72B-Instruct-abliteratedhuihui-ai48.106%
- Qwen2.5 72B Instructqwen47.98%
- MaziyarPanahi/calme-2.1-qwen2.5-72bmaziyarpanahi47.857%
- newsbang/Homer-v1.0-Qwen2.5-72Bnewsbang47.464%
- ehristoforu/qwen2.5-test-32b-itehristoforu47.368%
- Saxo/Linkbricks-Horizon-AI-Avengers-V1-32Bsaxo47.337%
- MaziyarPanahi/calme-2.2-qwen2.5-72bmaziyarpanahi47.225%
- fluently-lm/FluentlyLM-Prinumfluently-lm47.217%
Open LLM v2 BBH · Normalized
openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized score · percent
- qingy2024/Benchmaxx-Llama-3.2-1B-Instructqingy202476.7%
- JungZoona/T3Q-Qwen2.5-14B-Instruct-1M-e3jungzoona65.467%
- JungZoona/T3Q-qwen2.5-14b-v1.0-e3jungzoona65.467%
- shuttleai/shuttle-3shuttleai64.053%
- IntervitensInc/internlm2_5-20b-llamafiedintervitensinc63.471%
- Sakalti/ultiima-72B-v1.5sakalti63.438%
- internlm/internlm2_5-20b-chatinternlm62.832%
- MaziyarPanahi/calme-3.2-instruct-78bmaziyarpanahi62.609%
- MaziyarPanahi/calme-3.1-instruct-78bmaziyarpanahi62.41%
- newsbang/Homer-v1.0-Qwen2.5-72Bnewsbang62.274%
- MaziyarPanahi/calme-2.4-rys-78bmaziyarpanahi62.157%
- raphgg/test-2.5-72Braphgg62.154%
Open LLM v2 BBH · Raw
openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Raw accuracy · percent
- qingy2024/Benchmaxx-Llama-3.2-1B-Instructqingy202482.691%
- JungZoona/T3Q-Qwen2.5-14B-Instruct-1M-e3jungzoona75.86%
- JungZoona/T3Q-qwen2.5-14b-v1.0-e3jungzoona75.86%
- IntervitensInc/internlm2_5-20b-llamafiedintervitensinc74.785%
- internlm/internlm2_5-20b-chatinternlm74.736%
- shuttleai/shuttle-3shuttleai74.203%
- Sakalti/ultiima-72B-v1.5sakalti73.917%
- MaziyarPanahi/calme-3.2-instruct-78bmaziyarpanahi73.186%
- newsbang/Homer-v1.0-Qwen2.5-72Bnewsbang73.098%
- MaziyarPanahi/calme-3.1-instruct-78bmaziyarpanahi73.052%
- MaziyarPanahi/calme-2.4-rys-78bmaziyarpanahi72.795%
- MaziyarPanahi/calme-2.2-qwen2.5-72bmaziyarpanahi72.764%
Open LLM v2 GPQA · Normalized
openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized score · percent
- Steelskull/L3.3-MS-Nevoria-70bsteelskull29.418%
- Steelskull/L3.3-Nevoria-R1-70bsteelskull29.195%
- Tarek07/Progenitor-V1.1-LLaMa-70Btarek0727.74%
- rootxhacker/Apollo-70Brootxhacker27.629%
- Sao10K/70B-L3.3-Cirrus-x1sao10k26.622%
- Triangle104/Set-70btriangle10426.174%
- Daemontatox/Llama3.3-70B-CogniLinkdaemontatox26.063%
- Tarek07/Thalassic-Alpha-LLaMa-70Btarek0725.839%
- mistralai/Mistral-Large-Instruct-2411mistralai24.944%
- OpenBuddy/openbuddy-llama3.3-70b-v24.1-131kopenbuddy24.609%
- pankajmathur/orca_mini_v8_1_70bpankajmathur24.385%
- JungZoona/T3Q-Qwen2.5-14B-Instruct-1M-e3jungzoona22.26%
Open LLM v2 GPQA · Raw
openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Raw accuracy · percent
- Steelskull/L3.3-MS-Nevoria-70bsteelskull47.064%
- Steelskull/L3.3-Nevoria-R1-70bsteelskull46.896%
- Tarek07/Progenitor-V1.1-LLaMa-70Btarek0745.805%
- rootxhacker/Apollo-70Brootxhacker45.721%
- Sao10K/70B-L3.3-Cirrus-x1sao10k44.966%
- Triangle104/Set-70btriangle10444.631%
- Daemontatox/Llama3.3-70B-CogniLinkdaemontatox44.547%
- Tarek07/Thalassic-Alpha-LLaMa-70Btarek0744.379%
- mistralai/Mistral-Large-Instruct-2411mistralai43.708%
- OpenBuddy/openbuddy-llama3.3-70b-v24.1-131kopenbuddy43.456%
- pankajmathur/orca_mini_v8_1_70bpankajmathur43.289%
- JungZoona/T3Q-Qwen2.5-14B-Instruct-1M-e3jungzoona41.695%
Open LLM v2 IFEval · Normalized
openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized score · percent
- Meta: Llama 3.3 70B Instructmeta-llama89.976%
- Meta: Llama 3.1 70B Instructmeta-llama86.689%
- MaziyarPanahi/calme-2.1-qwen2.5-72bmaziyarpanahi86.624%
- VAGOsolutions/Llama-3.1-SauerkrautLM-70b-Instructvagosolutions86.564%
- Qwen2.5 72B Instructqwen86.384%
- MaziyarPanahi/calme-2.3-llama3.1-70bmaziyarpanahi86.047%
- huihui-ai/Qwen2.5-72B-Instruct-abliteratedhuihui-ai85.927%
- MaziyarPanahi/calme-2.2-llama3.1-70bmaziyarpanahi85.927%
- YOYO-AI/ZYH-LLM-Qwen2.5-14B-V3yoyo-ai85.779%
- pankajmathur/orca_mini_v8_1_70bpankajmathur85.714%
- dnhkng/RYS-Llama3.1-Largednhkng84.92%
- rubenroy/Gilgamesh-72Brubenroy84.86%
Open LLM v2 IFEval · Raw
openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Raw accuracy · percent
- Meta: Llama 3.3 70B Instructmeta-llama89.976%
- Meta: Llama 3.1 70B Instructmeta-llama86.689%
- MaziyarPanahi/calme-2.1-qwen2.5-72bmaziyarpanahi86.624%
- VAGOsolutions/Llama-3.1-SauerkrautLM-70b-Instructvagosolutions86.564%
- Qwen2.5 72B Instructqwen86.384%
- MaziyarPanahi/calme-2.3-llama3.1-70bmaziyarpanahi86.047%
- huihui-ai/Qwen2.5-72B-Instruct-abliteratedhuihui-ai85.927%
- MaziyarPanahi/calme-2.2-llama3.1-70bmaziyarpanahi85.927%
- YOYO-AI/ZYH-LLM-Qwen2.5-14B-V3yoyo-ai85.779%
- pankajmathur/orca_mini_v8_1_70bpankajmathur85.714%
- dnhkng/RYS-Llama3.1-Largednhkng84.92%
- rubenroy/Gilgamesh-72Brubenroy84.86%
Open LLM v2 MATH Lvl 5 · Normalized
openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized score · percent
- nvidia/AceMath-72B-Instructnvidia71.45%
- nvidia/AceMath-7B-Instructnvidia63.369%
- nvidia/AceInstruct-72Bnvidia62.613%
- Qwen/Qwen2.5-32B-Instructqwen62.538%
- Qwen/Qwen2.5-Math-72B-Instructqwen62.387%
- maldv/Awqward2.5-32B-Instructmaldv62.311%
- Saxo/Linkbricks-Horizon-AI-Avengers-V6-32Bsaxo62.236%
- Saxo/Linkbricks-Horizon-AI-Avengers-V3-32Bsaxo61.782%
- tanliboy/lambda-qwen2.5-32b-dpo-testtanliboy61.027%
- Saxo/Linkbricks-Horizon-AI-Avengers-V1-32Bsaxo60.272%
- huihui-ai/Qwen2.5-72B-Instruct-abliteratedhuihui-ai60.121%
- RDson/WomboCombo-R1-Coder-14B-Previewrdson59.894%
Open LLM v2 MATH Lvl 5 · Raw
openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Raw accuracy · percent
- nvidia/AceMath-72B-Instructnvidia71.45%
- nvidia/AceMath-7B-Instructnvidia63.369%
- nvidia/AceInstruct-72Bnvidia62.613%
- Qwen/Qwen2.5-32B-Instructqwen62.538%
- Qwen/Qwen2.5-Math-72B-Instructqwen62.387%
- maldv/Awqward2.5-32B-Instructmaldv62.311%
- Saxo/Linkbricks-Horizon-AI-Avengers-V6-32Bsaxo62.236%
- Saxo/Linkbricks-Horizon-AI-Avengers-V3-32Bsaxo61.782%
- tanliboy/lambda-qwen2.5-32b-dpo-testtanliboy61.027%
- Saxo/Linkbricks-Horizon-AI-Avengers-V1-32Bsaxo60.272%
- huihui-ai/Qwen2.5-72B-Instruct-abliteratedhuihui-ai60.121%
- RDson/WomboCombo-R1-Coder-14B-Previewrdson59.894%
Open LLM v2 MMLU-PRO · Normalized
openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized score · percent
- MaziyarPanahi/calme-3.2-instruct-78bmaziyarpanahi70.034%
- MaziyarPanahi/calme-3.1-instruct-78bmaziyarpanahi68.722%
- dfurman/CalmeRys-78B-Orpo-v0.1dfurman66.801%
- MaziyarPanahi/calme-2.4-rys-78bmaziyarpanahi66.691%
- glaiveai/Reflection-Llama-3.1-70Bglaiveai59.349%
- arcee-ai/Arcee-Blitzarcee-ai57.262%
- newsbang/Homer-v1.0-Qwen2.5-72Bnewsbang57.17%
- Sakalti/ultiima-72B-v1.5sakalti56.154%
- Qwen/Qwen2.5-72Bqwen55.203%
- Aryanne/QwentileSwaparyanne54.953%
- rombodawg/Rombos-LLM-V2.5-Qwen-72brombodawg54.833%
- rombodawg/Rombos-LLM-V2.5-Qwen-32brombodawg54.621%
Open LLM v2 MMLU-PRO · Raw
openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Raw accuracy · percent
- MaziyarPanahi/calme-3.2-instruct-78bmaziyarpanahi73.03%
- MaziyarPanahi/calme-3.1-instruct-78bmaziyarpanahi71.85%
- dfurman/CalmeRys-78B-Orpo-v0.1dfurman70.121%
- MaziyarPanahi/calme-2.4-rys-78bmaziyarpanahi70.022%
- glaiveai/Reflection-Llama-3.1-70Bglaiveai63.414%
- arcee-ai/Arcee-Blitzarcee-ai61.536%
- newsbang/Homer-v1.0-Qwen2.5-72Bnewsbang61.453%
- Sakalti/ultiima-72B-v1.5sakalti60.539%
- Qwen/Qwen2.5-72Bqwen59.683%
- Aryanne/QwentileSwaparyanne59.458%
- rombodawg/Rombos-LLM-V2.5-Qwen-72brombodawg59.35%
- rombodawg/Rombos-LLM-V2.5-Qwen-32brombodawg59.159%
Open LLM v2 MUSR · Normalized
openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized score · percent
- JungZoona/T3Q-Qwen2.5-14B-Instruct-1M-e3jungzoona38.688%
- JungZoona/T3Q-qwen2.5-14b-v1.0-e3jungzoona38.688%
- MaziyarPanahi/calme-3.2-instruct-78bmaziyarpanahi38.529%
- MaziyarPanahi/calme-3.1-instruct-78bmaziyarpanahi36.499%
- dfurman/CalmeRys-78B-Orpo-v0.1dfurman36.372%
- MaziyarPanahi/calme-2.4-rys-78bmaziyarpanahi34.566%
- LeroyDyer/_Spydaz_Web_AI_AGI_R1_OmG_Coderleroydyer32.374%
- Triangle104/DS-R1-Distill-Q2.5-14B-Harmony_V0.1triangle10431.919%
- LeroyDyer/_Spydaz_Web_AI_AGI_R1_Top_Studentleroydyer29.374%
- win10/miscii-14b-1M-0128win1028.755%
- DeepSeek: DeepSeek-R1-Distill-Qwen-14Bdeepseek28.711%
- prithivMLmods/Galactic-Qwen-14B-Exp2prithivmlmods28.49%
Models
LoadingBenchmarks
Explore every benchmark
LoadingThese charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.