Open LLM Leaderboard v2

Indexed results from Open LLM Leaderboard v2 · Archive. Each ranking retains its own metric and evaluation conditions.

Open LLM v2 Average

openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized six-task average · percent

  1. MaziyarPanahi/calme-3.2-instruct-78bmaziyarpanahi52.081%
  2. MaziyarPanahi/calme-3.1-instruct-78bmaziyarpanahi51.287%
  3. dfurman/CalmeRys-78B-Orpo-v0.1dfurman51.231%
  4. MaziyarPanahi/calme-2.4-rys-78bmaziyarpanahi50.765%
  5. huihui-ai/Qwen2.5-72B-Instruct-abliteratedhuihui-ai48.106%
  6. Qwen2.5 72B Instructqwen47.98%
  7. MaziyarPanahi/calme-2.1-qwen2.5-72bmaziyarpanahi47.857%
  8. newsbang/Homer-v1.0-Qwen2.5-72Bnewsbang47.464%
  9. ehristoforu/qwen2.5-test-32b-itehristoforu47.368%
  10. Saxo/Linkbricks-Horizon-AI-Avengers-V1-32Bsaxo47.337%
  11. MaziyarPanahi/calme-2.2-qwen2.5-72bmaziyarpanahi47.225%
  12. fluently-lm/FluentlyLM-Prinumfluently-lm47.217%

Open LLM v2 BBH · Normalized

openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized score · percent

  1. qingy2024/Benchmaxx-Llama-3.2-1B-Instructqingy202476.7%
  2. JungZoona/T3Q-Qwen2.5-14B-Instruct-1M-e3jungzoona65.467%
  3. JungZoona/T3Q-qwen2.5-14b-v1.0-e3jungzoona65.467%
  4. shuttleai/shuttle-3shuttleai64.053%
  5. IntervitensInc/internlm2_5-20b-llamafiedintervitensinc63.471%
  6. Sakalti/ultiima-72B-v1.5sakalti63.438%
  7. internlm/internlm2_5-20b-chatinternlm62.832%
  8. MaziyarPanahi/calme-3.2-instruct-78bmaziyarpanahi62.609%
  9. MaziyarPanahi/calme-3.1-instruct-78bmaziyarpanahi62.41%
  10. newsbang/Homer-v1.0-Qwen2.5-72Bnewsbang62.274%
  11. MaziyarPanahi/calme-2.4-rys-78bmaziyarpanahi62.157%
  12. raphgg/test-2.5-72Braphgg62.154%

Open LLM v2 BBH · Raw

openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Raw accuracy · percent

  1. qingy2024/Benchmaxx-Llama-3.2-1B-Instructqingy202482.691%
  2. JungZoona/T3Q-Qwen2.5-14B-Instruct-1M-e3jungzoona75.86%
  3. JungZoona/T3Q-qwen2.5-14b-v1.0-e3jungzoona75.86%
  4. IntervitensInc/internlm2_5-20b-llamafiedintervitensinc74.785%
  5. internlm/internlm2_5-20b-chatinternlm74.736%
  6. shuttleai/shuttle-3shuttleai74.203%
  7. Sakalti/ultiima-72B-v1.5sakalti73.917%
  8. MaziyarPanahi/calme-3.2-instruct-78bmaziyarpanahi73.186%
  9. newsbang/Homer-v1.0-Qwen2.5-72Bnewsbang73.098%
  10. MaziyarPanahi/calme-3.1-instruct-78bmaziyarpanahi73.052%
  11. MaziyarPanahi/calme-2.4-rys-78bmaziyarpanahi72.795%
  12. MaziyarPanahi/calme-2.2-qwen2.5-72bmaziyarpanahi72.764%

Open LLM v2 GPQA · Normalized

openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized score · percent

  1. Steelskull/L3.3-MS-Nevoria-70bsteelskull29.418%
  2. Steelskull/L3.3-Nevoria-R1-70bsteelskull29.195%
  3. Tarek07/Progenitor-V1.1-LLaMa-70Btarek0727.74%
  4. rootxhacker/Apollo-70Brootxhacker27.629%
  5. Sao10K/70B-L3.3-Cirrus-x1sao10k26.622%
  6. Triangle104/Set-70btriangle10426.174%
  7. Daemontatox/Llama3.3-70B-CogniLinkdaemontatox26.063%
  8. Tarek07/Thalassic-Alpha-LLaMa-70Btarek0725.839%
  9. mistralai/Mistral-Large-Instruct-2411mistralai24.944%
  10. OpenBuddy/openbuddy-llama3.3-70b-v24.1-131kopenbuddy24.609%
  11. pankajmathur/orca_mini_v8_1_70bpankajmathur24.385%
  12. JungZoona/T3Q-Qwen2.5-14B-Instruct-1M-e3jungzoona22.26%

Open LLM v2 GPQA · Raw

openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Raw accuracy · percent

  1. Steelskull/L3.3-MS-Nevoria-70bsteelskull47.064%
  2. Steelskull/L3.3-Nevoria-R1-70bsteelskull46.896%
  3. Tarek07/Progenitor-V1.1-LLaMa-70Btarek0745.805%
  4. rootxhacker/Apollo-70Brootxhacker45.721%
  5. Sao10K/70B-L3.3-Cirrus-x1sao10k44.966%
  6. Triangle104/Set-70btriangle10444.631%
  7. Daemontatox/Llama3.3-70B-CogniLinkdaemontatox44.547%
  8. Tarek07/Thalassic-Alpha-LLaMa-70Btarek0744.379%
  9. mistralai/Mistral-Large-Instruct-2411mistralai43.708%
  10. OpenBuddy/openbuddy-llama3.3-70b-v24.1-131kopenbuddy43.456%
  11. pankajmathur/orca_mini_v8_1_70bpankajmathur43.289%
  12. JungZoona/T3Q-Qwen2.5-14B-Instruct-1M-e3jungzoona41.695%

Open LLM v2 IFEval · Normalized

openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized score · percent

  1. Meta: Llama 3.3 70B Instructmeta-llama89.976%
  2. Meta: Llama 3.1 70B Instructmeta-llama86.689%
  3. MaziyarPanahi/calme-2.1-qwen2.5-72bmaziyarpanahi86.624%
  4. VAGOsolutions/Llama-3.1-SauerkrautLM-70b-Instructvagosolutions86.564%
  5. Qwen2.5 72B Instructqwen86.384%
  6. MaziyarPanahi/calme-2.3-llama3.1-70bmaziyarpanahi86.047%
  7. huihui-ai/Qwen2.5-72B-Instruct-abliteratedhuihui-ai85.927%
  8. MaziyarPanahi/calme-2.2-llama3.1-70bmaziyarpanahi85.927%
  9. YOYO-AI/ZYH-LLM-Qwen2.5-14B-V3yoyo-ai85.779%
  10. pankajmathur/orca_mini_v8_1_70bpankajmathur85.714%
  11. dnhkng/RYS-Llama3.1-Largednhkng84.92%
  12. rubenroy/Gilgamesh-72Brubenroy84.86%

Open LLM v2 IFEval · Raw

openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Raw accuracy · percent

  1. Meta: Llama 3.3 70B Instructmeta-llama89.976%
  2. Meta: Llama 3.1 70B Instructmeta-llama86.689%
  3. MaziyarPanahi/calme-2.1-qwen2.5-72bmaziyarpanahi86.624%
  4. VAGOsolutions/Llama-3.1-SauerkrautLM-70b-Instructvagosolutions86.564%
  5. Qwen2.5 72B Instructqwen86.384%
  6. MaziyarPanahi/calme-2.3-llama3.1-70bmaziyarpanahi86.047%
  7. huihui-ai/Qwen2.5-72B-Instruct-abliteratedhuihui-ai85.927%
  8. MaziyarPanahi/calme-2.2-llama3.1-70bmaziyarpanahi85.927%
  9. YOYO-AI/ZYH-LLM-Qwen2.5-14B-V3yoyo-ai85.779%
  10. pankajmathur/orca_mini_v8_1_70bpankajmathur85.714%
  11. dnhkng/RYS-Llama3.1-Largednhkng84.92%
  12. rubenroy/Gilgamesh-72Brubenroy84.86%

Open LLM v2 MATH Lvl 5 · Normalized

openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized score · percent

  1. nvidia/AceMath-72B-Instructnvidia71.45%
  2. nvidia/AceMath-7B-Instructnvidia63.369%
  3. nvidia/AceInstruct-72Bnvidia62.613%
  4. Qwen/Qwen2.5-32B-Instructqwen62.538%
  5. Qwen/Qwen2.5-Math-72B-Instructqwen62.387%
  6. maldv/Awqward2.5-32B-Instructmaldv62.311%
  7. Saxo/Linkbricks-Horizon-AI-Avengers-V6-32Bsaxo62.236%
  8. Saxo/Linkbricks-Horizon-AI-Avengers-V3-32Bsaxo61.782%
  9. tanliboy/lambda-qwen2.5-32b-dpo-testtanliboy61.027%
  10. Saxo/Linkbricks-Horizon-AI-Avengers-V1-32Bsaxo60.272%
  11. huihui-ai/Qwen2.5-72B-Instruct-abliteratedhuihui-ai60.121%
  12. RDson/WomboCombo-R1-Coder-14B-Previewrdson59.894%

Open LLM v2 MATH Lvl 5 · Raw

openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Raw accuracy · percent

  1. nvidia/AceMath-72B-Instructnvidia71.45%
  2. nvidia/AceMath-7B-Instructnvidia63.369%
  3. nvidia/AceInstruct-72Bnvidia62.613%
  4. Qwen/Qwen2.5-32B-Instructqwen62.538%
  5. Qwen/Qwen2.5-Math-72B-Instructqwen62.387%
  6. maldv/Awqward2.5-32B-Instructmaldv62.311%
  7. Saxo/Linkbricks-Horizon-AI-Avengers-V6-32Bsaxo62.236%
  8. Saxo/Linkbricks-Horizon-AI-Avengers-V3-32Bsaxo61.782%
  9. tanliboy/lambda-qwen2.5-32b-dpo-testtanliboy61.027%
  10. Saxo/Linkbricks-Horizon-AI-Avengers-V1-32Bsaxo60.272%
  11. huihui-ai/Qwen2.5-72B-Instruct-abliteratedhuihui-ai60.121%
  12. RDson/WomboCombo-R1-Coder-14B-Previewrdson59.894%

Open LLM v2 MMLU-PRO · Normalized

openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized score · percent

  1. MaziyarPanahi/calme-3.2-instruct-78bmaziyarpanahi70.034%
  2. MaziyarPanahi/calme-3.1-instruct-78bmaziyarpanahi68.722%
  3. dfurman/CalmeRys-78B-Orpo-v0.1dfurman66.801%
  4. MaziyarPanahi/calme-2.4-rys-78bmaziyarpanahi66.691%
  5. glaiveai/Reflection-Llama-3.1-70Bglaiveai59.349%
  6. arcee-ai/Arcee-Blitzarcee-ai57.262%
  7. newsbang/Homer-v1.0-Qwen2.5-72Bnewsbang57.17%
  8. Sakalti/ultiima-72B-v1.5sakalti56.154%
  9. Qwen/Qwen2.5-72Bqwen55.203%
  10. Aryanne/QwentileSwaparyanne54.953%
  11. rombodawg/Rombos-LLM-V2.5-Qwen-72brombodawg54.833%
  12. rombodawg/Rombos-LLM-V2.5-Qwen-32brombodawg54.621%

Open LLM v2 MMLU-PRO · Raw

openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Raw accuracy · percent

  1. MaziyarPanahi/calme-3.2-instruct-78bmaziyarpanahi73.03%
  2. MaziyarPanahi/calme-3.1-instruct-78bmaziyarpanahi71.85%
  3. dfurman/CalmeRys-78B-Orpo-v0.1dfurman70.121%
  4. MaziyarPanahi/calme-2.4-rys-78bmaziyarpanahi70.022%
  5. glaiveai/Reflection-Llama-3.1-70Bglaiveai63.414%
  6. arcee-ai/Arcee-Blitzarcee-ai61.536%
  7. newsbang/Homer-v1.0-Qwen2.5-72Bnewsbang61.453%
  8. Sakalti/ultiima-72B-v1.5sakalti60.539%
  9. Qwen/Qwen2.5-72Bqwen59.683%
  10. Aryanne/QwentileSwaparyanne59.458%
  11. rombodawg/Rombos-LLM-V2.5-Qwen-72brombodawg59.35%
  12. rombodawg/Rombos-LLM-V2.5-Qwen-32brombodawg59.159%

Open LLM v2 MUSR · Normalized

openLLMLeaderboardV2 · Open LLM Leaderboard v2 · Normalized score · percent

  1. JungZoona/T3Q-Qwen2.5-14B-Instruct-1M-e3jungzoona38.688%
  2. JungZoona/T3Q-qwen2.5-14b-v1.0-e3jungzoona38.688%
  3. MaziyarPanahi/calme-3.2-instruct-78bmaziyarpanahi38.529%
  4. MaziyarPanahi/calme-3.1-instruct-78bmaziyarpanahi36.499%
  5. dfurman/CalmeRys-78B-Orpo-v0.1dfurman36.372%
  6. MaziyarPanahi/calme-2.4-rys-78bmaziyarpanahi34.566%
  7. LeroyDyer/_Spydaz_Web_AI_AGI_R1_OmG_Coderleroydyer32.374%
  8. Triangle104/DS-R1-Distill-Q2.5-14B-Harmony_V0.1triangle10431.919%
  9. LeroyDyer/_Spydaz_Web_AI_AGI_R1_Top_Studentleroydyer29.374%
  10. win10/miscii-14b-1M-0128win1028.755%
  11. DeepSeek: DeepSeek-R1-Distill-Qwen-14Bdeepseek28.711%
  12. prithivMLmods/Galactic-Qwen-14B-Exp2prithivmlmods28.49%

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace