Open Ko-LLM Leaderboard
Indexed results from Open Ko-LLM Leaderboard. Each ranking retains its own metric and evaluation conditions.
ko_ifeval · inst_level_loose_acc,none
openKoLLM · Open Ko-LLM Leaderboard · ko_ifeval · inst_level_loose_acc,none · percent · Higher is better
- kayfour/T3Q-Qwen2.5-7B-it-KOR-Safekayfour70.178%
- Qwen: Qwen2.5 7B Instructqwen70.178%
- ENERGY-DRINK-LOVE/rtzr_dpo-v4-hqenergy-drink-love69.733%
- Gunulhona/Gemma-Ko-Mergegunulhona65.875%
- mlabonne/Daredevil-8B-abliteratedmlabonne64.243%
- MaziyarPanahi/Llama-3-8B-Instruct-v0.10maziyarpanahi62.76%
- MaziyarPanahi/Llama-3-8B-Instruct-v0.10maziyarpanahi62.76%
- vicgalle/Configurable-Llama-3.1-8B-Instructvicgalle62.76%
- v000000/L3.1-Niitorm-8B-DPO-t0.0001v00000062.315%
- vicgalle/Configurable-Llama-3-8B-v0.3vicgalle62.166%
- cognitivecomputations/Llama-3-8B-Instruct-abliterated-v2cognitivecomputations62.018%
- VAGOsolutions/Llama-3-SauerkrautLM-8b-Instructvagosolutions61.869%
ko_ifeval · prompt_level_strict_acc,none
openKoLLM · Open Ko-LLM Leaderboard · ko_ifeval · prompt_level_strict_acc,none · percent · Higher is better
ko_eqbench · eqbench,none
openKoLLM · Open Ko-LLM Leaderboard · ko_eqbench · eqbench,none · score · Higher is better
ko_ifeval · prompt_level_loose_acc,none
openKoLLM · Open Ko-LLM Leaderboard · ko_ifeval · prompt_level_loose_acc,none · percent · Higher is better
- kayfour/T3Q-Qwen2.5-7B-it-KOR-Safekayfour63.36%
- Qwen: Qwen2.5 7B Instructqwen63.36%
- ENERGY-DRINK-LOVE/rtzr_dpo-v4-hqenergy-drink-love62.551%
- Gunulhona/Gemma-Ko-Mergegunulhona57.895%
- mlabonne/Daredevil-8B-abliteratedmlabonne55.87%
- MaziyarPanahi/Llama-3-8B-Instruct-v0.10maziyarpanahi55.263%
- MaziyarPanahi/Llama-3-8B-Instruct-v0.10maziyarpanahi55.263%
- v000000/L3.1-Niitorm-8B-DPO-t0.0001v00000053.846%
- vicgalle/Configurable-Llama-3-8B-v0.3vicgalle53.846%
- cognitivecomputations/Llama-3-8B-Instruct-abliterated-v2cognitivecomputations53.644%
- VAGOsolutions/Llama-3-SauerkrautLM-8b-Instructvagosolutions53.644%
- vicgalle/Configurable-Llama-3.1-8B-Instructvicgalle53.644%
ko_gsm8k · exact_match,strict-match
openKoLLM · Open Ko-LLM Leaderboard · ko_gsm8k · exact_match,strict-match · percent · Higher is better
- NAPS-ai/naps-llama-3_1-8b-instruct-v0.4naps-ai58.302%
- macadeliccc/Samantha-Qwen-2-7Bmacadeliccc58.15%
- SeaLLMs/SeaLLMs-v3-7B-Chatseallms58.074%
- Eurdem/Defne-llama3.1-8Beurdem57.923%
- AIDX-ktds/ktdsbaseLM-v0.15-onbased-llama3.1aidx-ktds57.619%
- AIDX-ktds/ktdsbaseLM-v0.16-onbased-llama3.1aidx-ktds57.619%
- Weyaxi/Einstein-v7-Qwen2-7Bweyaxi57.165%
- BAAI/Infinity-Instruct-3M-0625-Llama3-8Bbaai56.634%
- vicgalle/Configurable-Llama-3.1-8B-Instructvicgalle56.634%
- mlabonne/Daredevil-8B-abliterated-dpomixmlabonne56.482%
- v000000/L3.1-Niitorm-8B-DPO-t0.0001v00000056.331%
- SeaLLMs/SeaLLM-7B-v2.5seallms55.8%
ko_ifeval · inst_level_strict_acc,none
openKoLLM · Open Ko-LLM Leaderboard · ko_ifeval · inst_level_strict_acc,none · percent · Higher is better
- nbeerbower/gemma2-gutenberg-27Bnbeerbower77.3%
- byroneverson/gemma-2-27b-it-abliteratedbyroneverson76.113%
- recoilme/recoilme-gemma-2-9B-v0.2recoilme72.997%
- UCLA-AGI/Gemma-2-9B-It-SPPO-Iter1ucla-agi72.107%
- rombodawg/Rombos-LLM-V2.6-Qwen-14brombodawg71.958%
- v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpenov00000071.662%
- v000000/Qwen2.5-Lumen-14Bv00000071.662%
- v000000/Qwen2.5-14B-Gutenberg-1e-Deltav00000071.365%
- UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3ucla-agi71.217%
- arcee-ai/SuperNova-Mediusarcee-ai71.068%
- Lambent/qwen2.5-reinstruct-alternate-lumen-14Blambent70.772%
- UCLA-AGI/Gemma-2-9B-It-SPPO-Iter2ucla-agi70.623%
ko_gsm8k · exact_match,strict-match
openKoLLM · Open Ko-LLM Leaderboard · ko_gsm8k · exact_match,strict-match · percent · Higher is better
- nbeerbower/gemma2-gutenberg-27Bnbeerbower71.721%
- byroneverson/gemma-2-27b-it-abliteratedbyroneverson70.811%
- recoilme/recoilme-gemma-2-9B-v0.4recoilme68.916%
- Cran-May/T.E-8.1cran-may68.537%
- recoilme/recoilme-gemma-2-9B-v0.2recoilme67.627%
- anthracite-org/magnum-v3-27b-ktoanthracite-org66.869%
- recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerprecoilme66.338%
- recoilme/recoilme-gemma-2-9B-v0.3recoilme65.58%
- Orion-zhen/Qwen2.5-7B-Instruct-Uncensoredorion-zhen65.125%
- arcee-ai/SuperNova-Mediusarcee-ai64.898%
- v000000/Qwen2.5-14B-Gutenberg-1e-Deltav00000062.396%
- v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpenov00000061.638%
kornat_harmless · acc_norm,none
openKoLLM · Open Ko-LLM Leaderboard · kornat_harmless · acc_norm,none · percent · Higher is better
ko_gsm8k · exact_match,flexible-extract
openKoLLM · Open Ko-LLM Leaderboard · ko_gsm8k · exact_match,flexible-extract · percent · Higher is better
- AALF/gemma-2-27b-it-SimPO-37K-100stepsaalf78.241%
- AALF/gemma-2-27b-it-SimPO-37Kaalf78.014%
- byroneverson/gemma-2-27b-it-abliteratedbyroneverson78.014%
- tanliboy/lambda-qwen2.5-14b-dpo-testtanliboy77.71%
- nbeerbower/gemma2-gutenberg-27Bnbeerbower77.18%
- v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpenov00000076.346%
- v000000/Qwen2.5-14B-Gutenberg-1e-Deltav00000076.194%
- Qwen/Qwen2.5-14B-Instructqwen75.967%
- v000000/Qwen2.5-Lumen-14Bv00000075.815%
- rombodawg/Rombos-LLM-V2.6-Qwen-14brombodawg75.588%
- Lambent/qwen2.5-reinstruct-alternate-lumen-14Blambent75.36%
- arcee-ai/SuperNova-Mediusarcee-ai75.208%
ko_eqbench · percent_parseable,none
openKoLLM · Open Ko-LLM Leaderboard · ko_eqbench · percent_parseable,none · percent · Higher is better
ko_ifeval · inst_level_loose_acc,none
openKoLLM · Open Ko-LLM Leaderboard · ko_ifeval · inst_level_loose_acc,none · percent · Higher is better
- nbeerbower/gemma2-gutenberg-27Bnbeerbower78.042%
- byroneverson/gemma-2-27b-it-abliteratedbyroneverson77.893%
- recoilme/recoilme-gemma-2-9B-v0.2recoilme75.371%
- arcee-ai/SuperNova-Mediusarcee-ai74.777%
- rombodawg/Rombos-LLM-V2.6-Qwen-14brombodawg74.184%
- tanliboy/lambda-qwen2.5-14b-dpo-testtanliboy73.739%
- UCLA-AGI/Gemma-2-9B-It-SPPO-Iter1ucla-agi73.739%
- v000000/Qwen2.5-Lumen-14Bv00000073.739%
- Lambent/qwen2.5-reinstruct-alternate-lumen-14Blambent73.442%
- v000000/Qwen2.5-14B-Gutenberg-1e-Deltav00000073.442%
- Qwen/Qwen2.5-14B-Instructqwen73.294%
- UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3ucla-agi73.294%
ko_gsm8k · exact_match,flexible-extract
openKoLLM · Open Ko-LLM Leaderboard · ko_gsm8k · exact_match,flexible-extract · percent · Higher is better
Models
LoadingBenchmarks
Explore every benchmark
LoadingThese charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.