GritLM/GritLM-7B-KTO

Explore GritLM/GritLM-7B-KTO: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/GritLM/GritLM-7B-KTO

Specifications & capabilities

Input
text
Output
text
Published model ID
GritLM-7B-KTO

Evaluations

1–20 / 41

Open Ko-LLM Leaderboard

65.367%

source id
openKoLLM
leaderboard name
kornat_harmless · acc_norm,none
dimension
general
metric
kornat_harmless · acc_norm,none
rank
76
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_harmless · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

48.925%

source id
openKoLLM
leaderboard name
kornat_helpful · acc_norm,none
dimension
general
metric
kornat_helpful · acc_norm,none
rank
116
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_helpful · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

84.795%

source id
openKoLLM
leaderboard name
ko_eqbench · percent_parseable,none
dimension
general
metric
ko_eqbench · percent_parseable,none
rank
119
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · percent_parseable,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

32.794%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_strict_acc,none
dimension
general
metric
ko_ifeval · prompt_level_strict_acc,none
rank
137
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

41.098%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_strict_acc,none
dimension
general
metric
ko_ifeval · inst_level_strict_acc,none
rank
142
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

44.214%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_loose_acc,none
dimension
general
metric
ko_ifeval · inst_level_loose_acc,none
rank
148
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

35.223%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_loose_acc,none
dimension
general
metric
ko_ifeval · prompt_level_loose_acc,none
rank
152
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

22.434

source id
openKoLLM
leaderboard name
ko_eqbench · eqbench,none
dimension
general
metric
ko_eqbench · eqbench,none
rank
153
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · eqbench,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

32.996%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_strict_acc,none
dimension
general
metric
ko_ifeval · prompt_level_strict_acc,none
rank
154
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-06-17 02:09:20.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

35.628%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_loose_acc,none
dimension
general
metric
ko_ifeval · prompt_level_loose_acc,none
rank
162
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-06-17 02:09:20.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

43.917%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_loose_acc,none
dimension
general
metric
ko_ifeval · inst_level_loose_acc,none
rank
167
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-06-17 02:09:20.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

40.95%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_strict_acc,none
dimension
general
metric
ko_ifeval · inst_level_strict_acc,none
rank
167
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-06-17 02:09:20.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

14.026%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,strict-match
dimension
general
metric
ko_gsm8k · exact_match,strict-match
rank
169
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,strict-match
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

65.38%

source id
openKoLLM
leaderboard name
kornat_harmless · acc_norm,none
dimension
general
metric
kornat_harmless · acc_norm,none
rank
179
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_harmless · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-06-17 02:09:20.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

21.605%

source id
openKoLLM
leaderboard name
kornat_common · acc_norm,none
dimension
general
metric
kornat_common · acc_norm,none
rank
182
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_common · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

22.214%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,flexible-extract
dimension
general
metric
ko_gsm8k · exact_match,flexible-extract
rank
188
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,flexible-extract
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

56.275%

source id
openKoLLM
leaderboard name
ko_winogrande · acc,none
dimension
general
metric
ko_winogrande · acc,none
rank
189
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_winogrande · acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

43.289%

source id
openKoLLM
leaderboard name
kornat_social · A-SVA,none
dimension
general
metric
kornat_social · A-SVA,none
rank
189
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_social · A-SVA,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

48.85%

source id
openKoLLM
leaderboard name
kornat_helpful · acc_norm,none
dimension
general
metric
kornat_helpful · acc_norm,none
rank
211
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_helpful · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-06-17 02:09:20.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Open Ko-LLM Leaderboard

20.202%

source id
openKoLLM
leaderboard name
ko_gpqa_diamond_zeroshot · acc_norm,none
dimension
general
metric
ko_gpqa_diamond_zeroshot · acc_norm,none
rank
222
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gpqa_diamond_zeroshot · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/GritLM/GritLM-7B-KTO/result_2024-10-10 17:51:09.json
published_at
2025-01-12T22:16:32Z
model_revision
b5c48669508c1de18c698460c187f64e90e7df44
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
GritLM/GritLM-7B-KTO
Original result ↗

Original sources

1–3 / 3

Hugging Face · GritLM/GritLM-7B-KTO ↗

Hugging Face · Catalog ↗

Hugging Face · Catalog ↗

Source links

1–2 / 2

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace