BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B

Explore BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B

Specifications & capabilities

Input
text
Output
text
Published model ID
Infinity-Instruct-3M-0625-Yi-1.5-9B

Evaluations

1–20 / 41

Open Ko-LLM Leaderboard

40.762

source id
openKoLLM
leaderboard name
ko_eqbench · eqbench,none
dimension
general
metric
ko_eqbench · eqbench,none
rank
44
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · eqbench,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-07-26 19:29:20.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

26.768%

source id
openKoLLM
leaderboard name
ko_gpqa_diamond_zeroshot · acc_norm,none
dimension
general
metric
ko_gpqa_diamond_zeroshot · acc_norm,none
rank
84
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gpqa_diamond_zeroshot · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-07-26 19:29:20.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

49.525%

source id
openKoLLM
leaderboard name
kornat_helpful · acc_norm,none
dimension
general
metric
kornat_helpful · acc_norm,none
rank
99
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_helpful · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-09-30 19:49:18.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

24.242%

source id
openKoLLM
leaderboard name
ko_gpqa_diamond_zeroshot · acc_norm,none
dimension
general
metric
ko_gpqa_diamond_zeroshot · acc_norm,none
rank
121
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gpqa_diamond_zeroshot · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-09-30 19:49:18.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

63.623%

source id
openKoLLM
leaderboard name
kornat_harmless · acc_norm,none
dimension
general
metric
kornat_harmless · acc_norm,none
rank
124
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_harmless · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-09-30 19:49:18.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

49.925%

source id
openKoLLM
leaderboard name
kornat_helpful · acc_norm,none
dimension
general
metric
kornat_helpful · acc_norm,none
rank
134
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_helpful · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-07-26 19:29:20.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

43.027%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_strict_acc,none
dimension
general
metric
ko_ifeval · inst_level_strict_acc,none
rank
137
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-07-26 19:29:20.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

41.543%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_strict_acc,none
dimension
general
metric
ko_ifeval · inst_level_strict_acc,none
rank
137
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-09-30 19:49:18.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

33.603%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_strict_acc,none
dimension
general
metric
ko_ifeval · prompt_level_strict_acc,none
rank
139
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-07-26 19:29:20.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

45.401%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_loose_acc,none
dimension
general
metric
ko_ifeval · inst_level_loose_acc,none
rank
147
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-07-26 19:29:20.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

31.377%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_strict_acc,none
dimension
general
metric
ko_ifeval · prompt_level_strict_acc,none
rank
151
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-09-30 19:49:18.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

44.065%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_loose_acc,none
dimension
general
metric
ko_ifeval · inst_level_loose_acc,none
rank
153
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-09-30 19:49:18.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

35.83%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_loose_acc,none
dimension
general
metric
ko_ifeval · prompt_level_loose_acc,none
rank
157
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-07-26 19:29:20.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

33.603%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_loose_acc,none
dimension
general
metric
ko_ifeval · prompt_level_loose_acc,none
rank
169
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-09-30 19:49:18.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

25.474%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,flexible-extract
dimension
general
metric
ko_gsm8k · exact_match,flexible-extract
rank
175
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,flexible-extract
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-09-30 19:49:18.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

21.505%

source id
openKoLLM
leaderboard name
kornat_common · acc_norm,none
dimension
general
metric
kornat_common · acc_norm,none
rank
183
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_common · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-09-30 19:49:18.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

56.748%

source id
openKoLLM
leaderboard name
ko_winogrande · acc,none
dimension
general
metric
ko_winogrande · acc,none
rank
184
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_winogrande · acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-09-30 19:49:18.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

41.335%

source id
openKoLLM
leaderboard name
kornat_social · A-SVA,none
dimension
general
metric
kornat_social · A-SVA,none
rank
199
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_social · A-SVA,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-09-30 19:49:18.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

0

source id
openKoLLM
leaderboard name
ko_eqbench · eqbench,none
dimension
general
metric
ko_eqbench · eqbench,none
rank
206
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · eqbench,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-09-30 19:49:18.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Open Ko-LLM Leaderboard

0%

source id
openKoLLM
leaderboard name
ko_eqbench · percent_parseable,none
dimension
general
metric
ko_eqbench · percent_parseable,none
rank
208
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · percent_parseable,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B/result_2024-09-30 19:49:18.json
published_at
2025-01-12T22:16:32Z
model_revision
a42c86c61b98ca4fdf238d688fe6ea11cf414d29
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
Original result ↗

Original sources

1–3 / 3

Hugging Face · BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B ↗

Hugging Face · Catalog ↗

Hugging Face · Catalog ↗

Source links

1–2 / 2

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace