CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct

Explore CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct

Specifications & capabilities

Input
text
Output
text
Published model ID
Llama-3.2-Rabbit-Ko-3B-Instruct

Evaluations

1–20 / 41

Open Ko-LLM Leaderboard

36.619%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,strict-match
dimension
general
metric
ko_gsm8k · exact_match,strict-match
rank
116
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,strict-match
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:44.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

36.619%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,strict-match
dimension
general
metric
ko_gsm8k · exact_match,strict-match
rank
116
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,strict-match
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:05.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

31.935

source id
openKoLLM
leaderboard name
ko_eqbench · eqbench,none
dimension
general
metric
ko_eqbench · eqbench,none
rank
128
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · eqbench,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:44.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

31.935

source id
openKoLLM
leaderboard name
ko_eqbench · eqbench,none
dimension
general
metric
ko_eqbench · eqbench,none
rank
128
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · eqbench,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:05.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

40.182%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,flexible-extract
dimension
general
metric
ko_gsm8k · exact_match,flexible-extract
rank
185
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,flexible-extract
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:44.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

40.182%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,flexible-extract
dimension
general
metric
ko_gsm8k · exact_match,flexible-extract
rank
185
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,flexible-extract
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:05.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

37.982%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_strict_acc,none
dimension
general
metric
ko_ifeval · inst_level_strict_acc,none
rank
238
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:44.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

37.982%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_strict_acc,none
dimension
general
metric
ko_ifeval · inst_level_strict_acc,none
rank
238
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:05.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

40.356%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_loose_acc,none
dimension
general
metric
ko_ifeval · inst_level_loose_acc,none
rank
255
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:05.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

40.356%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_loose_acc,none
dimension
general
metric
ko_ifeval · inst_level_loose_acc,none
rank
255
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:44.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

28.947%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_strict_acc,none
dimension
general
metric
ko_ifeval · prompt_level_strict_acc,none
rank
266
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:05.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

28.947%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_strict_acc,none
dimension
general
metric
ko_ifeval · prompt_level_strict_acc,none
rank
266
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:44.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

31.579%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_loose_acc,none
dimension
general
metric
ko_ifeval · prompt_level_loose_acc,none
rank
268
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:44.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

31.579%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_loose_acc,none
dimension
general
metric
ko_ifeval · prompt_level_loose_acc,none
rank
268
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:05.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

73.684%

source id
openKoLLM
leaderboard name
ko_eqbench · percent_parseable,none
dimension
general
metric
ko_eqbench · percent_parseable,none
rank
303
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · percent_parseable,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:44.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

73.684%

source id
openKoLLM
leaderboard name
ko_eqbench · percent_parseable,none
dimension
general
metric
ko_eqbench · percent_parseable,none
rank
303
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · percent_parseable,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:05.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

22.403%

source id
openKoLLM
leaderboard name
kornat_common · acc_norm,none
dimension
general
metric
kornat_common · acc_norm,none
rank
581
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_common · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:44.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

22.403%

source id
openKoLLM
leaderboard name
kornat_common · acc_norm,none
dimension
general
metric
kornat_common · acc_norm,none
rank
581
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_common · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:05.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

21.717%

source id
openKoLLM
leaderboard name
ko_gpqa_diamond_zeroshot · acc_norm,none
dimension
general
metric
ko_gpqa_diamond_zeroshot · acc_norm,none
rank
642
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gpqa_diamond_zeroshot · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:05.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

21.717%

source id
openKoLLM
leaderboard name
ko_gpqa_diamond_zeroshot · acc_norm,none
dimension
general
metric
ko_gpqa_diamond_zeroshot · acc_norm,none
rank
642
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gpqa_diamond_zeroshot · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct/result_2024-11-14 06:38:44.json
published_at
2025-01-12T22:16:32Z
model_revision
5be46c768d800447b82de41fdc9df2f8c43ba3c0
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
Original result ↗

Safety assessments

1–1 / 1

Foundation Model Transparency Index 2025 ↗

31 / 100

source id
stanfordFMTI
canonical model id
huggingface/CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct
taxonomy
transparency
hazard category
transparency
hazard name
Organization transparency
policy area
Meta
assessment type
organization-level disclosure
metric
disclosure_score
result label
31 / 100
sample size
100
updated at
2026-11-09T18:08:05.227Z

Original sources

1–4 / 4

Hugging Face · CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct ↗

GitHub · Catalog ↗

Hugging Face · Catalog ↗

Hugging Face · Catalog ↗

Source links

1–3 / 3

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace