Eurdem/Defne-llama3.1-8B

Explore Eurdem/Defne-llama3.1-8B: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/Eurdem/Defne-llama3.1-8B

Specifications & capabilities

Input
text
Output
text
Published model ID
Defne-llama3.1-8B

Evaluations

1–20 / 41

Open Ko-LLM Leaderboard

57.923%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,strict-match
dimension
general
metric
ko_gsm8k · exact_match,strict-match
rank
11
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,strict-match
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

48.178%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_strict_acc,none
dimension
general
metric
ko_ifeval · prompt_level_strict_acc,none
rank
12
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

55.638%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_strict_acc,none
dimension
general
metric
ko_ifeval · inst_level_strict_acc,none
rank
15
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

88.889%

source id
openKoLLM
leaderboard name
ko_eqbench · percent_parseable,none
dimension
general
metric
ko_eqbench · percent_parseable,none
rank
16
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · percent_parseable,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

52.227%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_loose_acc,none
dimension
general
metric
ko_ifeval · prompt_level_loose_acc,none
rank
22
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

88.889%

source id
openKoLLM
leaderboard name
ko_eqbench · percent_parseable,none
dimension
general
metric
ko_eqbench · percent_parseable,none
rank
23
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · percent_parseable,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

59.496%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_loose_acc,none
dimension
general
metric
ko_ifeval · inst_level_loose_acc,none
rank
28
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

58.529%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,flexible-extract
dimension
general
metric
ko_gsm8k · exact_match,flexible-extract
rank
29
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,flexible-extract
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

57.695%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,strict-match
dimension
general
metric
ko_gsm8k · exact_match,strict-match
rank
37
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,strict-match
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

51.616%

source id
openKoLLM
leaderboard name
kornat_social · A-SVA,none
dimension
general
metric
kornat_social · A-SVA,none
rank
39
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_social · A-SVA,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

51.637%

source id
openKoLLM
leaderboard name
kornat_social · A-SVA,none
dimension
general
metric
kornat_social · A-SVA,none
rank
44
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_social · A-SVA,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

52.227%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_loose_acc,none
dimension
general
metric
ko_ifeval · prompt_level_loose_acc,none
rank
46
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

47.976%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_strict_acc,none
dimension
general
metric
ko_ifeval · prompt_level_strict_acc,none
rank
48
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

55.49%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_strict_acc,none
dimension
general
metric
ko_ifeval · inst_level_strict_acc,none
rank
54
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

59.347%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_loose_acc,none
dimension
general
metric
ko_ifeval · inst_level_loose_acc,none
rank
55
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

58.302%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,flexible-extract
dimension
general
metric
ko_gsm8k · exact_match,flexible-extract
rank
73
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,flexible-extract
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

61.563%

source id
openKoLLM
leaderboard name
ko_winogrande · acc,none
dimension
general
metric
ko_winogrande · acc,none
rank
80
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_winogrande · acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

35.568

source id
openKoLLM
leaderboard name
ko_eqbench · eqbench,none
dimension
general
metric
ko_eqbench · eqbench,none
rank
89
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · eqbench,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

35.895

source id
openKoLLM
leaderboard name
ko_eqbench · eqbench,none
dimension
general
metric
ko_eqbench · eqbench,none
rank
92
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · eqbench,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Open Ko-LLM Leaderboard

25.866%

source id
openKoLLM
leaderboard name
kornat_common · acc_norm,none
dimension
general
metric
kornat_common · acc_norm,none
rank
108
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_common · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
published_at
2025-01-12T22:16:32Z
model_revision
7832ba3066636bf4dab3e7d658c0b3ded12491ae
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Eurdem/Defne-llama3.1-8B
Original result ↗

Safety assessments

1–1 / 1

Foundation Model Transparency Index 2025 ↗

31 / 100

source id
stanfordFMTI
canonical model id
huggingface/Eurdem/Defne-llama3.1-8B
taxonomy
transparency
hazard category
transparency
hazard name
Organization transparency
policy area
Meta
assessment type
organization-level disclosure
metric
disclosure_score
result label
31 / 100
sample size
100
updated at
2026-11-09T18:08:05.227Z

Original sources

1–4 / 4

Hugging Face · Eurdem/Defne-llama3.1-8B ↗

GitHub · Catalog ↗

Hugging Face · Catalog ↗

Hugging Face · Catalog ↗

Source links

1–3 / 3

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace