Eurdem/Defne-llama3.1-8B
Explore Eurdem/Defne-llama3.1-8B: model specifications, capabilities, benchmark results, platform pricing and original sources.
huggingface/Eurdem/Defne-llama3.1-8B
Specifications & capabilities
- Input
- text
- Output
- text
- Published model ID
- Defne-llama3.1-8B
Evaluations
1–20 / 41
57.923%
- source id
- openKoLLM
- leaderboard name
- ko_gsm8k · exact_match,strict-match
- dimension
- general
- metric
- ko_gsm8k · exact_match,strict-match
- rank
- 11
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_gsm8k · exact_match,strict-match
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗48.178%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · prompt_level_strict_acc,none
- dimension
- general
- metric
- ko_ifeval · prompt_level_strict_acc,none
- rank
- 12
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · prompt_level_strict_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗55.638%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · inst_level_strict_acc,none
- dimension
- general
- metric
- ko_ifeval · inst_level_strict_acc,none
- rank
- 15
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · inst_level_strict_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗88.889%
- source id
- openKoLLM
- leaderboard name
- ko_eqbench · percent_parseable,none
- dimension
- general
- metric
- ko_eqbench · percent_parseable,none
- rank
- 16
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_eqbench · percent_parseable,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗52.227%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · prompt_level_loose_acc,none
- dimension
- general
- metric
- ko_ifeval · prompt_level_loose_acc,none
- rank
- 22
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · prompt_level_loose_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗88.889%
- source id
- openKoLLM
- leaderboard name
- ko_eqbench · percent_parseable,none
- dimension
- general
- metric
- ko_eqbench · percent_parseable,none
- rank
- 23
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_eqbench · percent_parseable,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗59.496%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · inst_level_loose_acc,none
- dimension
- general
- metric
- ko_ifeval · inst_level_loose_acc,none
- rank
- 28
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · inst_level_loose_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗58.529%
- source id
- openKoLLM
- leaderboard name
- ko_gsm8k · exact_match,flexible-extract
- dimension
- general
- metric
- ko_gsm8k · exact_match,flexible-extract
- rank
- 29
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_gsm8k · exact_match,flexible-extract
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗57.695%
- source id
- openKoLLM
- leaderboard name
- ko_gsm8k · exact_match,strict-match
- dimension
- general
- metric
- ko_gsm8k · exact_match,strict-match
- rank
- 37
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_gsm8k · exact_match,strict-match
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗51.616%
- source id
- openKoLLM
- leaderboard name
- kornat_social · A-SVA,none
- dimension
- general
- metric
- kornat_social · A-SVA,none
- rank
- 39
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- kornat_social · A-SVA,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗51.637%
- source id
- openKoLLM
- leaderboard name
- kornat_social · A-SVA,none
- dimension
- general
- metric
- kornat_social · A-SVA,none
- rank
- 44
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- kornat_social · A-SVA,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗52.227%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · prompt_level_loose_acc,none
- dimension
- general
- metric
- ko_ifeval · prompt_level_loose_acc,none
- rank
- 46
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · prompt_level_loose_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗47.976%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · prompt_level_strict_acc,none
- dimension
- general
- metric
- ko_ifeval · prompt_level_strict_acc,none
- rank
- 48
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · prompt_level_strict_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗55.49%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · inst_level_strict_acc,none
- dimension
- general
- metric
- ko_ifeval · inst_level_strict_acc,none
- rank
- 54
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · inst_level_strict_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗59.347%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · inst_level_loose_acc,none
- dimension
- general
- metric
- ko_ifeval · inst_level_loose_acc,none
- rank
- 55
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · inst_level_loose_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗58.302%
- source id
- openKoLLM
- leaderboard name
- ko_gsm8k · exact_match,flexible-extract
- dimension
- general
- metric
- ko_gsm8k · exact_match,flexible-extract
- rank
- 73
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_gsm8k · exact_match,flexible-extract
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗61.563%
- source id
- openKoLLM
- leaderboard name
- ko_winogrande · acc,none
- dimension
- general
- metric
- ko_winogrande · acc,none
- rank
- 80
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_winogrande · acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗35.568
- source id
- openKoLLM
- leaderboard name
- ko_eqbench · eqbench,none
- dimension
- general
- metric
- ko_eqbench · eqbench,none
- rank
- 89
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_eqbench · eqbench,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-10-01 05:09:18.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗35.895
- source id
- openKoLLM
- leaderboard name
- ko_eqbench · eqbench,none
- dimension
- general
- metric
- ko_eqbench · eqbench,none
- rank
- 92
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_eqbench · eqbench,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗25.866%
- source id
- openKoLLM
- leaderboard name
- kornat_common · acc_norm,none
- dimension
- general
- metric
- kornat_common · acc_norm,none
- rank
- 108
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- kornat_common · acc_norm,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Eurdem/Defne-llama3.1-8B/result_2024-08-13 05:15:48.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- 7832ba3066636bf4dab3e7d658c0b3ded12491ae
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Eurdem/Defne-llama3.1-8B
Original result ↗Safety assessments
1–1 / 1
31 / 100
- source id
- stanfordFMTI
- canonical model id
- huggingface/Eurdem/Defne-llama3.1-8B
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Meta
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 31 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Explore more models