Qwen: Qwen2.5 7B Instruct
Qwen2.5 7B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and…
qwen/qwen-2.5-7b-instruct
Qwen2.5 7B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and...
Specifications & capabilities
- Input
- text
- Output
- text
- Context window · tokens
- 32768
- Published model ID
- Qwen2.5-7B-Instruct
- Capabilities
- structuredOutputs, toolCalling
Evaluations
1–20 / 46
70.178%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · inst_level_loose_acc,none
- dimension
- general
- metric
- ko_ifeval · inst_level_loose_acc,none
- rank
- 3
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · inst_level_loose_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗63.36%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · prompt_level_loose_acc,none
- dimension
- general
- metric
- ko_ifeval · prompt_level_loose_acc,none
- rank
- 3
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · prompt_level_loose_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗60.324%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · prompt_level_strict_acc,none
- dimension
- general
- metric
- ko_ifeval · prompt_level_strict_acc,none
- rank
- 3
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · prompt_level_strict_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗67.656%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · inst_level_strict_acc,none
- dimension
- general
- metric
- ko_ifeval · inst_level_strict_acc,none
- rank
- 4
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · inst_level_strict_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗67.096%
- source id
- openKoLLM
- leaderboard name
- ko_gsm8k · exact_match,flexible-extract
- dimension
- general
- metric
- ko_gsm8k · exact_match,flexible-extract
- rank
- 6
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_gsm8k · exact_match,flexible-extract
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗69.13%
- source id
- openPersianLLM
- leaderboard name
- ARC Challenge
- dimension
- general
- metric
- ARC Challenge
- rank
- 8
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- ARC Challenge
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗36.72%
- source id
- openPersianLLM
- leaderboard name
- Part Multiple Choice
- dimension
- general
- metric
- Part Multiple Choice
- rank
- 8
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- Part Multiple Choice
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗79.02%
- source id
- openPersianLLM
- leaderboard name
- ARC Easy
- dimension
- general
- metric
- ARC Easy
- rank
- 9
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- ARC Easy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗21.96%
- source id
- openPersianLLM
- leaderboard name
- MMLU Pro
- dimension
- general
- metric
- MMLU Pro
- rank
- 13
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- MMLU Pro
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗71.553%
- source id
- openKoLLM
- leaderboard name
- kornat_harmless · acc_norm,none
- dimension
- general
- metric
- kornat_harmless · acc_norm,none
- rank
- 14
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- kornat_harmless · acc_norm,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗52.66%
- source id
- openPersianLLM
- leaderboard name
- AUT Multiple Choice Persian
- dimension
- general
- metric
- AUT Multiple Choice Persian
- rank
- 15
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- AUT Multiple Choice Persian
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗54.075%
- source id
- openKoLLM
- leaderboard name
- kornat_helpful · acc_norm,none
- dimension
- general
- metric
- kornat_helpful · acc_norm,none
- rank
- 19
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- kornat_helpful · acc_norm,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗67.062%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · inst_level_strict_acc,none
- dimension
- general
- metric
- ko_ifeval · inst_level_strict_acc,none
- rank
- 22
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · inst_level_strict_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗47.768
- source id
- openKoLLM
- leaderboard name
- ko_eqbench · eqbench,none
- dimension
- general
- metric
- ko_eqbench · eqbench,none
- rank
- 23
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_eqbench · eqbench,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗70.772%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · inst_level_loose_acc,none
- dimension
- general
- metric
- ko_ifeval · inst_level_loose_acc,none
- rank
- 23
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · inst_level_loose_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗63.563%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · prompt_level_loose_acc,none
- dimension
- general
- metric
- ko_ifeval · prompt_level_loose_acc,none
- rank
- 23
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · prompt_level_loose_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗59.717%
- source id
- openKoLLM
- leaderboard name
- ko_ifeval · prompt_level_strict_acc,none
- dimension
- general
- metric
- ko_ifeval · prompt_level_strict_acc,none
- rank
- 23
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_ifeval · prompt_level_strict_acc,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗68.234%
- source id
- openKoLLM
- leaderboard name
- ko_gsm8k · exact_match,flexible-extract
- dimension
- general
- metric
- ko_gsm8k · exact_match,flexible-extract
- rank
- 31
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_gsm8k · exact_match,flexible-extract
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗49.712
- source id
- openKoLLM
- leaderboard name
- ko_eqbench · eqbench,none
- dimension
- general
- metric
- ko_eqbench · eqbench,none
- rank
- 40
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.bfloat16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- ko_eqbench · eqbench,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 238
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗54.2%
- source id
- openKoLLM
- leaderboard name
- kornat_helpful · acc_norm,none
- dimension
- general
- metric
- kornat_helpful · acc_norm,none
- rank
- 44
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Ko-LLM
- language
- ko
- execution
- model_dtype
- torch.float16
- num_fewshot_seeds
- 1
- override_batch_size
- 1
- num_few_shot_default
- 0
- task_versions
- all
- 2
- ko_gsm8k
- 2
- ko_ifeval
- 2
- ko_eqbench
- 2
- ko_winogrande
- 2
- kornat_common
- 2
- kornat_social
- 2
- kornat_helpful
- 2
- kornat_harmless
- 2
- ko_gpqa_diamond_zeroshot
- 2
- metric_kind
- kornat_helpful · acc_norm,none
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
- published_at
- 2025-01-12T22:16:32Z
- model_revision
- bb46c15ee4bb56c5b63245ef50fd7637234d6f75
- source_revision
- 79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
- metric_population
- 994
- benchmark_evaluation
- true
- source model id
- Qwen/Qwen2.5-7B-Instruct
Original result ↗Published prices
1–4 / 4
$0.04
- Inference provider
- deepInfra
- Platform
- DeepInfra
- Unit
- input_tokens_per_million
- Currency
- USD
$0.10
- Inference provider
- deepInfra
- Platform
- DeepInfra
- Unit
- output_tokens_per_million
- Currency
- USD
$0.05
- Inference provider
- siliconFlow
- Platform
- SiliconFlow
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing label
- Input tokens (per 1M)
$0.05
- Inference provider
- siliconFlow
- Platform
- SiliconFlow
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing label
- Output tokens (per 1M)
Provider specifications & access
1–4 / 4
- source model id
- HuggingFace/qwen-qwen2.5-7b-instruct@1
- hosting
- foundry-managed-compute
- license
- apache-2.0
- source model id
- publishers/hf-qwen/models/qwen2.5-7b-instruct@001
- hosting
- vertex-self-deployed
- source model id
- publishers/qwen/models/qwen2@qwen2.5-7b-instruct
- hosting
- vertex-self-deployed
- source model id
- Qwen/Qwen2.5-7B-Instruct
- hosting
- siliconflow-hosted
- max output tokens
- 4096
- capabilities
- structuredOutputs
- toolCalling
Safety assessments
1–1 / 1
26 / 100
- source id
- stanfordFMTI
- canonical model id
- qwen/qwen-2.5-7b-instruct
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Alibaba
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 26 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–2 / 2
- field
- context_length
- value
- 33K
- scope
- source-model
- source id
- siliconFlow
- confidence
- 1
- field
- max_output_tokens
- value
- 4K
- scope
- source-model
- source id
- siliconFlow
- confidence
- 1
Hugging Face model card
1–1 / 1
- downloads
- 6534638
- likes
- 2496
- pipeline tag
- text-generation
- library name
- transformers
- License
- apache-2.0
Explore more models