Qwen: Qwen2.5 7B Instruct

Qwen2.5 7B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and…

qwen/qwen-2.5-7b-instruct

Qwen2.5 7B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and...

Specifications & capabilities

Input
text
Output
text
Context window · tokens
32768
Published model ID
Qwen2.5-7B-Instruct
Capabilities
structuredOutputs, toolCalling

Evaluations

21–40 / 46

Open Ko-LLM Leaderboard

30.493%

source id
openKoLLM
leaderboard name
kornat_common · acc_norm,none
dimension
general
metric
kornat_common · acc_norm,none
rank
57
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_common · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
published_at
2025-01-12T22:16:32Z
model_revision
bb46c15ee4bb56c5b63245ef50fd7637234d6f75
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-7B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

71.557%

source id
openKoLLM
leaderboard name
kornat_harmless · acc_norm,none
dimension
general
metric
kornat_harmless · acc_norm,none
rank
59
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_harmless · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
published_at
2025-01-12T22:16:32Z
model_revision
bb46c15ee4bb56c5b63245ef50fd7637234d6f75
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-7B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

33.813%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,strict-match
dimension
general
metric
ko_gsm8k · exact_match,strict-match
rank
108
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,strict-match
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
published_at
2025-01-12T22:16:32Z
model_revision
bb46c15ee4bb56c5b63245ef50fd7637234d6f75
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-7B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

60.379%

source id
openKoLLM
leaderboard name
ko_winogrande · acc,none
dimension
general
metric
ko_winogrande · acc,none
rank
122
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_winogrande · acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
published_at
2025-01-12T22:16:32Z
model_revision
bb46c15ee4bb56c5b63245ef50fd7637234d6f75
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-7B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

83.626%

source id
openKoLLM
leaderboard name
ko_eqbench · percent_parseable,none
dimension
general
metric
ko_eqbench · percent_parseable,none
rank
123
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · percent_parseable,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
published_at
2025-01-12T22:16:32Z
model_revision
bb46c15ee4bb56c5b63245ef50fd7637234d6f75
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-7B-Instruct
Original result ↗

Open LLM Leaderboard v2

50%

source id
openLLMLeaderboardV2
leaderboard name
Open LLM v2 MATH Lvl 5 · Raw
dimension
math
metric
Raw accuracy
rank
136
aggregation scope
suite
Open LLM v2
co2_kg
3.2405911036770783
status
archived
precision
bfloat16
task_count
6
metric_kind
Raw accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2025-03-20T12:17:27Z
chat_template
true
suite_version
2
model_revision
52e20a6f5f475e5c8f6a8ebda4ae5fa6b1ea22ac
source_flagged
false
missing_metrics
    dataset_revision
    9c09a7cae43334062a82cb164f2ef255013dafa2
    metric_population
    4576
    ranking_population
    4576
    source_flag_anomaly
    false
    source model id
    Qwen/Qwen2.5-7B-Instruct
    Original result ↗

    Open LLM Leaderboard v2

    50%

    source id
    openLLMLeaderboardV2
    leaderboard name
    Open LLM v2 MATH Lvl 5 · Normalized
    dimension
    math
    metric
    Normalized score
    rank
    136
    aggregation scope
    suite
    Open LLM v2
    co2_kg
    3.2405911036770783
    status
    archived
    precision
    bfloat16
    task_count
    6
    metric_kind
    Normalized score
    rank_method
    Derived competition rank over published evaluations with reported scores, including variants and source flags
    weight_type
    Original
    published_at
    2025-03-20T12:17:27Z
    chat_template
    true
    suite_version
    2
    model_revision
    52e20a6f5f475e5c8f6a8ebda4ae5fa6b1ea22ac
    source_flagged
    false
    missing_metrics
      dataset_revision
      9c09a7cae43334062a82cb164f2ef255013dafa2
      metric_population
      4576
      ranking_population
      4576
      source_flag_anomaly
      false
      source model id
      Qwen/Qwen2.5-7B-Instruct
      Original result ↗

      Open Ko-LLM Leaderboard

      30.376%

      source id
      openKoLLM
      leaderboard name
      kornat_common · acc_norm,none
      dimension
      general
      metric
      kornat_common · acc_norm,none
      rank
      147
      aggregation scope
      status
      published
      direction
      higherIsBetter
      conditions
      suite
      Open Ko-LLM
      language
      ko
      execution
      model_dtype
      torch.float16
      num_fewshot_seeds
      1
      override_batch_size
      1
      num_few_shot_default
      0
      task_versions
      all
      2
      ko_gsm8k
      2
      ko_ifeval
      2
      ko_eqbench
      2
      ko_winogrande
      2
      kornat_common
      2
      kornat_social
      2
      kornat_helpful
      2
      kornat_harmless
      2
      ko_gpqa_diamond_zeroshot
      2
      metric_kind
      kornat_common · acc_norm,none
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
      published_at
      2025-01-12T22:16:32Z
      model_revision
      bb46c15ee4bb56c5b63245ef50fd7637234d6f75
      source_revision
      79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
      metric_population
      994
      benchmark_evaluation
      true
      source model id
      Qwen/Qwen2.5-7B-Instruct
      Original result ↗

      Open Ko-LLM Leaderboard

      33.283%

      source id
      openKoLLM
      leaderboard name
      ko_gsm8k · exact_match,strict-match
      dimension
      general
      metric
      ko_gsm8k · exact_match,strict-match
      rank
      151
      aggregation scope
      status
      published
      direction
      higherIsBetter
      conditions
      suite
      Open Ko-LLM
      language
      ko
      execution
      model_dtype
      torch.float16
      num_fewshot_seeds
      1
      override_batch_size
      1
      num_few_shot_default
      0
      task_versions
      all
      2
      ko_gsm8k
      2
      ko_ifeval
      2
      ko_eqbench
      2
      ko_winogrande
      2
      kornat_common
      2
      kornat_social
      2
      kornat_helpful
      2
      kornat_harmless
      2
      ko_gpqa_diamond_zeroshot
      2
      metric_kind
      ko_gsm8k · exact_match,strict-match
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
      published_at
      2025-01-12T22:16:32Z
      model_revision
      bb46c15ee4bb56c5b63245ef50fd7637234d6f75
      source_revision
      79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
      metric_population
      994
      benchmark_evaluation
      true
      source model id
      Qwen/Qwen2.5-7B-Instruct
      Original result ↗

      Open Ko-LLM Leaderboard

      37.55%

      source id
      openKoLLM
      leaderboard name
      kornat_social · A-SVA,none
      dimension
      general
      metric
      kornat_social · A-SVA,none
      rank
      215
      aggregation scope
      status
      published
      direction
      higherIsBetter
      conditions
      suite
      Open Ko-LLM
      language
      ko
      execution
      model_dtype
      torch.bfloat16
      num_fewshot_seeds
      1
      override_batch_size
      1
      num_few_shot_default
      0
      task_versions
      all
      2
      ko_gsm8k
      2
      ko_ifeval
      2
      ko_eqbench
      2
      ko_winogrande
      2
      kornat_common
      2
      kornat_social
      2
      kornat_helpful
      2
      kornat_harmless
      2
      ko_gpqa_diamond_zeroshot
      2
      metric_kind
      kornat_social · A-SVA,none
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
      published_at
      2025-01-12T22:16:32Z
      model_revision
      bb46c15ee4bb56c5b63245ef50fd7637234d6f75
      source_revision
      79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
      metric_population
      238
      benchmark_evaluation
      true
      source model id
      Qwen/Qwen2.5-7B-Instruct
      Original result ↗

      Open Ko-LLM Leaderboard

      19.697%

      source id
      openKoLLM
      leaderboard name
      ko_gpqa_diamond_zeroshot · acc_norm,none
      dimension
      general
      metric
      ko_gpqa_diamond_zeroshot · acc_norm,none
      rank
      226
      aggregation scope
      status
      published
      direction
      higherIsBetter
      conditions
      suite
      Open Ko-LLM
      language
      ko
      execution
      model_dtype
      torch.bfloat16
      num_fewshot_seeds
      1
      override_batch_size
      1
      num_few_shot_default
      0
      task_versions
      all
      2
      ko_gsm8k
      2
      ko_ifeval
      2
      ko_eqbench
      2
      ko_winogrande
      2
      kornat_common
      2
      kornat_social
      2
      kornat_helpful
      2
      kornat_harmless
      2
      ko_gpqa_diamond_zeroshot
      2
      metric_kind
      ko_gpqa_diamond_zeroshot · acc_norm,none
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-30 18:05:04.json
      published_at
      2025-01-12T22:16:32Z
      model_revision
      bb46c15ee4bb56c5b63245ef50fd7637234d6f75
      source_revision
      79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
      metric_population
      238
      benchmark_evaluation
      true
      source model id
      Qwen/Qwen2.5-7B-Instruct
      Original result ↗

      Open Ko-LLM Leaderboard

      81.287%

      source id
      openKoLLM
      leaderboard name
      ko_eqbench · percent_parseable,none
      dimension
      general
      metric
      ko_eqbench · percent_parseable,none
      rank
      261
      aggregation scope
      status
      published
      direction
      higherIsBetter
      conditions
      suite
      Open Ko-LLM
      language
      ko
      execution
      model_dtype
      torch.float16
      num_fewshot_seeds
      1
      override_batch_size
      1
      num_few_shot_default
      0
      task_versions
      all
      2
      ko_gsm8k
      2
      ko_ifeval
      2
      ko_eqbench
      2
      ko_winogrande
      2
      kornat_common
      2
      kornat_social
      2
      kornat_helpful
      2
      kornat_harmless
      2
      ko_gpqa_diamond_zeroshot
      2
      metric_kind
      ko_eqbench · percent_parseable,none
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
      published_at
      2025-01-12T22:16:32Z
      model_revision
      bb46c15ee4bb56c5b63245ef50fd7637234d6f75
      source_revision
      79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
      metric_population
      994
      benchmark_evaluation
      true
      source model id
      Qwen/Qwen2.5-7B-Instruct
      Original result ↗

      Open LLM Leaderboard v2

      75.853%

      source id
      openLLMLeaderboardV2
      leaderboard name
      Open LLM v2 IFEval · Normalized
      dimension
      instructionFollowing
      metric
      Normalized score
      rank
      394
      aggregation scope
      suite
      Open LLM v2
      co2_kg
      3.2405911036770783
      status
      archived
      precision
      bfloat16
      task_count
      6
      metric_kind
      Normalized score
      rank_method
      Derived competition rank over published evaluations with reported scores, including variants and source flags
      weight_type
      Original
      published_at
      2025-03-20T12:17:27Z
      chat_template
      true
      suite_version
      2
      model_revision
      52e20a6f5f475e5c8f6a8ebda4ae5fa6b1ea22ac
      source_flagged
      false
      missing_metrics
        dataset_revision
        9c09a7cae43334062a82cb164f2ef255013dafa2
        metric_population
        4576
        ranking_population
        4576
        source_flag_anomaly
        false
        source model id
        Qwen/Qwen2.5-7B-Instruct
        Original result ↗

        Open LLM Leaderboard v2

        75.853%

        source id
        openLLMLeaderboardV2
        leaderboard name
        Open LLM v2 IFEval · Raw
        dimension
        instructionFollowing
        metric
        Raw accuracy
        rank
        394
        aggregation scope
        suite
        Open LLM v2
        co2_kg
        3.2405911036770783
        status
        archived
        precision
        bfloat16
        task_count
        6
        metric_kind
        Raw accuracy
        rank_method
        Derived competition rank over published evaluations with reported scores, including variants and source flags
        weight_type
        Original
        published_at
        2025-03-20T12:17:27Z
        chat_template
        true
        suite_version
        2
        model_revision
        52e20a6f5f475e5c8f6a8ebda4ae5fa6b1ea22ac
        source_flagged
        false
        missing_metrics
          dataset_revision
          9c09a7cae43334062a82cb164f2ef255013dafa2
          metric_population
          4576
          ranking_population
          4576
          source_flag_anomaly
          false
          source model id
          Qwen/Qwen2.5-7B-Instruct
          Original result ↗

          Open Ko-LLM Leaderboard

          60.537%

          source id
          openKoLLM
          leaderboard name
          ko_winogrande · acc,none
          dimension
          general
          metric
          ko_winogrande · acc,none
          rank
          425
          aggregation scope
          status
          published
          direction
          higherIsBetter
          conditions
          suite
          Open Ko-LLM
          language
          ko
          execution
          model_dtype
          torch.float16
          num_fewshot_seeds
          1
          override_batch_size
          1
          num_few_shot_default
          0
          task_versions
          all
          2
          ko_gsm8k
          2
          ko_ifeval
          2
          ko_eqbench
          2
          ko_winogrande
          2
          kornat_common
          2
          kornat_social
          2
          kornat_helpful
          2
          kornat_harmless
          2
          ko_gpqa_diamond_zeroshot
          2
          metric_kind
          ko_winogrande · acc,none
          rank_method
          competition rank among reported evaluations in identical conditions, including unlinked observations
          source_file
          open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
          published_at
          2025-01-12T22:16:32Z
          model_revision
          bb46c15ee4bb56c5b63245ef50fd7637234d6f75
          source_revision
          79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
          metric_population
          994
          benchmark_evaluation
          true
          source model id
          Qwen/Qwen2.5-7B-Instruct
          Original result ↗

          Open LLM Leaderboard v2

          35.2%

          source id
          openLLMLeaderboardV2
          leaderboard name
          Open LLM v2 Average
          dimension
          general
          metric
          Normalized six-task average
          rank
          623
          aggregation scope
          suite
          Open LLM v2
          co2_kg
          3.2405911036770783
          status
          archived
          precision
          bfloat16
          task_count
          6
          metric_kind
          Normalized six-task average
          rank_method
          Derived competition rank over published evaluations with reported scores, including variants and source flags
          weight_type
          Original
          published_at
          2025-03-20T12:17:27Z
          chat_template
          true
          suite_version
          2
          model_revision
          52e20a6f5f475e5c8f6a8ebda4ae5fa6b1ea22ac
          source_flagged
          false
          missing_metrics
            dataset_revision
            9c09a7cae43334062a82cb164f2ef255013dafa2
            metric_population
            4576
            ranking_population
            4576
            source_flag_anomaly
            false
            source model id
            Qwen/Qwen2.5-7B-Instruct
            Original result ↗

            Open Ko-LLM Leaderboard

            21.717%

            source id
            openKoLLM
            leaderboard name
            ko_gpqa_diamond_zeroshot · acc_norm,none
            dimension
            general
            metric
            ko_gpqa_diamond_zeroshot · acc_norm,none
            rank
            642
            aggregation scope
            status
            published
            direction
            higherIsBetter
            conditions
            suite
            Open Ko-LLM
            language
            ko
            execution
            model_dtype
            torch.float16
            num_fewshot_seeds
            1
            override_batch_size
            1
            num_few_shot_default
            0
            task_versions
            all
            2
            ko_gsm8k
            2
            ko_ifeval
            2
            ko_eqbench
            2
            ko_winogrande
            2
            kornat_common
            2
            kornat_social
            2
            kornat_helpful
            2
            kornat_harmless
            2
            ko_gpqa_diamond_zeroshot
            2
            metric_kind
            ko_gpqa_diamond_zeroshot · acc_norm,none
            rank_method
            competition rank among reported evaluations in identical conditions, including unlinked observations
            source_file
            open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
            published_at
            2025-01-12T22:16:32Z
            model_revision
            bb46c15ee4bb56c5b63245ef50fd7637234d6f75
            source_revision
            79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
            metric_population
            994
            benchmark_evaluation
            true
            source model id
            Qwen/Qwen2.5-7B-Instruct
            Original result ↗

            Open Ko-LLM Leaderboard

            37.782%

            source id
            openKoLLM
            leaderboard name
            kornat_social · A-SVA,none
            dimension
            general
            metric
            kornat_social · A-SVA,none
            rank
            865
            aggregation scope
            status
            published
            direction
            higherIsBetter
            conditions
            suite
            Open Ko-LLM
            language
            ko
            execution
            model_dtype
            torch.float16
            num_fewshot_seeds
            1
            override_batch_size
            1
            num_few_shot_default
            0
            task_versions
            all
            2
            ko_gsm8k
            2
            ko_ifeval
            2
            ko_eqbench
            2
            ko_winogrande
            2
            kornat_common
            2
            kornat_social
            2
            kornat_helpful
            2
            kornat_harmless
            2
            ko_gpqa_diamond_zeroshot
            2
            metric_kind
            kornat_social · A-SVA,none
            rank_method
            competition rank among reported evaluations in identical conditions, including unlinked observations
            source_file
            open-ko-llm-leaderboard/results/Qwen/Qwen2.5-7B-Instruct/result_2024-09-28 02:12:45.json
            published_at
            2025-01-12T22:16:32Z
            model_revision
            bb46c15ee4bb56c5b63245ef50fd7637234d6f75
            source_revision
            79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
            metric_population
            994
            benchmark_evaluation
            true
            source model id
            Qwen/Qwen2.5-7B-Instruct
            Original result ↗

            Open LLM Leaderboard v2

            42.869%

            source id
            openLLMLeaderboardV2
            leaderboard name
            Open LLM v2 MMLU-PRO · Raw
            dimension
            knowledge
            metric
            Raw accuracy
            rank
            1017
            aggregation scope
            suite
            Open LLM v2
            co2_kg
            3.2405911036770783
            status
            archived
            precision
            bfloat16
            task_count
            6
            metric_kind
            Raw accuracy
            rank_method
            Derived competition rank over published evaluations with reported scores, including variants and source flags
            weight_type
            Original
            published_at
            2025-03-20T12:17:27Z
            chat_template
            true
            suite_version
            2
            model_revision
            52e20a6f5f475e5c8f6a8ebda4ae5fa6b1ea22ac
            source_flagged
            false
            missing_metrics
              dataset_revision
              9c09a7cae43334062a82cb164f2ef255013dafa2
              metric_population
              4576
              ranking_population
              4576
              source_flag_anomaly
              false
              source model id
              Qwen/Qwen2.5-7B-Instruct
              Original result ↗

              Open LLM Leaderboard v2

              36.521%

              source id
              openLLMLeaderboardV2
              leaderboard name
              Open LLM v2 MMLU-PRO · Normalized
              dimension
              knowledge
              metric
              Normalized score
              rank
              1017
              aggregation scope
              suite
              Open LLM v2
              co2_kg
              3.2405911036770783
              status
              archived
              precision
              bfloat16
              task_count
              6
              metric_kind
              Normalized score
              rank_method
              Derived competition rank over published evaluations with reported scores, including variants and source flags
              weight_type
              Original
              published_at
              2025-03-20T12:17:27Z
              chat_template
              true
              suite_version
              2
              model_revision
              52e20a6f5f475e5c8f6a8ebda4ae5fa6b1ea22ac
              source_flagged
              false
              missing_metrics
                dataset_revision
                9c09a7cae43334062a82cb164f2ef255013dafa2
                metric_population
                4576
                ranking_population
                4576
                source_flag_anomaly
                false
                source model id
                Qwen/Qwen2.5-7B-Instruct
                Original result ↗

                Published prices

                1–4 / 4

                Qwen/Qwen2.5-7B-Instruct ↗

                $0.05

                Inference provider
                siliconFlow
                Platform
                SiliconFlow
                Unit
                input_tokens_per_million
                Currency
                USD
                Billing conditions
                Billing label
                Input tokens (per 1M)

                Qwen/Qwen2.5-7B-Instruct ↗

                $0.05

                Inference provider
                siliconFlow
                Platform
                SiliconFlow
                Unit
                output_tokens_per_million
                Currency
                USD
                Billing conditions
                Billing label
                Output tokens (per 1M)

                Provider specifications & access

                1–4 / 4

                Qwen/Qwen2.5-7B-Instruct ↗

                source model id
                HuggingFace/qwen-qwen2.5-7b-instruct@1
                hosting
                foundry-managed-compute
                platforms
                • Microsoft Foundry
                license
                apache-2.0
                architecture
                input_modalities
                • text
                output_modalities
                • text
                capabilities

                  Qwen/Qwen2.5-7B-Instruct ↗

                  source model id
                  publishers/hf-qwen/models/qwen2.5-7b-instruct@001
                  hosting
                  vertex-self-deployed
                  platforms
                  • Google Cloud Vertex AI
                  architecture
                  input_modalities
                  • text
                  output_modalities
                  • text
                  capabilities

                    Qwen2.5-7B-Instruct ↗

                    source model id
                    publishers/qwen/models/qwen2@qwen2.5-7b-instruct
                    hosting
                    vertex-self-deployed
                    platforms
                    • Google Cloud Vertex AI
                    architecture
                    input_modalities
                    • text
                    output_modalities
                    • text
                    capabilities

                      Qwen2.5-7B-Instruct ↗

                      source model id
                      Qwen/Qwen2.5-7B-Instruct
                      hosting
                      siliconflow-hosted
                      platforms
                      • SiliconFlow
                      max output tokens
                      4096
                      architecture
                      input_modalities
                      • text
                      output_modalities
                      • text
                      capabilities
                      • structuredOutputs
                      • toolCalling

                      Safety assessments

                      1–1 / 1

                      Foundation Model Transparency Index 2025 ↗

                      26 / 100

                      source id
                      stanfordFMTI
                      canonical model id
                      qwen/qwen-2.5-7b-instruct
                      taxonomy
                      transparency
                      hazard category
                      transparency
                      hazard name
                      Organization transparency
                      policy area
                      Alibaba
                      assessment type
                      organization-level disclosure
                      metric
                      disclosure_score
                      result label
                      26 / 100
                      sample size
                      100
                      updated at
                      2026-11-09T18:08:05.227Z

                      Source specification observations

                      1–2 / 2

                      siliconFlow ↗

                      field
                      context_length
                      value
                      33K
                      scope
                      source-model
                      source id
                      siliconFlow
                      confidence
                      1

                      siliconFlow ↗

                      field
                      max_output_tokens
                      value
                      4K
                      scope
                      source-model
                      source id
                      siliconFlow
                      confidence
                      1

                      Original sources

                      1–20 / 22

                      SiliconFlow · Model page ↗

                      Hugging Face · Model repository ↗

                      DeepInfra · Model page ↗

                      Google Cloud · Model page ↗

                      Google Cloud · Model page ↗

                      Microsoft Foundry · Model page ↗

                      SiliconFlow · Playground ↗

                      Google Cloud · Model documentation ↗

                      Microsoft Foundry · Model documentation ↗

                      SiliconFlow · API documentation ↗

                      arXiv · Paper · 2309.00071 ↗

                      arXiv · Paper · 2407.10671 ↗

                      DeepInfra · Catalog ↗

                      GitHub · Catalog ↗

                      GitHub · Catalog ↗

                      Google Cloud · Catalog ↗

                      Hugging Face · Catalog ↗

                      Hugging Face · Catalog ↗

                      Hugging Face · Catalog ↗

                      Hugging Face · Catalog ↗

                      Source links

                      1–10 / 10

                      Hugging Face model card

                      1–1 / 1

                      Explore more models

                      Models

                      Loading
                      EVIDENCE / COMPARISON

                      Benchmarks

                      Explore every benchmark

                      Loading

                      These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

                      Install TensorTrace