Qwen/Qwen2.5-14B-Instruct

Explore Qwen/Qwen2.5-14B-Instruct: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/Qwen/Qwen2.5-14B-Instruct

Specifications & capabilities

Published model ID
Qwen2.5-14B-Instruct
Capabilities
structuredOutputs, toolCalling

Evaluations

1–20 / 27

Open Ko-LLM Leaderboard

60.65%

source id
openKoLLM
leaderboard name
kornat_helpful · acc_norm,none
dimension
general
metric
kornat_helpful · acc_norm,none
rank
3
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_helpful · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
published_at
2025-01-12T22:16:32Z
model_revision
cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-14B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

39.564%

source id
openKoLLM
leaderboard name
kornat_common · acc_norm,none
dimension
general
metric
kornat_common · acc_norm,none
rank
7
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_common · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
published_at
2025-01-12T22:16:32Z
model_revision
cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-14B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

72.993%

source id
openKoLLM
leaderboard name
kornat_harmless · acc_norm,none
dimension
general
metric
kornat_harmless · acc_norm,none
rank
8
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_harmless · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
published_at
2025-01-12T22:16:32Z
model_revision
cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-14B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

75.967%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,flexible-extract
dimension
general
metric
ko_gsm8k · exact_match,flexible-extract
rank
10
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,flexible-extract
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
published_at
2025-01-12T22:16:32Z
model_revision
cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-14B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

66.397%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_loose_acc,none
dimension
general
metric
ko_ifeval · prompt_level_loose_acc,none
rank
12
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
published_at
2025-01-12T22:16:32Z
model_revision
cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-14B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

73.294%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_loose_acc,none
dimension
general
metric
ko_ifeval · inst_level_loose_acc,none
rank
13
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
published_at
2025-01-12T22:16:32Z
model_revision
cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-14B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

63.36%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_strict_acc,none
dimension
general
metric
ko_ifeval · prompt_level_strict_acc,none
rank
13
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
published_at
2025-01-12T22:16:32Z
model_revision
cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-14B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

70.623%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_strict_acc,none
dimension
general
metric
ko_ifeval · inst_level_strict_acc,none
rank
14
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
published_at
2025-01-12T22:16:32Z
model_revision
cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-14B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

68.587%

source id
openKoLLM
leaderboard name
ko_winogrande · acc,none
dimension
general
metric
ko_winogrande · acc,none
rank
19
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_winogrande · acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
published_at
2025-01-12T22:16:32Z
model_revision
cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-14B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

57.954

source id
openKoLLM
leaderboard name
ko_eqbench · eqbench,none
dimension
general
metric
ko_eqbench · eqbench,none
rank
24
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · eqbench,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
published_at
2025-01-12T22:16:32Z
model_revision
cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-14B-Instruct
Original result ↗

Open Ko-LLM Leaderboard

26.768%

source id
openKoLLM
leaderboard name
ko_gpqa_diamond_zeroshot · acc_norm,none
dimension
general
metric
ko_gpqa_diamond_zeroshot · acc_norm,none
rank
28
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gpqa_diamond_zeroshot · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
published_at
2025-01-12T22:16:32Z
model_revision
cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
Qwen/Qwen2.5-14B-Instruct
Original result ↗

Open LLM Leaderboard v2

54.758%

source id
openLLMLeaderboardV2
leaderboard name
Open LLM v2 MATH Lvl 5 · Raw
dimension
math
metric
Raw accuracy
rank
42
aggregation scope
suite
Open LLM v2
co2_kg
3.547300640675203
status
archived
precision
bfloat16
task_count
6
metric_kind
Raw accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2025-03-20T12:17:27Z
chat_template
true
suite_version
2
model_revision
f55224c616ca27d4bcf28969a156de12c98981cf
source_flagged
false
missing_metrics
    dataset_revision
    9c09a7cae43334062a82cb164f2ef255013dafa2
    metric_population
    4576
    ranking_population
    4576
    source_flag_anomaly
    false
    source model id
    Qwen/Qwen2.5-14B-Instruct
    Original result ↗

    Open LLM Leaderboard v2

    54.758%

    source id
    openLLMLeaderboardV2
    leaderboard name
    Open LLM v2 MATH Lvl 5 · Normalized
    dimension
    math
    metric
    Normalized score
    rank
    42
    aggregation scope
    suite
    Open LLM v2
    co2_kg
    3.547300640675203
    status
    archived
    precision
    bfloat16
    task_count
    6
    metric_kind
    Normalized score
    rank_method
    Derived competition rank over published evaluations with reported scores, including variants and source flags
    weight_type
    Original
    published_at
    2025-03-20T12:17:27Z
    chat_template
    true
    suite_version
    2
    model_revision
    f55224c616ca27d4bcf28969a156de12c98981cf
    source_flagged
    false
    missing_metrics
      dataset_revision
      9c09a7cae43334062a82cb164f2ef255013dafa2
      metric_population
      4576
      ranking_population
      4576
      source_flag_anomaly
      false
      source model id
      Qwen/Qwen2.5-14B-Instruct
      Original result ↗

      Open LLM Leaderboard v2

      81.578%

      source id
      openLLMLeaderboardV2
      leaderboard name
      Open LLM v2 IFEval · Normalized
      dimension
      instructionFollowing
      metric
      Normalized score
      rank
      61
      aggregation scope
      suite
      Open LLM v2
      co2_kg
      3.547300640675203
      status
      archived
      precision
      bfloat16
      task_count
      6
      metric_kind
      Normalized score
      rank_method
      Derived competition rank over published evaluations with reported scores, including variants and source flags
      weight_type
      Original
      published_at
      2025-03-20T12:17:27Z
      chat_template
      true
      suite_version
      2
      model_revision
      f55224c616ca27d4bcf28969a156de12c98981cf
      source_flagged
      false
      missing_metrics
        dataset_revision
        9c09a7cae43334062a82cb164f2ef255013dafa2
        metric_population
        4576
        ranking_population
        4576
        source_flag_anomaly
        false
        source model id
        Qwen/Qwen2.5-14B-Instruct
        Original result ↗

        Open LLM Leaderboard v2

        81.578%

        source id
        openLLMLeaderboardV2
        leaderboard name
        Open LLM v2 IFEval · Raw
        dimension
        instructionFollowing
        metric
        Raw accuracy
        rank
        61
        aggregation scope
        suite
        Open LLM v2
        co2_kg
        3.547300640675203
        status
        archived
        precision
        bfloat16
        task_count
        6
        metric_kind
        Raw accuracy
        rank_method
        Derived competition rank over published evaluations with reported scores, including variants and source flags
        weight_type
        Original
        published_at
        2025-03-20T12:17:27Z
        chat_template
        true
        suite_version
        2
        model_revision
        f55224c616ca27d4bcf28969a156de12c98981cf
        source_flagged
        false
        missing_metrics
          dataset_revision
          9c09a7cae43334062a82cb164f2ef255013dafa2
          metric_population
          4576
          ranking_population
          4576
          source_flag_anomaly
          false
          source model id
          Qwen/Qwen2.5-14B-Instruct
          Original result ↗

          Open Ko-LLM Leaderboard

          54.132%

          source id
          openKoLLM
          leaderboard name
          ko_gsm8k · exact_match,strict-match
          dimension
          general
          metric
          ko_gsm8k · exact_match,strict-match
          rank
          62
          aggregation scope
          status
          published
          direction
          higherIsBetter
          conditions
          suite
          Open Ko-LLM
          language
          ko
          execution
          model_dtype
          torch.bfloat16
          num_fewshot_seeds
          1
          override_batch_size
          1
          num_few_shot_default
          0
          task_versions
          all
          2
          ko_gsm8k
          2
          ko_ifeval
          2
          ko_eqbench
          2
          ko_winogrande
          2
          kornat_common
          2
          kornat_social
          2
          kornat_helpful
          2
          kornat_harmless
          2
          ko_gpqa_diamond_zeroshot
          2
          metric_kind
          ko_gsm8k · exact_match,strict-match
          rank_method
          competition rank among reported evaluations in identical conditions, including unlinked observations
          source_file
          open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
          published_at
          2025-01-12T22:16:32Z
          model_revision
          cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
          source_revision
          79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
          metric_population
          238
          benchmark_evaluation
          true
          source model id
          Qwen/Qwen2.5-14B-Instruct
          Original result ↗

          Open Ko-LLM Leaderboard

          87.719%

          source id
          openKoLLM
          leaderboard name
          ko_eqbench · percent_parseable,none
          dimension
          general
          metric
          ko_eqbench · percent_parseable,none
          rank
          96
          aggregation scope
          status
          published
          direction
          higherIsBetter
          conditions
          suite
          Open Ko-LLM
          language
          ko
          execution
          model_dtype
          torch.bfloat16
          num_fewshot_seeds
          1
          override_batch_size
          1
          num_few_shot_default
          0
          task_versions
          all
          2
          ko_gsm8k
          2
          ko_ifeval
          2
          ko_eqbench
          2
          ko_winogrande
          2
          kornat_common
          2
          kornat_social
          2
          kornat_helpful
          2
          kornat_harmless
          2
          ko_gpqa_diamond_zeroshot
          2
          metric_kind
          ko_eqbench · percent_parseable,none
          rank_method
          competition rank among reported evaluations in identical conditions, including unlinked observations
          source_file
          open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
          published_at
          2025-01-12T22:16:32Z
          model_revision
          cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
          source_revision
          79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
          metric_population
          238
          benchmark_evaluation
          true
          source model id
          Qwen/Qwen2.5-14B-Instruct
          Original result ↗

          Open LLM Leaderboard v2

          41.309%

          source id
          openLLMLeaderboardV2
          leaderboard name
          Open LLM v2 Average
          dimension
          general
          metric
          Normalized six-task average
          rank
          173
          aggregation scope
          suite
          Open LLM v2
          co2_kg
          3.547300640675203
          status
          archived
          precision
          bfloat16
          task_count
          6
          metric_kind
          Normalized six-task average
          rank_method
          Derived competition rank over published evaluations with reported scores, including variants and source flags
          weight_type
          Original
          published_at
          2025-03-20T12:17:27Z
          chat_template
          true
          suite_version
          2
          model_revision
          f55224c616ca27d4bcf28969a156de12c98981cf
          source_flagged
          false
          missing_metrics
            dataset_revision
            9c09a7cae43334062a82cb164f2ef255013dafa2
            metric_population
            4576
            ranking_population
            4576
            source_flag_anomaly
            false
            source model id
            Qwen/Qwen2.5-14B-Instruct
            Original result ↗

            Open Ko-LLM Leaderboard

            31.394%

            source id
            openKoLLM
            leaderboard name
            kornat_social · A-SVA,none
            dimension
            general
            metric
            kornat_social · A-SVA,none
            rank
            234
            aggregation scope
            status
            published
            direction
            higherIsBetter
            conditions
            suite
            Open Ko-LLM
            language
            ko
            execution
            model_dtype
            torch.bfloat16
            num_fewshot_seeds
            1
            override_batch_size
            1
            num_few_shot_default
            0
            task_versions
            all
            2
            ko_gsm8k
            2
            ko_ifeval
            2
            ko_eqbench
            2
            ko_winogrande
            2
            kornat_common
            2
            kornat_social
            2
            kornat_helpful
            2
            kornat_harmless
            2
            ko_gpqa_diamond_zeroshot
            2
            metric_kind
            kornat_social · A-SVA,none
            rank_method
            competition rank among reported evaluations in identical conditions, including unlinked observations
            source_file
            open-ko-llm-leaderboard/results/Qwen/Qwen2.5-14B-Instruct/result_2024-10-24 06:04:45.json
            published_at
            2025-01-12T22:16:32Z
            model_revision
            cf98f3b3bbb457ad9e2bb7baf9a0125b6b88caa8
            source_revision
            79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
            metric_population
            238
            benchmark_evaluation
            true
            source model id
            Qwen/Qwen2.5-14B-Instruct
            Original result ↗

            Open LLM Leaderboard v2

            48.361%

            source id
            openLLMLeaderboardV2
            leaderboard name
            Open LLM v2 BBH · Normalized
            dimension
            reasoning
            metric
            Normalized score
            rank
            530
            aggregation scope
            suite
            Open LLM v2
            co2_kg
            3.547300640675203
            status
            archived
            precision
            bfloat16
            task_count
            6
            metric_kind
            Normalized score
            rank_method
            Derived competition rank over published evaluations with reported scores, including variants and source flags
            weight_type
            Original
            published_at
            2025-03-20T12:17:27Z
            chat_template
            true
            suite_version
            2
            model_revision
            f55224c616ca27d4bcf28969a156de12c98981cf
            source_flagged
            false
            missing_metrics
              dataset_revision
              9c09a7cae43334062a82cb164f2ef255013dafa2
              metric_population
              4576
              ranking_population
              4576
              source_flag_anomaly
              false
              source model id
              Qwen/Qwen2.5-14B-Instruct
              Original result ↗

              Provider specifications & access

              1–4 / 4

              Qwen/Qwen2.5-14B-Instruct ↗

              source model id
              HuggingFace/qwen-qwen2.5-14b-instruct@1
              hosting
              foundry-managed-compute
              platforms
              • Microsoft Foundry
              license
              apache-2.0
              architecture
              input_modalities
              • text
              output_modalities
              • text
              capabilities

                Qwen/Qwen2.5-14B-Instruct ↗

                source model id
                publishers/hf-qwen/models/qwen2.5-14b-instruct@001
                hosting
                vertex-self-deployed
                platforms
                • Google Cloud Vertex AI
                architecture
                input_modalities
                • text
                output_modalities
                • text
                capabilities

                  Qwen2.5-14B-Instruct ↗

                  source model id
                  publishers/qwen/models/qwen2@qwen2.5-14b-instruct
                  hosting
                  vertex-self-deployed
                  platforms
                  • Google Cloud Vertex AI
                  architecture
                  input_modalities
                  • text
                  output_modalities
                  • text
                  capabilities

                    Qwen2.5-14B-Instruct ↗

                    source model id
                    Qwen/Qwen2.5-14B-Instruct
                    hosting
                    siliconflow-hosted
                    platforms
                    • SiliconFlow
                    max output tokens
                    4096
                    architecture
                    input_modalities
                    • text
                    output_modalities
                    • text
                    capabilities
                    • structuredOutputs
                    • toolCalling

                    Safety assessments

                    1–1 / 1

                    Foundation Model Transparency Index 2025 ↗

                    26 / 100

                    source id
                    stanfordFMTI
                    canonical model id
                    huggingface/Qwen/Qwen2.5-14B-Instruct
                    taxonomy
                    transparency
                    hazard category
                    transparency
                    hazard name
                    Organization transparency
                    policy area
                    Alibaba
                    assessment type
                    organization-level disclosure
                    metric
                    disclosure_score
                    result label
                    26 / 100
                    sample size
                    100
                    updated at
                    2026-11-09T18:08:05.227Z

                    Source specification observations

                    1–2 / 2

                    siliconFlow ↗

                    field
                    context_length
                    value
                    33K
                    scope
                    source-model
                    source id
                    siliconFlow
                    confidence
                    1

                    siliconFlow ↗

                    field
                    max_output_tokens
                    value
                    4K
                    scope
                    source-model
                    source id
                    siliconFlow
                    confidence
                    1

                    Original sources

                    1–19 / 19

                    SiliconFlow · Model page ↗

                    Hugging Face · Model repository ↗

                    Google Cloud · Model page ↗

                    Google Cloud · Model page ↗

                    Microsoft Foundry · Model page ↗

                    SiliconFlow · Playground ↗

                    Google Cloud · Model documentation ↗

                    Microsoft Foundry · Model documentation ↗

                    SiliconFlow · API documentation ↗

                    arXiv · Paper · 2309.00071 ↗

                    arXiv · Paper · 2407.10671 ↗

                    GitHub · Catalog ↗

                    GitHub · Catalog ↗

                    Google Cloud · Catalog ↗

                    Hugging Face · Catalog ↗

                    Hugging Face · Catalog ↗

                    Hugging Face · Catalog ↗

                    Microsoft Foundry · Catalog ↗

                    SiliconFlow · Catalog ↗

                    Source links

                    1–8 / 8

                    Hugging Face model card

                    1–1 / 1

                    Explore more models

                    Models

                    Loading
                    EVIDENCE / COMPARISON

                    Benchmarks

                    Explore every benchmark

                    Loading

                    These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

                    Install TensorTrace