Qwen/QwQ-32B-Preview
Preview QwQ 32B reasoning model for experimental math and coding tasks.
azureFoundry/azure-huggingface/qwen--qwq-32b-preview@5
Preview QwQ 32B reasoning model for experimental math and coding tasks.
Specifications & capabilities
- Input
- text
- Output
- text
- Context window · tokens
- 32768
- Published model ID
- QwQ-32B-Preview
Evaluations
1–20 / 75
0.906
- source id
- llmStatsArchive
- leaderboard name
- MATH-500 · Normalized (reported)
- dimension
- general
- metric
- MATH-500 · Normalized (reported)
- rank
- 1
- aggregation scope
- status
- archived
- license
- CC-BY-4.0
- direction
- higherIsBetter
- conditions
- language
- en
- benchmark
- name
- MATH-500
- language
- en
- modality
- text
- verified
- false
- max_score
- 1
- created_at
- 2025-07-19T19:56:12.027850+00:00
- paper_link
- https://arxiv.org/abs/2103.03874
- updated_at
- 2025-07-19T19:56:12.027850+00:00
- description
- MATH-500 is a subset of the MATH dataset containing 500 challenging competition mathematics problems from AMC 10, AMC 12, AIME, and other mathematics competitions. Each problem includes full step-by-step solutions and spans multiple difficulty levels across seven mathematical subjects including Prealgebra, Algebra, Number Theory, Counting and Probability, Geometry, Intermediate Algebra, and Precalculus.
- benchmark_id
- math-500
- multilingual
- false
- analysis_method
- accuracy
- is_self_reported
- true
- verified_by_llmstats
- false
- attribution
- Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
- license_url
- https://creativecommons.org/licenses/by/4.0/
- metric_kind
- MATH-500 · Normalized (reported)
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- data/organizations/qwen/models/qwq-32b-preview/benchmarks.json
- archive_kind
- llmStats
- evidence_url
- https://qwenlm.github.io/blog/qwq-32b-preview/
- git_revision
- 872b75f63b8d853c46ed17856424029a0c47b1d2
- published_at
- 2025-10-24T17:47:59Z
- snapshot_date
- 2025-10-24T17:47:59Z
- source_revision
- 6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
- publisher_anchor
- qwen/qwq-32b-preview
- metric_population
- 2
- current_catalog_url
- https://llm-stats.com/
- benchmark_evaluation
- true
- source model id
- qwq-32b-preview
Original result ↗0.906
- source id
- llmStatsArchive
- leaderboard name
- MATH-500 · Raw
- dimension
- general
- metric
- MATH-500 · Raw
- rank
- 1
- aggregation scope
- status
- archived
- license
- CC-BY-4.0
- direction
- higherIsBetter
- conditions
- language
- en
- benchmark
- name
- MATH-500
- language
- en
- modality
- text
- verified
- false
- max_score
- 1
- created_at
- 2025-07-19T19:56:12.027850+00:00
- paper_link
- https://arxiv.org/abs/2103.03874
- updated_at
- 2025-07-19T19:56:12.027850+00:00
- description
- MATH-500 is a subset of the MATH dataset containing 500 challenging competition mathematics problems from AMC 10, AMC 12, AIME, and other mathematics competitions. Each problem includes full step-by-step solutions and spans multiple difficulty levels across seven mathematical subjects including Prealgebra, Algebra, Number Theory, Counting and Probability, Geometry, Intermediate Algebra, and Precalculus.
- benchmark_id
- math-500
- multilingual
- false
- analysis_method
- accuracy
- is_self_reported
- true
- verified_by_llmstats
- false
- attribution
- Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
- license_url
- https://creativecommons.org/licenses/by/4.0/
- metric_kind
- MATH-500 · Raw
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- data/organizations/qwen/models/qwq-32b-preview/benchmarks.json
- archive_kind
- llmStats
- evidence_url
- https://qwenlm.github.io/blog/qwq-32b-preview/
- git_revision
- 872b75f63b8d853c46ed17856424029a0c47b1d2
- published_at
- 2025-10-24T17:47:59Z
- snapshot_date
- 2025-10-24T17:47:59Z
- source_revision
- 6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
- publisher_anchor
- qwen/qwq-32b-preview
- metric_population
- 2
- current_catalog_url
- https://llm-stats.com/
- benchmark_evaluation
- true
- source model id
- qwq-32b-preview
Original result ↗87.24%
- source id
- openPersianLLM
- leaderboard name
- ARC Challenge
- dimension
- general
- metric
- ARC Challenge
- rank
- 3
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- ARC Challenge
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- Qwen/QwQ-32B-Preview
Original result ↗46.64%
- source id
- openPersianLLM
- leaderboard name
- Part Multiple Choice
- dimension
- general
- metric
- Part Multiple Choice
- rank
- 3
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- Part Multiple Choice
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- Qwen/QwQ-32B-Preview
Original result ↗37.94%
- source id
- openPersianLLM
- leaderboard name
- MMLU Pro
- dimension
- general
- metric
- MMLU Pro
- rank
- 4
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- MMLU Pro
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- Qwen/QwQ-32B-Preview
Original result ↗0.5
- source id
- llmStatsArchive
- leaderboard name
- AIME 2024 · Normalized (reported)
- dimension
- general
- metric
- AIME 2024 · Normalized (reported)
- rank
- 5
- aggregation scope
- status
- archived
- license
- CC-BY-4.0
- direction
- higherIsBetter
- conditions
- language
- en
- benchmark
- name
- AIME 2024
- language
- en
- modality
- text
- verified
- false
- max_score
- 1
- created_at
- 2025-07-19T19:56:11.941652+00:00
- paper_link
- https://arxiv.org/html/2503.21380v2
- updated_at
- 2025-09-30T00:00:00.000000+00:00
- description
- American Invitational Mathematics Examination 2024, consisting of 30 challenging mathematical reasoning problems from AIME I and AIME II competitions. Each problem requires an integer answer between 0-999 and tests advanced mathematical reasoning across algebra, geometry, combinatorics, and number theory. Used as a benchmark for evaluating mathematical reasoning capabilities in large language models at Olympiad-level difficulty.
- benchmark_id
- aime-2024
- multilingual
- false
- analysis_method
- accuracy
- is_self_reported
- true
- verified_by_llmstats
- false
- attribution
- Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
- license_url
- https://creativecommons.org/licenses/by/4.0/
- metric_kind
- AIME 2024 · Normalized (reported)
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- data/organizations/qwen/models/qwq-32b-preview/benchmarks.json
- archive_kind
- llmStats
- evidence_url
- https://qwenlm.github.io/blog/qwq-32b-preview/
- git_revision
- 872b75f63b8d853c46ed17856424029a0c47b1d2
- published_at
- 2025-10-24T17:47:59Z
- snapshot_date
- 2025-10-24T17:47:59Z
- source_revision
- 6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
- publisher_anchor
- qwen/qwq-32b-preview
- metric_population
- 5
- current_catalog_url
- https://llm-stats.com/
- benchmark_evaluation
- true
- source model id
- qwq-32b-preview
Original result ↗0.5
- source id
- llmStatsArchive
- leaderboard name
- AIME 2024 · Raw
- dimension
- general
- metric
- AIME 2024 · Raw
- rank
- 5
- aggregation scope
- status
- archived
- license
- CC-BY-4.0
- direction
- higherIsBetter
- conditions
- language
- en
- benchmark
- name
- AIME 2024
- language
- en
- modality
- text
- verified
- false
- max_score
- 1
- created_at
- 2025-07-19T19:56:11.941652+00:00
- paper_link
- https://arxiv.org/html/2503.21380v2
- updated_at
- 2025-09-30T00:00:00.000000+00:00
- description
- American Invitational Mathematics Examination 2024, consisting of 30 challenging mathematical reasoning problems from AIME I and AIME II competitions. Each problem requires an integer answer between 0-999 and tests advanced mathematical reasoning across algebra, geometry, combinatorics, and number theory. Used as a benchmark for evaluating mathematical reasoning capabilities in large language models at Olympiad-level difficulty.
- benchmark_id
- aime-2024
- multilingual
- false
- analysis_method
- accuracy
- is_self_reported
- true
- verified_by_llmstats
- false
- attribution
- Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
- license_url
- https://creativecommons.org/licenses/by/4.0/
- metric_kind
- AIME 2024 · Raw
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- data/organizations/qwen/models/qwq-32b-preview/benchmarks.json
- archive_kind
- llmStats
- evidence_url
- https://qwenlm.github.io/blog/qwq-32b-preview/
- git_revision
- 872b75f63b8d853c46ed17856424029a0c47b1d2
- published_at
- 2025-10-24T17:47:59Z
- snapshot_date
- 2025-10-24T17:47:59Z
- source_revision
- 6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
- publisher_anchor
- qwen/qwq-32b-preview
- metric_population
- 5
- current_catalog_url
- https://llm-stats.com/
- benchmark_evaluation
- true
- source model id
- qwq-32b-preview
Original result ↗91.95%
- source id
- openPersianLLM
- leaderboard name
- ARC Easy
- dimension
- general
- metric
- ARC Easy
- rank
- 6
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- ARC Easy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- Qwen/QwQ-32B-Preview
Original result ↗60.15%
- source id
- openPersianLLM
- leaderboard name
- AUT Multiple Choice Persian
- dimension
- general
- metric
- AUT Multiple Choice Persian
- rank
- 6
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- AUT Multiple Choice Persian
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- Qwen/QwQ-32B-Preview
Original result ↗0.652
- source id
- llmStatsArchive
- leaderboard name
- GPQA · Normalized (reported)
- dimension
- general
- metric
- GPQA · Normalized (reported)
- rank
- 7
- aggregation scope
- status
- archived
- license
- CC-BY-4.0
- direction
- higherIsBetter
- conditions
- language
- en
- benchmark
- name
- GPQA
- language
- en
- modality
- text
- verified
- false
- max_score
- 1
- created_at
- 2025-07-19T19:56:11.588605+00:00
- paper_link
- https://arxiv.org/abs/2311.12022
- updated_at
- 2025-07-19T19:56:11.588605+00:00
- description
- A challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry. Questions are Google-proof and extremely difficult, with PhD experts reaching 65% accuracy.
- benchmark_id
- gpqa
- multilingual
- false
- analysis_method
- accuracy
- is_self_reported
- true
- verified_by_llmstats
- false
- attribution
- Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
- license_url
- https://creativecommons.org/licenses/by/4.0/
- metric_kind
- GPQA · Normalized (reported)
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- data/organizations/qwen/models/qwq-32b-preview/benchmarks.json
- archive_kind
- llmStats
- evidence_url
- https://qwenlm.github.io/blog/qwq-32b-preview/
- git_revision
- 872b75f63b8d853c46ed17856424029a0c47b1d2
- published_at
- 2025-10-24T17:47:59Z
- snapshot_date
- 2025-10-24T17:47:59Z
- source_revision
- 6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
- publisher_anchor
- qwen/qwq-32b-preview
- metric_population
- 10
- current_catalog_url
- https://llm-stats.com/
- benchmark_evaluation
- true
- source model id
- qwq-32b-preview
Original result ↗0.652
- source id
- llmStatsArchive
- leaderboard name
- GPQA · Raw
- dimension
- general
- metric
- GPQA · Raw
- rank
- 7
- aggregation scope
- status
- archived
- license
- CC-BY-4.0
- direction
- higherIsBetter
- conditions
- language
- en
- benchmark
- name
- GPQA
- language
- en
- modality
- text
- verified
- false
- max_score
- 1
- created_at
- 2025-07-19T19:56:11.588605+00:00
- paper_link
- https://arxiv.org/abs/2311.12022
- updated_at
- 2025-07-19T19:56:11.588605+00:00
- description
- A challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry. Questions are Google-proof and extremely difficult, with PhD experts reaching 65% accuracy.
- benchmark_id
- gpqa
- multilingual
- false
- analysis_method
- accuracy
- is_self_reported
- true
- verified_by_llmstats
- false
- attribution
- Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
- license_url
- https://creativecommons.org/licenses/by/4.0/
- metric_kind
- GPQA · Raw
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- data/organizations/qwen/models/qwq-32b-preview/benchmarks.json
- archive_kind
- llmStats
- evidence_url
- https://qwenlm.github.io/blog/qwq-32b-preview/
- git_revision
- 872b75f63b8d853c46ed17856424029a0c47b1d2
- published_at
- 2025-10-24T17:47:59Z
- snapshot_date
- 2025-10-24T17:47:59Z
- source_revision
- 6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
- publisher_anchor
- qwen/qwq-32b-preview
- metric_population
- 10
- current_catalog_url
- https://llm-stats.com/
- benchmark_evaluation
- true
- source model id
- qwq-32b-preview
Original result ↗0.5
- source id
- llmStatsArchive
- leaderboard name
- LiveCodeBench · Normalized (reported)
- dimension
- general
- metric
- LiveCodeBench · Normalized (reported)
- rank
- 7
- aggregation scope
- status
- archived
- license
- CC-BY-4.0
- direction
- higherIsBetter
- conditions
- language
- en
- benchmark
- name
- LiveCodeBench
- language
- en
- modality
- text
- verified
- false
- max_score
- 1
- created_at
- 2025-07-19T19:56:13.292229+00:00
- paper_link
- https://arxiv.org/abs/2403.07974
- updated_at
- 2025-07-19T19:56:13.292229+00:00
- description
- LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.
- benchmark_id
- livecodebench
- multilingual
- false
- analysis_method
- accuracy
- is_self_reported
- true
- verified_by_llmstats
- false
- attribution
- Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
- license_url
- https://creativecommons.org/licenses/by/4.0/
- metric_kind
- LiveCodeBench · Normalized (reported)
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- data/organizations/qwen/models/qwq-32b-preview/benchmarks.json
- archive_kind
- llmStats
- evidence_url
- https://qwenlm.github.io/blog/qwq-32b-preview/
- git_revision
- 872b75f63b8d853c46ed17856424029a0c47b1d2
- published_at
- 2025-10-24T17:47:59Z
- snapshot_date
- 2025-10-24T17:47:59Z
- source_revision
- 6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
- publisher_anchor
- qwen/qwq-32b-preview
- metric_population
- 7
- current_catalog_url
- https://llm-stats.com/
- benchmark_evaluation
- true
- source model id
- qwq-32b-preview
Original result ↗0.5
- source id
- llmStatsArchive
- leaderboard name
- LiveCodeBench · Raw
- dimension
- general
- metric
- LiveCodeBench · Raw
- rank
- 7
- aggregation scope
- status
- archived
- license
- CC-BY-4.0
- direction
- higherIsBetter
- conditions
- language
- en
- benchmark
- name
- LiveCodeBench
- language
- en
- modality
- text
- verified
- false
- max_score
- 1
- created_at
- 2025-07-19T19:56:13.292229+00:00
- paper_link
- https://arxiv.org/abs/2403.07974
- updated_at
- 2025-07-19T19:56:13.292229+00:00
- description
- LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.
- benchmark_id
- livecodebench
- multilingual
- false
- analysis_method
- accuracy
- is_self_reported
- true
- verified_by_llmstats
- false
- attribution
- Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
- license_url
- https://creativecommons.org/licenses/by/4.0/
- metric_kind
- LiveCodeBench · Raw
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- data/organizations/qwen/models/qwq-32b-preview/benchmarks.json
- archive_kind
- llmStats
- evidence_url
- https://qwenlm.github.io/blog/qwq-32b-preview/
- git_revision
- 872b75f63b8d853c46ed17856424029a0c47b1d2
- published_at
- 2025-10-24T17:47:59Z
- snapshot_date
- 2025-10-24T17:47:59Z
- source_revision
- 6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
- publisher_anchor
- qwen/qwq-32b-preview
- metric_population
- 7
- current_catalog_url
- https://llm-stats.com/
- benchmark_evaluation
- true
- source model id
- qwq-32b-preview
Original result ↗56.782%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MMLU-PRO · Raw
- dimension
- knowledge
- metric
- Raw accuracy
- rank
- 47
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 20.42077955247921
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 1032e81cb936c486aae1d33da75b2fbcd5deed4a
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- Qwen/QwQ-32B-Preview
Original result ↗51.98%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MMLU-PRO · Normalized
- dimension
- knowledge
- metric
- Normalized score
- rank
- 47
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 20.42077955247921
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 1032e81cb936c486aae1d33da75b2fbcd5deed4a
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- Qwen/QwQ-32B-Preview
Original result ↗41.406%
- source id
- liveBench
- leaderboard name
- LiveBench Coding
- dimension
- coding
- metric
- Average score
- rank
- 67
- sample size
- 256
- evaluated at
- 2025-02-06T18:31:22.368Z
- source model id
- qwq-32b-preview
Original result ↗30.582%
- source id
- liveBench
- leaderboard name
- LiveBench Overall
- dimension
- general
- metric
- Average score
- rank
- 115
- sample size
- 736
- evaluated at
- 2025-02-06T20:21:55.596Z
- source model id
- qwq-32b-preview
Original result ↗21.658%
- source id
- liveBench
- leaderboard name
- LiveBench Language
- dimension
- intelligence
- metric
- Average score
- rank
- 116
- sample size
- 380
- evaluated at
- 2025-02-06T20:21:55.596Z
- source model id
- qwq-32b-preview
Original result ↗36.783%
- source id
- liveBench
- leaderboard name
- LiveBench Instruction Following
- dimension
- general
- metric
- Average score
- rank
- 149
- sample size
- 100
- evaluated at
- 2024-12-10T19:31:49.646Z
- source model id
- qwq-32b-preview
Original result ↗53.388%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 BBH · Normalized
- dimension
- reasoning
- metric
- Normalized score
- rank
- 180
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 20.42077955247921
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 1032e81cb936c486aae1d33da75b2fbcd5deed4a
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- Qwen/QwQ-32B-Preview
Original result ↗Provider specifications & access
1–9 / 9
- source model id
- azure-huggingface/qwen--qwq-32b-preview@1
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 32768
- source model id
- azure-huggingface/qwen--qwq-32b-preview@2
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 32768
- source model id
- azure-huggingface/qwen--qwq-32b-preview@3
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 32768
- source model id
- azure-huggingface/qwen--qwq-32b-preview@4
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 32768
- source model id
- azure-huggingface/qwen--qwq-32b-preview@5
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 32768
- source model id
- azure-huggingface/qwen--qwq-32b-preview@6
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 32768
- source model id
- azure-huggingface/qwen--qwq-32b-preview@7
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 32768
- source model id
- HuggingFace/qwen-qwq-32b-preview@1
- hosting
- foundry-managed-compute
- license
- apache-2.0
- source model id
- HuggingFace/qwen-qwq-32b-preview@2
- hosting
- foundry-managed-compute
- license
- apache-2.0
Safety assessments
1–1 / 1
26 / 100
- source id
- stanfordFMTI
- canonical model id
- azureFoundry/azure-huggingface/qwen--qwq-32b-preview@5
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Alibaba
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 26 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–7 / 7
- field
- context_length
- value
- 32768
- normalized value
- 32768
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 32768
- normalized value
- 32768
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 32768
- normalized value
- 32768
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 32768
- normalized value
- 32768
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 32768
- normalized value
- 32768
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 32768
- normalized value
- 32768
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 32768
- normalized value
- 32768
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
Explore more models