Qwen: Qwen3 32B

Qwen3-32B is a dense 32.8B parameter causal language model from the Qwen3 series, optimized for both complex reasoning and efficient dialogue. It supports seamless switching between a "thinking" mode…

qwen/qwen3-32b-04-28

Qwen3-32B is a dense 32.8B parameter causal language model from the Qwen3 series, optimized for both complex reasoning and efficient dialogue. It supports seamless switching between a "thinking" mode for tasks like math, coding, and logical inference, and a "non-thinking" mode for faster, general-purpose conversation. The model demonstrates strong performance in instruction-following, agent tool use, creative writing, and multilingual tasks across 100+ languages and dialects. It natively handles 32K token contexts and can extend to 131K tokens using YaRN-based scaling.

Specifications & capabilities

Input
text
Output
text
Context window · tokens
131072
Knowledge cutoff
2025-03-31
Published model ID
Qwen3-32B
Capabilities
reasoning, structuredOutputs, toolCalling
Description source ↗

Evaluations

1–20 / 95

LLM Stats · GitHub archive

0.73

source id
llmStatsArchive
leaderboard name
MultiLF · Raw
dimension
general
metric
MultiLF · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MultiLF
language
en
modality
text
verified
false
max_score
1
categories
  • general
created_at
2025-07-19T19:56:14.628191+00:00
updated_at
2025-07-19T19:56:14.628191+00:00
description
MultiLF benchmark
benchmark_id
multilf
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MultiLF · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-32b/benchmarks.json
archive_kind
llmStats
evidence_url
https://qwenlm.github.io/blog/qwen3/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-32b
metric_population
2
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-32b
Original result ↗

LLM Stats · GitHub archive

0.73

source id
llmStatsArchive
leaderboard name
MultiLF · Normalized (reported)
dimension
general
metric
MultiLF · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MultiLF
language
en
modality
text
verified
false
max_score
1
categories
  • general
created_at
2025-07-19T19:56:14.628191+00:00
updated_at
2025-07-19T19:56:14.628191+00:00
description
MultiLF benchmark
benchmark_id
multilf
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MultiLF · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-32b/benchmarks.json
archive_kind
llmStats
evidence_url
https://qwenlm.github.io/blog/qwen3/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-32b
metric_population
2
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-32b
Original result ↗

LLM Stats · GitHub archive

0.938

source id
llmStatsArchive
leaderboard name
Arena Hard · Normalized (reported)
dimension
general
metric
Arena Hard · Normalized (reported)
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Arena Hard
language
en
modality
text
verified
false
max_score
1
categories
  • general
  • reasoning
  • creativity
created_at
2025-07-19T19:56:14.079874+00:00
paper_link
https://arxiv.org/abs/2406.11939
updated_at
2025-07-19T19:56:14.079874+00:00
description
Arena-Hard-Auto is an automatic evaluation benchmark for instruction-tuned LLMs consisting of 500 challenging real-world prompts curated by BenchBuilder. It includes open-ended software engineering problems, mathematical questions, and creative writing tasks. The benchmark uses LLM-as-a-Judge methodology with GPT-4.1 and Gemini-2.5 as automatic judges to approximate human preference. Arena-Hard achieves 98.6% correlation with human preference rankings and provides 3x higher separation of model performances compared to MT-Bench, making it highly effective for distinguishing between models of similar quality.
benchmark_id
arena-hard
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Arena Hard · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-32b/benchmarks.json
archive_kind
llmStats
evidence_url
https://qwenlm.github.io/blog/qwen3/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-32b
metric_population
5
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-32b
Original result ↗

LLM Stats · GitHub archive

0.938

source id
llmStatsArchive
leaderboard name
Arena Hard · Raw
dimension
general
metric
Arena Hard · Raw
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Arena Hard
language
en
modality
text
verified
false
max_score
1
categories
  • general
  • reasoning
  • creativity
created_at
2025-07-19T19:56:14.079874+00:00
paper_link
https://arxiv.org/abs/2406.11939
updated_at
2025-07-19T19:56:14.079874+00:00
description
Arena-Hard-Auto is an automatic evaluation benchmark for instruction-tuned LLMs consisting of 500 challenging real-world prompts curated by BenchBuilder. It includes open-ended software engineering problems, mathematical questions, and creative writing tasks. The benchmark uses LLM-as-a-Judge methodology with GPT-4.1 and Gemini-2.5 as automatic judges to approximate human preference. Arena-Hard achieves 98.6% correlation with human preference rankings and provides 3x higher separation of model performances compared to MT-Bench, making it highly effective for distinguishing between models of similar quality.
benchmark_id
arena-hard
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Arena Hard · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-32b/benchmarks.json
archive_kind
llmStats
evidence_url
https://qwenlm.github.io/blog/qwen3/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-32b
metric_population
5
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-32b
Original result ↗

LLM Stats · GitHub archive

0.814

source id
llmStatsArchive
leaderboard name
AIME 2024 · Normalized (reported)
dimension
general
metric
AIME 2024 · Normalized (reported)
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
AIME 2024
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-07-19T19:56:11.941652+00:00
paper_link
https://arxiv.org/html/2503.21380v2
updated_at
2025-09-30T00:00:00.000000+00:00
description
American Invitational Mathematics Examination 2024, consisting of 30 challenging mathematical reasoning problems from AIME I and AIME II competitions. Each problem requires an integer answer between 0-999 and tests advanced mathematical reasoning across algebra, geometry, combinatorics, and number theory. Used as a benchmark for evaluating mathematical reasoning capabilities in large language models at Olympiad-level difficulty.
benchmark_id
aime-2024
multilingual
false
analysis_method
Pass@64
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
AIME 2024 · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-32b/benchmarks.json
archive_kind
llmStats
evidence_url
https://qwenlm.github.io/blog/qwen3/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-32b
metric_population
2
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-32b
Original result ↗

LLM Stats · GitHub archive

0.814

source id
llmStatsArchive
leaderboard name
AIME 2024 · Raw
dimension
general
metric
AIME 2024 · Raw
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
AIME 2024
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-07-19T19:56:11.941652+00:00
paper_link
https://arxiv.org/html/2503.21380v2
updated_at
2025-09-30T00:00:00.000000+00:00
description
American Invitational Mathematics Examination 2024, consisting of 30 challenging mathematical reasoning problems from AIME I and AIME II competitions. Each problem requires an integer answer between 0-999 and tests advanced mathematical reasoning across algebra, geometry, combinatorics, and number theory. Used as a benchmark for evaluating mathematical reasoning capabilities in large language models at Olympiad-level difficulty.
benchmark_id
aime-2024
multilingual
false
analysis_method
Pass@64
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
AIME 2024 · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-32b/benchmarks.json
archive_kind
llmStats
evidence_url
https://qwenlm.github.io/blog/qwen3/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-32b
metric_population
2
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-32b
Original result ↗

LLM Stats · GitHub archive

0.749

source id
llmStatsArchive
leaderboard name
LiveBench · Normalized (reported)
dimension
general
metric
LiveBench · Normalized (reported)
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
LiveBench
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
  • general
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2406.19314
updated_at
2025-09-05T00:00:00.000000+00:00
description
LiveBench is a challenging, contamination-limited LLM benchmark that addresses test set contamination by releasing new questions monthly based on recently-released datasets, arXiv papers, news articles, and IMDb movie synopses. It comprises tasks across math, coding, reasoning, language, instruction following, and data analysis with verifiable, objective ground-truth answers.
benchmark_id
livebench
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
LiveBench · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-32b/benchmarks.json
archive_kind
llmStats
evidence_url
https://qwenlm.github.io/blog/qwen3/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-32b
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-32b
Original result ↗

LLM Stats · GitHub archive

0.749

source id
llmStatsArchive
leaderboard name
LiveBench · Raw
dimension
general
metric
LiveBench · Raw
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
LiveBench
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
  • general
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2406.19314
updated_at
2025-09-05T00:00:00.000000+00:00
description
LiveBench is a challenging, contamination-limited LLM benchmark that addresses test set contamination by releasing new questions monthly based on recently-released datasets, arXiv papers, news articles, and IMDb movie synopses. It comprises tasks across math, coding, reasoning, language, instruction following, and data analysis with verifiable, objective ground-truth answers.
benchmark_id
livebench
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
LiveBench · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-32b/benchmarks.json
archive_kind
llmStats
evidence_url
https://qwenlm.github.io/blog/qwen3/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-32b
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-32b
Original result ↗

LLM Stats · GitHub archive

0.729

source id
llmStatsArchive
leaderboard name
AIME 2025 · Normalized (reported)
dimension
general
metric
AIME 2025 · Normalized (reported)
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
AIME 2025
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2503.21380
updated_at
2025-09-05T00:00:00.000000+00:00
description
All 30 problems from the 2025 American Invitational Mathematics Examination (AIME I and AIME II), testing olympiad-level mathematical reasoning with integer answers from 000-999. Used as an AI benchmark to evaluate large language models' ability to solve complex mathematical problems requiring multi-step logical deductions and structured symbolic reasoning.
benchmark_id
aime-2025
multilingual
false
analysis_method
Pass@64
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
AIME 2025 · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-32b/benchmarks.json
archive_kind
llmStats
evidence_url
https://qwenlm.github.io/blog/qwen3/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-32b
metric_population
2
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-32b
Original result ↗

LLM Stats · GitHub archive

0.729

source id
llmStatsArchive
leaderboard name
AIME 2025 · Raw
dimension
general
metric
AIME 2025 · Raw
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
AIME 2025
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2503.21380
updated_at
2025-09-05T00:00:00.000000+00:00
description
All 30 problems from the 2025 American Invitational Mathematics Examination (AIME I and AIME II), testing olympiad-level mathematical reasoning with integer answers from 000-999. Used as an AI benchmark to evaluate large language models' ability to solve complex mathematical problems requiring multi-step logical deductions and structured symbolic reasoning.
benchmark_id
aime-2025
multilingual
false
analysis_method
Pass@64
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
AIME 2025 · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-32b/benchmarks.json
archive_kind
llmStats
evidence_url
https://qwenlm.github.io/blog/qwen3/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-32b
metric_population
2
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-32b
Original result ↗

LLM Stats · GitHub archive

0.502

source id
llmStatsArchive
leaderboard name
Aider · Normalized (reported)
dimension
general
metric
Aider · Normalized (reported)
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Aider
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • code
created_at
2025-07-19T19:56:14.566857+00:00
updated_at
2025-07-19T19:56:14.566857+00:00
description
Aider is a comprehensive code editing benchmark based on 133 practice exercises from Exercism's Python repository, designed to evaluate AI models' ability to translate natural language coding requests into executable code that passes unit tests. The benchmark measures end-to-end code editing capabilities, including GPT's ability to edit existing code and format code changes for automated saving to local files. The Aider Polyglot variant extends this evaluation across 225 challenging exercises spanning C++, Go, Java, JavaScript, Python, and Rust, making it a standard benchmark for assessing multilingual code editing performance in AI research.
benchmark_id
aider
multilingual
false
implementation_link
https://github.com/Aider-AI/aider
analysis_method
Pass@2
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Aider · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-32b/benchmarks.json
archive_kind
llmStats
evidence_url
https://qwenlm.github.io/blog/qwen3/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-32b
metric_population
2
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-32b
Original result ↗

LLM Stats · GitHub archive

0.502

source id
llmStatsArchive
leaderboard name
Aider · Raw
dimension
general
metric
Aider · Raw
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Aider
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • code
created_at
2025-07-19T19:56:14.566857+00:00
updated_at
2025-07-19T19:56:14.566857+00:00
description
Aider is a comprehensive code editing benchmark based on 133 practice exercises from Exercism's Python repository, designed to evaluate AI models' ability to translate natural language coding requests into executable code that passes unit tests. The benchmark measures end-to-end code editing capabilities, including GPT's ability to edit existing code and format code changes for automated saving to local files. The Aider Polyglot variant extends this evaluation across 225 challenging exercises spanning C++, Go, Java, JavaScript, Python, and Rust, making it a standard benchmark for assessing multilingual code editing performance in AI research.
benchmark_id
aider
multilingual
false
implementation_link
https://github.com/Aider-AI/aider
analysis_method
Pass@2
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Aider · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-32b/benchmarks.json
archive_kind
llmStats
evidence_url
https://qwenlm.github.io/blog/qwen3/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-32b
metric_population
2
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-32b
Original result ↗

BFCL

90.27%

source id
bfcl
leaderboard name
BFCL Non-Live AST
dimension
toolUse
metric
Non-live AST accuracy
rank
3
Original result ↗

OpenRouter Benchmarks

63.343%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Groq
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
3
sample size
346
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Groq
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-08-29T16:23:45.123Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
346
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.633429739884393
accuracy_std_dev
0.015053999999999956
cost_per_task_usd
0.007234326589595376
output_tokens_per_task
11969.693641618496
latency_seconds_per_task
26.683387283236993
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
6
benchmark_evaluation
true
openrouter_permaslug
qwen/qwen3-32b-04-28
source model id
qwen/qwen3-32b-04-28
Original result ↗

OpenRouter Benchmarks

44.913%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Tenstorrent
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
7
sample size
249
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
5
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Tenstorrent
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-07T04:00:08.022Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
249
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.4491300441767068
accuracy_std_dev
0.023957999896485522
cost_per_task_usd
0.02306757831325301
output_tokens_per_task
14213.674698795181
latency_seconds_per_task
1875.501032128514
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
7
benchmark_evaluation
true
openrouter_permaslug
qwen/qwen3-32b-04-28
source model id
qwen/qwen3-32b-04-28
Original result ↗

OpenRouter Benchmarks

54.691%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Tenstorrent
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
8
sample size
1908
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
10
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Tenstorrent
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-08T04:29:32.011Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1908
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.5469078490566038
accuracy_std_dev
0.022963942121508662
cost_per_task_usd
0.005774233752620544
output_tokens_per_task
14661.248427672956
latency_seconds_per_task
784.9588862683438
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
8
benchmark_evaluation
true
openrouter_permaslug
qwen/qwen3-32b-04-28
source model id
qwen/qwen3-32b-04-28
Original result ↗

BFCL

88.77%

source id
bfcl
leaderboard name
BFCL Non-Live AST
dimension
toolUse
metric
Non-live AST accuracy
rank
11
Original result ↗

BFCL

47.87%

source id
bfcl
leaderboard name
BFCL Multi Turn
dimension
agentic
metric
Multi-turn accuracy
rank
18
Original result ↗

Published prices

1–4 / 4

qwen/qwen3-32b ↗

$0.08

Inference provider
openRouter
Platform
OpenRouter
Unit
input_tokens_per_million
Currency
USD
Billing conditions

qwen/qwen3-32b ↗

$0.28

Inference provider
openRouter
Platform
OpenRouter
Unit
output_tokens_per_million
Currency
USD
Billing conditions

Qwen/Qwen3-32B ↗

$0.14

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
input_tokens_per_million
Currency
USD
Billing conditions
Billing label
Input tokens (per 1M)

Qwen/Qwen3-32B ↗

$0.57

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
output_tokens_per_million
Currency
USD
Billing conditions
Billing label
Output tokens (per 1M)

Provider specifications & access

1–9 / 9

Qwen/Qwen3-32B ↗

source model id
azure-huggingface/qwen--qwen3-32b@2
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
apache-2.0
context length
40960
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    Qwen/Qwen3-32B ↗

    source model id
    azure-huggingface/qwen--qwen3-32b@3
    hosting
    foundry-managed-compute
    platforms
    • Microsoft Foundry
    license
    apache-2.0
    context length
    40960
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      Qwen/Qwen3-32B ↗

      source model id
      azure-huggingface/qwen--qwen3-32b@4
      hosting
      foundry-managed-compute
      platforms
      • Microsoft Foundry
      license
      apache-2.0
      context length
      40960
      architecture
      input_modalities
      • text
      output_modalities
      • text
      capabilities

        Qwen/Qwen3-32B ↗

        source model id
        azure-huggingface/qwen--qwen3-32b@5
        hosting
        foundry-managed-compute
        platforms
        • Microsoft Foundry
        license
        apache-2.0
        context length
        40960
        architecture
        input_modalities
        • text
        output_modalities
        • text
        capabilities

          Qwen/Qwen3-32B ↗

          source model id
          azure-huggingface/qwen--qwen3-32b@6
          hosting
          foundry-managed-compute
          platforms
          • Microsoft Foundry
          license
          apache-2.0
          context length
          40960
          architecture
          input_modalities
          • text
          output_modalities
          • text
          capabilities

            Qwen/Qwen3-32B ↗

            source model id
            HuggingFace/qwen-qwen3-32b@1
            hosting
            foundry-managed-compute
            platforms
            • Microsoft Foundry
            license
            apache-2.0
            architecture
            input_modalities
            • text
            output_modalities
            • text
            capabilities

              Qwen/Qwen3-32B ↗

              source model id
              HuggingFace/qwen-qwen3-32b@2
              hosting
              foundry-managed-compute
              platforms
              • Microsoft Foundry
              license
              apache-2.0
              architecture
              input_modalities
              • text
              output_modalities
              • text
              capabilities

                Qwen3-32B ↗

                source model id
                publishers/qwen/models/qwen3@qwen3-32b
                hosting
                vertex-self-deployed
                platforms
                • Google Cloud Vertex AI
                architecture
                input_modalities
                • text
                output_modalities
                • text
                capabilities

                  Qwen3-32B ↗

                  source model id
                  Qwen/Qwen3-32B
                  hosting
                  siliconflow-hosted
                  platforms
                  • SiliconFlow
                  max output tokens
                  131072
                  architecture
                  input_modalities
                  • text
                  output_modalities
                  • text
                  capabilities
                  • reasoning
                  • structuredOutputs
                  • toolCalling

                  Safety assessments

                  1–1 / 1

                  Foundation Model Transparency Index 2025 ↗

                  26 / 100

                  source id
                  stanfordFMTI
                  canonical model id
                  qwen/qwen3-32b-04-28
                  taxonomy
                  transparency
                  hazard category
                  transparency
                  hazard name
                  Organization transparency
                  policy area
                  Alibaba
                  assessment type
                  organization-level disclosure
                  metric
                  disclosure_score
                  result label
                  26 / 100
                  sample size
                  100
                  updated at
                  2026-11-09T18:08:05.227Z

                  Source specification observations

                  1–10 / 10

                  azureFoundry ↗

                  field
                  context_length
                  value
                  40960
                  normalized value
                  40960
                  scope
                  source-model
                  source id
                  azureFoundry
                  confidence
                  1

                  azureFoundry ↗

                  field
                  context_length
                  value
                  40960
                  normalized value
                  40960
                  scope
                  source-model
                  source id
                  azureFoundry
                  confidence
                  1

                  azureFoundry ↗

                  field
                  context_length
                  value
                  40960
                  normalized value
                  40960
                  scope
                  source-model
                  source id
                  azureFoundry
                  confidence
                  1

                  azureFoundry ↗

                  field
                  context_length
                  value
                  40960
                  normalized value
                  40960
                  scope
                  source-model
                  source id
                  azureFoundry
                  confidence
                  1

                  azureFoundry ↗

                  field
                  context_length
                  value
                  40960
                  normalized value
                  40960
                  scope
                  source-model
                  source id
                  azureFoundry
                  confidence
                  1

                  openRouter ↗

                  field
                  context_length
                  value
                  131072
                  normalized value
                  131072
                  scope
                  source-model
                  source id
                  openRouter
                  confidence
                  1

                  siliconFlow ↗

                  field
                  context_length
                  value
                  131K
                  scope
                  source-model
                  source id
                  siliconFlow
                  confidence
                  1

                  openRouter ↗

                  field
                  knowledge_cutoff
                  reported field
                  knowledge_cutoff
                  value
                  2025-03-31
                  normalized value
                  2025-03-31
                  precision
                  day
                  scope
                  source-model
                  source id
                  openRouter
                  confidence
                  1

                  openRouter ↗

                  field
                  max_output_tokens
                  value
                  16384
                  normalized value
                  16384
                  scope
                  source-model
                  source id
                  openRouter
                  confidence
                  1

                  siliconFlow ↗

                  field
                  max_output_tokens
                  value
                  131K
                  scope
                  source-model
                  source id
                  siliconFlow
                  confidence
                  1

                  Original sources

                  1–20 / 28

                  SiliconFlow · Model page ↗

                  Hugging Face · Model reference ↗

                  Google Cloud · Model page ↗

                  Microsoft Foundry · Model page ↗

                  Microsoft Foundry · Model page ↗

                  Microsoft Foundry · Model page ↗

                  Microsoft Foundry · Model page ↗

                  Microsoft Foundry · Model page ↗

                  Microsoft Foundry · Model page ↗

                  Microsoft Foundry · Model page ↗

                  OpenRouter · Model page ↗

                  SiliconFlow · Playground ↗

                  Google Cloud · Model documentation ↗

                  Microsoft Foundry · Model documentation ↗

                  SiliconFlow · API documentation ↗

                  arXiv · Paper · 2309.00071 ↗

                  arXiv · Paper · 2505.09388 ↗

                  GitHub · Catalog ↗

                  GitHub · Catalog ↗

                  Google Cloud · Catalog ↗

                  Source links

                  1–12 / 12

                  Hugging Face model card

                  1–1 / 1

                  Qwen/Qwen3-32B ↗

                  downloads
                  3062101
                  likes
                  792
                  pipeline tag
                  text-generation
                  library name
                  transformers
                  License
                  apache-2.0

                  Explore more models

                  Models

                  Loading
                  EVIDENCE / COMPARISON

                  Benchmarks

                  Explore every benchmark

                  Loading

                  These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

                  Install TensorTrace