Qwen: Qwen3 235B A22B Instruct 2507

Qwen3-235B-A22B-Instruct-2507 is a multilingual, instruction-tuned mixture-of-experts language model based on the Qwen3-235B architecture, with 22B active parameters per forward pass. It is optimized…

qwen/qwen3-235b-a22b-07-25

Qwen3-235B-A22B-Instruct-2507 is a multilingual, instruction-tuned mixture-of-experts language model based on the Qwen3-235B architecture, with 22B active parameters per forward pass. It is optimized for general-purpose text generation, including instruction following, logical reasoning, math, code, and tool usage. The model supports a native 262K context length and does not implement "thinking mode" (<think> blocks).

Compared to its base variant, this version delivers significant gains in knowledge coverage, long-context reasoning, coding benchmarks, and alignment with open-ended tasks. It is particularly strong on multilingual understanding, math reasoning (e.g., AIME, HMMT), and alignment evaluations like Arena-Hard and WritingBench.

Specifications & capabilities

Input
text
Output
text
Context window · tokens
262144
Knowledge cutoff
2025-06-30
Published model ID
Qwen3-235B-A22B-Instruct-2507
Capabilities
promptCaching, structuredOutputs, toolCalling
Description source ↗

Evaluations

21–40 / 160

LLM Stats · GitHub archive

0.713

source id
llmStatsArchive
leaderboard name
Tau2 Retail · Normalized (reported)
dimension
general
metric
Tau2 Retail · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Tau2 Retail
language
en
modality
text
verified
false
max_score
1
categories
  • communication
  • reasoning
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2506.07982
updated_at
2025-09-05T00:00:00.000000+00:00
description
τ²-bench retail domain evaluates conversational AI agents in customer service scenarios within a dual-control environment where both agent and user can interact with tools. Tests tool-agent-user interaction, rule adherence, and task consistency in retail customer support contexts.
benchmark_id
tau2-retail
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Tau2 Retail · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.713

source id
llmStatsArchive
leaderboard name
Tau2 Retail · Raw
dimension
general
metric
Tau2 Retail · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Tau2 Retail
language
en
modality
text
verified
false
max_score
1
categories
  • communication
  • reasoning
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2506.07982
updated_at
2025-09-05T00:00:00.000000+00:00
description
τ²-bench retail domain evaluates conversational AI agents in customer service scenarios within a dual-control environment where both agent and user can interact with tools. Tests tool-agent-user interaction, rule adherence, and task consistency in retail customer support contexts.
benchmark_id
tau2-retail
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Tau2 Retail · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.709

source id
llmStatsArchive
leaderboard name
BFCL-v3 · Raw
dimension
general
metric
BFCL-v3 · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
BFCL-v3
language
en
modality
text
verified
false
max_score
1
categories
  • general
  • reasoning
created_at
2025-08-03T22:06:11.216985+00:00
paper_link
https://openreview.net/forum?id=2GmDdhBdDk
updated_at
2025-08-03T22:06:11.216985+00:00
description
Berkeley Function Calling Leaderboard v3 (BFCL-v3) is an advanced benchmark that evaluates large language models' function calling capabilities through multi-turn and multi-step interactions. It introduces extended conversational exchanges where models must retain contextual information across turns and execute multiple internal function calls for complex user requests. The benchmark includes 1000 test cases across domains like vehicle control, trading bots, travel booking, and file system management, using state-based evaluation to verify both system state changes and execution path correctness.
benchmark_id
bfcl-v3
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
BFCL-v3 · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.709

source id
llmStatsArchive
leaderboard name
BFCL-v3 · Normalized (reported)
dimension
general
metric
BFCL-v3 · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
BFCL-v3
language
en
modality
text
verified
false
max_score
1
categories
  • general
  • reasoning
created_at
2025-08-03T22:06:11.216985+00:00
paper_link
https://openreview.net/forum?id=2GmDdhBdDk
updated_at
2025-08-03T22:06:11.216985+00:00
description
Berkeley Function Calling Leaderboard v3 (BFCL-v3) is an advanced benchmark that evaluates large language models' function calling capabilities through multi-turn and multi-step interactions. It introduces extended conversational exchanges where models must retain contextual information across turns and execute multiple internal function calls for complex user requests. The benchmark includes 1000 test cases across domains like vehicle control, trading bots, travel booking, and file system management, using state-based evaluation to verify both system state changes and execution path correctness.
benchmark_id
bfcl-v3
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
BFCL-v3 · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.626

source id
llmStatsArchive
leaderboard name
SuperGPQA · Normalized (reported)
dimension
general
metric
SuperGPQA · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
SuperGPQA
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
  • math
  • legal
  • healthcare
  • finance
  • chemistry
  • economics
  • physics
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2502.14739
updated_at
2025-09-05T00:00:00.000000+00:00
description
SuperGPQA is a comprehensive benchmark that evaluates large language models across 285 graduate-level academic disciplines. The benchmark contains 25,957 questions covering 13 broad disciplinary areas including Engineering, Medicine, Science, and Law, with specialized fields in light industry, agriculture, and service-oriented domains. It employs a Human-LLM collaborative filtering mechanism with over 80 expert annotators to create challenging questions that assess graduate-level knowledge and reasoning capabilities.
benchmark_id
supergpqa
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
SuperGPQA · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
4
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.626

source id
llmStatsArchive
leaderboard name
SuperGPQA · Raw
dimension
general
metric
SuperGPQA · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
SuperGPQA
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
  • math
  • legal
  • healthcare
  • finance
  • chemistry
  • economics
  • physics
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2502.14739
updated_at
2025-09-05T00:00:00.000000+00:00
description
SuperGPQA is a comprehensive benchmark that evaluates large language models across 285 graduate-level academic disciplines. The benchmark contains 25,957 questions covering 13 broad disciplinary areas including Engineering, Medicine, Science, and Law, with specialized fields in light industry, agriculture, and service-oriented domains. It employs a Human-LLM collaborative filtering mechanism with over 80 expert annotators to create challenging questions that assess graduate-level knowledge and reasoning capabilities.
benchmark_id
supergpqa
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
SuperGPQA · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
4
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.554

source id
llmStatsArchive
leaderboard name
HMMT25 · Normalized (reported)
dimension
general
metric
HMMT25 · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HMMT25
language
en
modality
text
verified
false
max_score
1
categories
  • math
created_at
2025-07-19T19:56:15.061281+00:00
paper_link
http://web.mit.edu/HMMT/www/
updated_at
2025-07-19T19:56:15.061281+00:00
description
Harvard-MIT Mathematics Tournament 2025 - A prestigious student-organized mathematics competition for high school students featuring two tournaments (November 2025 at MIT and February 2026 at Harvard) with individual tests, team rounds, and guts rounds
benchmark_id
hmmt25
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HMMT25 · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.554

source id
llmStatsArchive
leaderboard name
HMMT25 · Raw
dimension
general
metric
HMMT25 · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HMMT25
language
en
modality
text
verified
false
max_score
1
categories
  • math
created_at
2025-07-19T19:56:15.061281+00:00
paper_link
http://web.mit.edu/HMMT/www/
updated_at
2025-07-19T19:56:15.061281+00:00
description
Harvard-MIT Mathematics Tournament 2025 - A prestigious student-organized mathematics competition for high school students featuring two tournaments (November 2025 at MIT and February 2026 at Harvard) with individual tests, team rounds, and guts rounds
benchmark_id
hmmt25
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HMMT25 · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.543

source id
llmStatsArchive
leaderboard name
SimpleQA · Normalized (reported)
dimension
general
metric
SimpleQA · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
SimpleQA
language
en
modality
text
verified
false
max_score
1
categories
  • general
  • reasoning
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2411.04368
updated_at
2025-09-05T00:00:00.000000+00:00
description
SimpleQA is a factuality benchmark developed by OpenAI that measures the short-form factual accuracy of large language models. The benchmark contains 4,326 short, fact-seeking questions that are adversarially collected and designed to have single, indisputable answers. Questions cover diverse topics from science and technology to entertainment, and the benchmark also measures model calibration by evaluating whether models know what they know.
benchmark_id
simpleqa
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
SimpleQA · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.543

source id
llmStatsArchive
leaderboard name
SimpleQA · Raw
dimension
general
metric
SimpleQA · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
SimpleQA
language
en
modality
text
verified
false
max_score
1
categories
  • general
  • reasoning
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2411.04368
updated_at
2025-09-05T00:00:00.000000+00:00
description
SimpleQA is a factuality benchmark developed by OpenAI that measures the short-form factual accuracy of large language models. The benchmark contains 4,326 short, fact-seeking questions that are adversarially collected and designed to have single, indisputable answers. Questions cover diverse topics from science and technology to entertainment, and the benchmark also measures model calibration by evaluating whether models know what they know.
benchmark_id
simpleqa
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
SimpleQA · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.518

source id
llmStatsArchive
leaderboard name
LiveCodeBench v6 · Raw
dimension
general
metric
LiveCodeBench v6 · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
LiveCodeBench v6
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
created_at
2025-07-19T19:56:11.785682+00:00
paper_link
https://arxiv.org/abs/2403.07974
updated_at
2025-07-19T19:56:11.785682+00:00
description
LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.
benchmark_id
livecodebench-v6
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
LiveCodeBench v6 · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.518

source id
llmStatsArchive
leaderboard name
LiveCodeBench v6 · Normalized (reported)
dimension
general
metric
LiveCodeBench v6 · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
LiveCodeBench v6
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
created_at
2025-07-19T19:56:11.785682+00:00
paper_link
https://arxiv.org/abs/2403.07974
updated_at
2025-07-19T19:56:11.785682+00:00
description
LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.
benchmark_id
livecodebench-v6
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
LiveCodeBench v6 · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.502

source id
llmStatsArchive
leaderboard name
PolyMATH · Normalized (reported)
dimension
general
metric
PolyMATH · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
PolyMATH
language
en
modality
multimodal
verified
false
max_score
1
categories
  • math
  • reasoning
  • spatial_reasoning
  • multimodal
  • vision
created_at
2025-08-03T22:06:11.108063+00:00
paper_link
https://arxiv.org/abs/2410.14702
updated_at
2025-08-03T22:06:11.108063+00:00
description
Polymath is a challenging multi-modal mathematical reasoning benchmark designed to evaluate the general cognitive reasoning abilities of Multi-modal Large Language Models (MLLMs). The benchmark comprises 5,000 manually collected high-quality images of cognitive textual and visual challenges across 10 distinct categories, including pattern recognition, spatial reasoning, and relative reasoning.
benchmark_id
polymath
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
PolyMATH · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.502

source id
llmStatsArchive
leaderboard name
PolyMATH · Raw
dimension
general
metric
PolyMATH · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
PolyMATH
language
en
modality
multimodal
verified
false
max_score
1
categories
  • math
  • reasoning
  • spatial_reasoning
  • multimodal
  • vision
created_at
2025-08-03T22:06:11.108063+00:00
paper_link
https://arxiv.org/abs/2410.14702
updated_at
2025-08-03T22:06:11.108063+00:00
description
Polymath is a challenging multi-modal mathematical reasoning benchmark designed to evaluate the general cognitive reasoning abilities of Multi-modal Large Language Models (MLLMs). The benchmark comprises 5,000 manually collected high-quality images of cognitive textual and visual challenges across 10 distinct categories, including pattern recognition, spatial reasoning, and relative reasoning.
benchmark_id
polymath
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
PolyMATH · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.44

source id
llmStatsArchive
leaderboard name
Tau2 Airline · Normalized (reported)
dimension
general
metric
Tau2 Airline · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Tau2 Airline
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • communication
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2506.07982
updated_at
2025-09-05T00:00:00.000000+00:00
description
TAU2 airline domain benchmark for evaluating conversational agents in dual-control environments where both AI agents and users interact with tools in airline customer service scenarios. Tests agent coordination, communication, and ability to guide user actions in tasks like flight booking, modifications, cancellations, and refunds.
benchmark_id
tau2-airline
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Tau2 Airline · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.44

source id
llmStatsArchive
leaderboard name
Tau2 Airline · Raw
dimension
general
metric
Tau2 Airline · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Tau2 Airline
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • communication
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2506.07982
updated_at
2025-09-05T00:00:00.000000+00:00
description
TAU2 airline domain benchmark for evaluating conversational agents in dual-control environments where both AI agents and users interact with tools in airline customer service scenarios. Tests agent coordination, communication, and ability to guide user actions in tasks like flight booking, modifications, cancellations, and refunds.
benchmark_id
tau2-airline
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Tau2 Airline · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.418

source id
llmStatsArchive
leaderboard name
ARC-AGI · Normalized (reported)
dimension
general
metric
ARC-AGI · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
ARC-AGI
language
en
modality
image
verified
false
max_score
1
categories
  • reasoning
  • vision
  • spatial_reasoning
created_at
2025-07-19T19:56:15.187761+00:00
paper_link
https://arxiv.org/abs/1911.01547
updated_at
2025-07-19T19:56:15.187761+00:00
description
The Abstraction and Reasoning Corpus for Artificial General Intelligence (ARC-AGI) is a benchmark designed to test general intelligence and abstract reasoning capabilities through visual grid-based transformation tasks. Each task consists of 2-5 demonstration pairs showing input grids transformed into output grids according to underlying rules, with test-takers required to infer these rules and apply them to novel test inputs. The benchmark uses colored grids (up to 30x30) with 10 discrete colors/symbols, designed to measure human-like general fluid intelligence and skill-acquisition efficiency with minimal prior knowledge.
benchmark_id
arc-agi
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
ARC-AGI · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.418

source id
llmStatsArchive
leaderboard name
ARC-AGI · Raw
dimension
general
metric
ARC-AGI · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
ARC-AGI
language
en
modality
image
verified
false
max_score
1
categories
  • reasoning
  • vision
  • spatial_reasoning
created_at
2025-07-19T19:56:15.187761+00:00
paper_link
https://arxiv.org/abs/1911.01547
updated_at
2025-07-19T19:56:15.187761+00:00
description
The Abstraction and Reasoning Corpus for Artificial General Intelligence (ARC-AGI) is a benchmark designed to test general intelligence and abstract reasoning capabilities through visual grid-based transformation tasks. Each task consists of 2-5 demonstration pairs showing input grids transformed into output grids according to underlying rules, with test-takers required to infer these rules and apply them to novel test inputs. The benchmark uses colored grids (up to 30x30) with 10 discrete colors/symbols, designed to measure human-like general fluid intelligence and skill-acquisition efficiency with minimal prior knowledge.
benchmark_id
arc-agi
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
ARC-AGI · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.703

source id
llmStatsArchive
leaderboard name
AIME 2025 · Raw
dimension
general
metric
AIME 2025 · Raw
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
AIME 2025
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2503.21380
updated_at
2025-09-05T00:00:00.000000+00:00
description
All 30 problems from the 2025 American Invitational Mathematics Examination (AIME I and AIME II), testing olympiad-level mathematical reasoning with integer answers from 000-999. Used as an AI benchmark to evaluate large language models' ability to solve complex mathematical problems requiring multi-step logical deductions and structured symbolic reasoning.
benchmark_id
aime-2025
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
AIME 2025 · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
2
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

LLM Stats · GitHub archive

0.703

source id
llmStatsArchive
leaderboard name
AIME 2025 · Normalized (reported)
dimension
general
metric
AIME 2025 · Normalized (reported)
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
AIME 2025
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2503.21380
updated_at
2025-09-05T00:00:00.000000+00:00
description
All 30 problems from the 2025 American Invitational Mathematics Examination (AIME I and AIME II), testing olympiad-level mathematical reasoning with integer answers from 000-999. Used as an AI benchmark to evaluate large language models' ability to solve complex mathematical problems requiring multi-step logical deductions and structured symbolic reasoning.
benchmark_id
aime-2025
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
AIME 2025 · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen3-235b-a22b-instruct-2507/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen3-235b-a22b-instruct-2507
metric_population
2
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen3-235b-a22b-instruct-2507
Original result ↗

Published prices

1–3 / 3

Provider specifications & access

1–8 / 8

Qwen/Qwen3-235B-A22B-Instruct-2507 ↗

source model id
azure-huggingface/qwen--qwen3-235b-a22b-instruct-2507@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
apache-2.0
context length
262144
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    Qwen/Qwen3-235B-A22B-Instruct-2507 ↗

    source model id
    HuggingFace/qwen-qwen3-235b-a22b-instruct-2507@1
    hosting
    foundry-managed-compute
    platforms
    • Microsoft Foundry
    license
    apache-2.0
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      Qwen/Qwen3-235B-A22B-Instruct-2507 ↗

      source model id
      HuggingFace/qwen-qwen3-235b-a22b-instruct-2507@2
      hosting
      foundry-managed-compute
      platforms
      • Microsoft Foundry
      license
      apache-2.0
      architecture
      input_modalities
      • text
      output_modalities
      • text
      capabilities

        Qwen/Qwen3-235B-A22B-Instruct-2507 ↗

        source model id
        HuggingFace/qwen-qwen3-235b-a22b-instruct-2507@3
        hosting
        foundry-managed-compute
        platforms
        • Microsoft Foundry
        license
        apache-2.0
        architecture
        input_modalities
        • text
        output_modalities
        • text
        capabilities

          Qwen/Qwen3-235B-A22B-Instruct-2507 ↗

          source model id
          HuggingFace/qwen-qwen3-235b-a22b-instruct-2507@4
          hosting
          foundry-managed-compute
          platforms
          • Microsoft Foundry
          license
          apache-2.0
          architecture
          input_modalities
          • text
          output_modalities
          • text
          capabilities

            Qwen/Qwen3-235B-A22B-Instruct-2507 ↗

            source model id
            HuggingFace/qwen-qwen3-235b-a22b-instruct-2507@5
            hosting
            foundry-managed-compute
            platforms
            • Microsoft Foundry
            license
            apache-2.0
            architecture
            input_modalities
            • text
            output_modalities
            • text
            capabilities

              Qwen3-235B-A22B-Instruct-2507 ↗

              source model id
              publishers/qwen/models/qwen3@qwen3-235b-a22b-instruct-2507
              hosting
              vertex-self-deployed
              platforms
              • Google Cloud Vertex AI
              architecture
              input_modalities
              • text
              output_modalities
              • text
              capabilities

                Qwen3-235B-A22B-Instruct-2507 ↗

                source model id
                Qwen/Qwen3-235B-A22B-Instruct-2507
                hosting
                siliconflow-hosted
                platforms
                • SiliconFlow
                max output tokens
                262144
                architecture
                input_modalities
                • text
                output_modalities
                • text
                capabilities
                • structuredOutputs
                • toolCalling

                Safety assessments

                1–1 / 1

                Foundation Model Transparency Index 2025 ↗

                26 / 100

                source id
                stanfordFMTI
                canonical model id
                qwen/qwen3-235b-a22b-07-25
                taxonomy
                transparency
                hazard category
                transparency
                hazard name
                Organization transparency
                policy area
                Alibaba
                assessment type
                organization-level disclosure
                metric
                disclosure_score
                result label
                26 / 100
                sample size
                100
                updated at
                2026-11-09T18:08:05.227Z

                Source specification observations

                1–6 / 6

                azureFoundry ↗

                field
                context_length
                value
                262144
                normalized value
                262144
                scope
                source-model
                source id
                azureFoundry
                confidence
                1

                openRouter ↗

                field
                context_length
                value
                262144
                normalized value
                262144
                scope
                source-model
                source id
                openRouter
                confidence
                1

                siliconFlow ↗

                field
                context_length
                value
                262K
                scope
                source-model
                source id
                siliconFlow
                confidence
                1

                openRouter ↗

                field
                knowledge_cutoff
                reported field
                knowledge_cutoff
                value
                2025-06-30
                normalized value
                2025-06-30
                precision
                day
                scope
                source-model
                source id
                openRouter
                confidence
                1

                openRouter ↗

                field
                max_output_tokens
                value
                117964
                normalized value
                117964
                scope
                source-model
                source id
                openRouter
                confidence
                1

                siliconFlow ↗

                field
                max_output_tokens
                value
                262K
                scope
                source-model
                source id
                siliconFlow
                confidence
                1

                Original sources

                1–20 / 24

                SiliconFlow · Model page ↗

                Hugging Face · Model repository ↗

                Google Cloud · Model page ↗

                Microsoft Foundry · Model page ↗

                Microsoft Foundry · Model page ↗

                Microsoft Foundry · Model page ↗

                Microsoft Foundry · Model page ↗

                Microsoft Foundry · Model page ↗

                Microsoft Foundry · Model page ↗

                OpenRouter · Model page ↗

                SiliconFlow · Playground ↗

                Google Cloud · Model documentation ↗

                Microsoft Foundry · Model documentation ↗

                SiliconFlow · API documentation ↗

                GitHub · Catalog ↗

                GitHub · Catalog ↗

                Google Cloud · Catalog ↗

                Hugging Face · Catalog ↗

                Hugging Face · Catalog ↗

                LMArena · Catalog ↗

                Source links

                1–12 / 12

                Explore more models

                Models

                Loading
                EVIDENCE / COMPARISON

                Benchmarks

                Explore every benchmark

                Loading

                These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

                Install TensorTrace