Qwen/Qwen2-72B

Explore Qwen/Qwen2-72B: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/Qwen/Qwen2-72B

Specifications & capabilities

Input
text
Output
text
Published model ID
Qwen2-72B

Evaluations

21–40 / 54

LLM Stats · GitHub archive

0.689

source id
llmStatsArchive
leaderboard name
ARC-C · Normalized (reported)
dimension
general
metric
ARC-C · Normalized (reported)
rank
3
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
ARC-C
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
created_at
2025-07-19T19:56:11.052939+00:00
paper_link
https://arxiv.org/abs/1803.05457
updated_at
2025-07-19T19:56:11.052939+00:00
description
The AI2 Reasoning Challenge (ARC) Challenge Set is a multiple-choice question-answering benchmark containing grade-school level science questions that require advanced reasoning capabilities. ARC-C specifically contains questions that were answered incorrectly by both retrieval-based and word co-occurrence algorithms, making it a particularly challenging subset designed to test commonsense reasoning abilities in AI systems.
benchmark_id
arc-c
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
ARC-C · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

LLM Stats · GitHub archive

0.689

source id
llmStatsArchive
leaderboard name
ARC-C · Raw
dimension
general
metric
ARC-C · Raw
rank
3
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
ARC-C
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
created_at
2025-07-19T19:56:11.052939+00:00
paper_link
https://arxiv.org/abs/1803.05457
updated_at
2025-07-19T19:56:11.052939+00:00
description
The AI2 Reasoning Challenge (ARC) Challenge Set is a multiple-choice question-answering benchmark containing grade-school level science questions that require advanced reasoning capabilities. ARC-C specifically contains questions that were answered incorrectly by both retrieval-based and word co-occurrence algorithms, making it a particularly challenging subset designed to test commonsense reasoning abilities in AI systems.
benchmark_id
arc-c
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
ARC-C · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

LLM Stats · GitHub archive

0.911

source id
llmStatsArchive
leaderboard name
GSM8k · Normalized (reported)
dimension
general
metric
GSM8k · Normalized (reported)
rank
4
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
GSM8k
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-07-19T19:56:11.397385+00:00
paper_link
https://arxiv.org/abs/2110.14168
updated_at
2025-07-19T19:56:11.397385+00:00
description
Grade School Math 8K, a dataset of 8.5K high-quality linguistically diverse grade school math word problems requiring multi-step reasoning and elementary arithmetic operations.
benchmark_id
gsm8k
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
GSM8k · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
7
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

LLM Stats · GitHub archive

0.911

source id
llmStatsArchive
leaderboard name
GSM8k · Raw
dimension
general
metric
GSM8k · Raw
rank
4
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
GSM8k
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-07-19T19:56:11.397385+00:00
paper_link
https://arxiv.org/abs/2110.14168
updated_at
2025-07-19T19:56:11.397385+00:00
description
Grade School Math 8K, a dataset of 8.5K high-quality linguistically diverse grade school math word problems requiring multi-step reasoning and elementary arithmetic operations.
benchmark_id
gsm8k
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
GSM8k · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
7
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

LLM Stats · GitHub archive

0.644

source id
llmStatsArchive
leaderboard name
MMLU-Pro · Raw
dimension
general
metric
MMLU-Pro · Raw
rank
4
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MMLU-Pro
language
en
modality
text
verified
false
max_score
1
categories
  • language
  • reasoning
  • math
  • general
created_at
2025-07-19T19:56:11.408351+00:00
paper_link
https://arxiv.org/abs/2406.01574
updated_at
2025-07-19T19:56:11.408351+00:00
description
A more robust and challenging multi-task language understanding benchmark that extends MMLU by expanding multiple-choice options from 4 to 10, eliminating trivial questions, and focusing on reasoning-intensive tasks. Features over 12,000 curated questions across 14 domains and causes a 16-33% accuracy drop compared to original MMLU.
benchmark_id
mmlu-pro
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MMLU-Pro · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
5
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

LLM Stats · GitHub archive

0.644

source id
llmStatsArchive
leaderboard name
MMLU-Pro · Normalized (reported)
dimension
general
metric
MMLU-Pro · Normalized (reported)
rank
4
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MMLU-Pro
language
en
modality
text
verified
false
max_score
1
categories
  • language
  • reasoning
  • math
  • general
created_at
2025-07-19T19:56:11.408351+00:00
paper_link
https://arxiv.org/abs/2406.01574
updated_at
2025-07-19T19:56:11.408351+00:00
description
A more robust and challenging multi-task language understanding benchmark that extends MMLU by expanding multiple-choice options from 4 to 10, eliminating trivial questions, and focusing on reasoning-intensive tasks. Features over 12,000 curated questions across 14 domains and causes a 16-33% accuracy drop compared to original MMLU.
benchmark_id
mmlu-pro
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MMLU-Pro · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
5
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

LLM Stats · GitHub archive

0.823

source id
llmStatsArchive
leaderboard name
MMLU · Raw
dimension
general
metric
MMLU · Raw
rank
5
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MMLU
language
en
modality
text
verified
false
max_score
1
categories
  • general
  • reasoning
  • language
  • math
created_at
2025-07-19T19:56:11.200416+00:00
paper_link
https://arxiv.org/abs/2009.03300
updated_at
2025-07-19T19:56:11.200416+00:00
description
Massive Multitask Language Understanding benchmark testing knowledge across 57 diverse subjects including STEM, humanities, social sciences, and professional domains
benchmark_id
mmlu
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MMLU · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
8
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

LLM Stats · GitHub archive

0.823

source id
llmStatsArchive
leaderboard name
MMLU · Normalized (reported)
dimension
general
metric
MMLU · Normalized (reported)
rank
5
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MMLU
language
en
modality
text
verified
false
max_score
1
categories
  • general
  • reasoning
  • language
  • math
created_at
2025-07-19T19:56:11.200416+00:00
paper_link
https://arxiv.org/abs/2009.03300
updated_at
2025-07-19T19:56:11.200416+00:00
description
Massive Multitask Language Understanding benchmark testing knowledge across 57 diverse subjects including STEM, humanities, social sciences, and professional domains
benchmark_id
mmlu
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MMLU · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
8
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

LLM Stats · GitHub archive

0.597

source id
llmStatsArchive
leaderboard name
MATH · Normalized (reported)
dimension
general
metric
MATH · Normalized (reported)
rank
6
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MATH
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-07-19T19:56:11.804258+00:00
paper_link
https://arxiv.org/abs/2103.03874
updated_at
2025-07-19T19:56:11.804258+00:00
description
MATH dataset contains 12,500 challenging competition mathematics problems from AMC 10, AMC 12, AIME, and other mathematics competitions. Each problem includes full step-by-step solutions and spans multiple difficulty levels (1-5) across seven mathematical subjects including Prealgebra, Algebra, Number Theory, Counting and Probability, Geometry, Intermediate Algebra, and Precalculus.
benchmark_id
math
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MATH · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
7
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

LLM Stats · GitHub archive

0.597

source id
llmStatsArchive
leaderboard name
MATH · Raw
dimension
general
metric
MATH · Raw
rank
6
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MATH
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-07-19T19:56:11.804258+00:00
paper_link
https://arxiv.org/abs/2103.03874
updated_at
2025-07-19T19:56:11.804258+00:00
description
MATH dataset contains 12,500 challenging competition mathematics problems from AMC 10, AMC 12, AIME, and other mathematics competitions. Each problem includes full step-by-step solutions and spans multiple difficulty levels (1-5) across seven mathematical subjects including Prealgebra, Algebra, Number Theory, Counting and Probability, Geometry, Intermediate Algebra, and Precalculus.
benchmark_id
math
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MATH · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
7
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

LLM Stats · GitHub archive

0.86

source id
llmStatsArchive
leaderboard name
HumanEval · Raw
dimension
general
metric
HumanEval · Raw
rank
7
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HumanEval
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • code
created_at
2025-07-19T19:56:12.595263+00:00
paper_link
https://arxiv.org/abs/2107.03374
updated_at
2025-07-19T19:56:12.595263+00:00
description
A benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics
benchmark_id
humaneval
multilingual
false
analysis_method
Pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HumanEval · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
9
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

LLM Stats · GitHub archive

0.86

source id
llmStatsArchive
leaderboard name
HumanEval · Normalized (reported)
dimension
general
metric
HumanEval · Normalized (reported)
rank
7
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HumanEval
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • code
created_at
2025-07-19T19:56:12.595263+00:00
paper_link
https://arxiv.org/abs/2107.03374
updated_at
2025-07-19T19:56:12.595263+00:00
description
A benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics
benchmark_id
humaneval
multilingual
false
analysis_method
Pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HumanEval · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
9
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

LLM Stats · GitHub archive

0.424

source id
llmStatsArchive
leaderboard name
GPQA · Normalized (reported)
dimension
general
metric
GPQA · Normalized (reported)
rank
7
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
GPQA
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
created_at
2025-07-19T19:56:11.588605+00:00
paper_link
https://arxiv.org/abs/2311.12022
updated_at
2025-07-19T19:56:11.588605+00:00
description
A challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry. Questions are Google-proof and extremely difficult, with PhD experts reaching 65% accuracy.
benchmark_id
gpqa
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
GPQA · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
11
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

LLM Stats · GitHub archive

0.424

source id
llmStatsArchive
leaderboard name
GPQA · Raw
dimension
general
metric
GPQA · Raw
rank
7
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
GPQA
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
created_at
2025-07-19T19:56:11.588605+00:00
paper_link
https://arxiv.org/abs/2311.12022
updated_at
2025-07-19T19:56:11.588605+00:00
description
A challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry. Questions are Google-proof and extremely difficult, with PhD experts reaching 65% accuracy.
benchmark_id
gpqa
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
GPQA · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2-72b-instruct/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2-72B
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2-72b-instruct
metric_population
11
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2-72b-instruct
Original result ↗

Open LLM Leaderboard v1

85.292%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 GSM8K
dimension
math
metric
Accuracy
rank
9
aggregation scope
suite
Open LLM v1
status
archived
precision
bfloat16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
source_flagged
true
missing_metrics
    dataset_revision
    791ca1c841030008c6c266562c2b88c9b7196550
    metric_population
    7260
    ranking_population
    7260
    source_flag_anomaly
    true
    evaluated at
    2024-06-09T14:59:24.000Z
    source model id
    Qwen/Qwen2-72B
    Original result ↗

    Open LLM Leaderboard v1

    83.791%

    source id
    openLLMLeaderboardV1
    leaderboard name
    Open LLM v1 MMLU
    dimension
    knowledge
    metric
    Accuracy
    rank
    14
    aggregation scope
    suite
    Open LLM v1
    status
    archived
    precision
    bfloat16
    task_count
    6
    metric_kind
    Accuracy
    rank_method
    Derived competition rank over published evaluations with reported scores, including variants and source flags
    weight_type
    Original
    published_at
    2024-06-25T14:11:42Z
    chat_template
    false
    suite_version
    1
    source_flagged
    true
    missing_metrics
      dataset_revision
      791ca1c841030008c6c266562c2b88c9b7196550
      metric_population
      7260
      ranking_population
      7260
      source_flag_anomaly
      true
      evaluated at
      2024-06-09T14:59:24.000Z
      source model id
      Qwen/Qwen2-72B
      Original result ↗

      Open LLM Leaderboard v2

      57.306%

      source id
      openLLMLeaderboardV2
      leaderboard name
      Open LLM v2 MMLU-PRO · Raw
      dimension
      knowledge
      metric
      Raw accuracy
      rank
      38
      aggregation scope
      suite
      Open LLM v2
      co2_kg
      128.12455847973288
      status
      archived
      precision
      bfloat16
      task_count
      6
      metric_kind
      Raw accuracy
      rank_method
      Derived competition rank over published evaluations with reported scores, including variants and source flags
      weight_type
      Original
      published_at
      2025-03-20T12:17:27Z
      chat_template
      false
      suite_version
      2
      model_revision
      87993795c78576318087f70b43fbf530eb7789e7
      source_flagged
      false
      missing_metrics
        dataset_revision
        9c09a7cae43334062a82cb164f2ef255013dafa2
        metric_population
        4576
        ranking_population
        4576
        source_flag_anomaly
        false
        source model id
        Qwen/Qwen2-72B
        Original result ↗

        Open LLM Leaderboard v2

        52.562%

        source id
        openLLMLeaderboardV2
        leaderboard name
        Open LLM v2 MMLU-PRO · Normalized
        dimension
        knowledge
        metric
        Normalized score
        rank
        38
        aggregation scope
        suite
        Open LLM v2
        co2_kg
        128.12455847973288
        status
        archived
        precision
        bfloat16
        task_count
        6
        metric_kind
        Normalized score
        rank_method
        Derived competition rank over published evaluations with reported scores, including variants and source flags
        weight_type
        Original
        published_at
        2025-03-20T12:17:27Z
        chat_template
        false
        suite_version
        2
        model_revision
        87993795c78576318087f70b43fbf530eb7789e7
        source_flagged
        false
        missing_metrics
          dataset_revision
          9c09a7cae43334062a82cb164f2ef255013dafa2
          metric_population
          4576
          ranking_population
          4576
          source_flag_anomaly
          false
          source model id
          Qwen/Qwen2-72B
          Original result ↗

          Open LLM Leaderboard v1

          77.386%

          source id
          openLLMLeaderboardV1
          leaderboard name
          Open LLM v1 Average
          dimension
          general
          metric
          Six-task average
          rank
          50
          aggregation scope
          suite
          Open LLM v1
          status
          archived
          precision
          bfloat16
          task_count
          6
          metric_kind
          Six-task average
          rank_method
          Derived competition rank over published evaluations with reported scores, including variants and source flags
          weight_type
          Original
          published_at
          2024-06-25T14:11:42Z
          chat_template
          false
          suite_version
          1
          source_flagged
          true
          missing_metrics
            dataset_revision
            791ca1c841030008c6c266562c2b88c9b7196550
            metric_population
            7170
            ranking_population
            7260
            source_flag_anomaly
            true
            evaluated at
            2024-06-09T14:59:24.000Z
            source model id
            Qwen/Qwen2-72B
            Original result ↗

            Open LLM Leaderboard v2

            39.43%

            source id
            openLLMLeaderboardV2
            leaderboard name
            Open LLM v2 GPQA · Raw
            dimension
            knowledge
            metric
            Raw accuracy
            rank
            72
            aggregation scope
            suite
            Open LLM v2
            co2_kg
            128.12455847973288
            status
            archived
            precision
            bfloat16
            task_count
            6
            metric_kind
            Raw accuracy
            rank_method
            Derived competition rank over published evaluations with reported scores, including variants and source flags
            weight_type
            Original
            published_at
            2025-03-20T12:17:27Z
            chat_template
            false
            suite_version
            2
            model_revision
            87993795c78576318087f70b43fbf530eb7789e7
            source_flagged
            false
            missing_metrics
              dataset_revision
              9c09a7cae43334062a82cb164f2ef255013dafa2
              metric_population
              4576
              ranking_population
              4576
              source_flag_anomaly
              false
              source model id
              Qwen/Qwen2-72B
              Original result ↗

              Safety assessments

              1–1 / 1

              Foundation Model Transparency Index 2025 ↗

              26 / 100

              source id
              stanfordFMTI
              canonical model id
              huggingface/Qwen/Qwen2-72B
              taxonomy
              transparency
              hazard category
              transparency
              hazard name
              Organization transparency
              policy area
              Alibaba
              assessment type
              organization-level disclosure
              metric
              disclosure_score
              result label
              26 / 100
              sample size
              100
              updated at
              2026-11-09T18:08:05.227Z

              Original sources

              1–6 / 6

              Hugging Face · Model repository ↗

              GitHub · Catalog ↗

              GitHub · Catalog ↗

              Hugging Face · Catalog ↗

              Hugging Face · Catalog ↗

              Hugging Face · Catalog ↗

              Source links

              1–5 / 5

              Explore more models

              Models

              Loading
              EVIDENCE / COMPARISON

              Benchmarks

              Explore every benchmark

              Loading

              These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

              Install TensorTrace