mistralai/Codestral-22B-v0.1

Explore mistralai/Codestral-22B-v0.1: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/mistralai/Codestral-22B-v0.1

Specifications & capabilities

Input
text
Output
text
Published model ID
Codestral-22B-v0.1

Evaluations

1–20 / 27

LLM Stats · GitHub archive

0.916

source id
llmStatsArchive
leaderboard name
HumanEvalFIM-Average · Normalized (reported)
dimension
general
metric
HumanEvalFIM-Average · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HumanEvalFIM-Average
language
en
modality
text
verified
false
max_score
1
categories
  • general
created_at
2025-07-19T19:56:15.160562+00:00
paper_link
https://arxiv.org/abs/2207.14255
updated_at
2025-07-19T19:56:15.160562+00:00
description
Average evaluation of HumanEval Fill-in-the-Middle benchmark variants (single-line, multi-line, random-span) for assessing code infilling capabilities of language models
benchmark_id
humanevalfim-average
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HumanEvalFIM-Average · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

LLM Stats · GitHub archive

0.916

source id
llmStatsArchive
leaderboard name
HumanEvalFIM-Average · Raw
dimension
general
metric
HumanEvalFIM-Average · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HumanEvalFIM-Average
language
en
modality
text
verified
false
max_score
1
categories
  • general
created_at
2025-07-19T19:56:15.160562+00:00
paper_link
https://arxiv.org/abs/2207.14255
updated_at
2025-07-19T19:56:15.160562+00:00
description
Average evaluation of HumanEval Fill-in-the-Middle benchmark variants (single-line, multi-line, random-span) for assessing code infilling capabilities of language models
benchmark_id
humanevalfim-average
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HumanEvalFIM-Average · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

LLM Stats · GitHub archive

0.635

source id
llmStatsArchive
leaderboard name
Spider · Normalized (reported)
dimension
general
metric
Spider · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Spider
language
en
modality
text
verified
false
max_score
1
categories
  • language
  • reasoning
created_at
2025-07-19T19:56:15.156791+00:00
paper_link
https://arxiv.org/abs/1809.08887
updated_at
2025-07-19T19:56:15.156791+00:00
description
A large-scale, complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 college students. Contains 10,181 questions and 5,693 unique complex SQL queries on 200 databases with multiple tables, covering 138 different domains. Requires models to generalize to both new SQL queries and new database schemas, making it distinct from previous semantic parsing tasks that use single databases.
benchmark_id
spider
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Spider · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

LLM Stats · GitHub archive

0.635

source id
llmStatsArchive
leaderboard name
Spider · Raw
dimension
general
metric
Spider · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Spider
language
en
modality
text
verified
false
max_score
1
categories
  • language
  • reasoning
created_at
2025-07-19T19:56:15.156791+00:00
paper_link
https://arxiv.org/abs/1809.08887
updated_at
2025-07-19T19:56:15.156791+00:00
description
A large-scale, complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 college students. Contains 10,181 questions and 5,693 unique complex SQL queries on 200 databases with multiple tables, covering 138 different domains. Requires models to generalize to both new SQL queries and new database schemas, making it distinct from previous semantic parsing tasks that use single databases.
benchmark_id
spider
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Spider · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

LLM Stats · GitHub archive

0.615

source id
llmStatsArchive
leaderboard name
HumanEval-Average · Raw
dimension
general
metric
HumanEval-Average · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HumanEval-Average
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
created_at
2025-07-19T19:56:15.171175+00:00
paper_link
https://arxiv.org/abs/2107.03374
updated_at
2025-07-19T19:56:15.171175+00:00
description
A variant of the HumanEval benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics
benchmark_id
humaneval-average
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HumanEval-Average · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

LLM Stats · GitHub archive

0.615

source id
llmStatsArchive
leaderboard name
HumanEval-Average · Normalized (reported)
dimension
general
metric
HumanEval-Average · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HumanEval-Average
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
created_at
2025-07-19T19:56:15.171175+00:00
paper_link
https://arxiv.org/abs/2107.03374
updated_at
2025-07-19T19:56:15.171175+00:00
description
A variant of the HumanEval benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics
benchmark_id
humaneval-average
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HumanEval-Average · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

LLM Stats · GitHub archive

0.513

source id
llmStatsArchive
leaderboard name
CruxEval-O · Normalized (reported)
dimension
general
metric
CruxEval-O · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
CruxEval-O
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
created_at
2025-07-19T19:56:15.146592+00:00
paper_link
https://arxiv.org/abs/2401.03065
updated_at
2025-07-19T19:56:15.146592+00:00
description
CruxEval-O is the output prediction task of the CRUXEval benchmark, designed to evaluate code reasoning, understanding, and execution capabilities. It consists of 800 Python functions (3-13 lines) where models must predict the output given a function and input. The benchmark tests fundamental code execution reasoning abilities and goes beyond simple code generation to assess deeper understanding of program behavior.
benchmark_id
cruxeval-o
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
CruxEval-O · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

LLM Stats · GitHub archive

0.513

source id
llmStatsArchive
leaderboard name
CruxEval-O · Raw
dimension
general
metric
CruxEval-O · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
CruxEval-O
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
created_at
2025-07-19T19:56:15.146592+00:00
paper_link
https://arxiv.org/abs/2401.03065
updated_at
2025-07-19T19:56:15.146592+00:00
description
CruxEval-O is the output prediction task of the CRUXEval benchmark, designed to evaluate code reasoning, understanding, and execution capabilities. It consists of 800 Python functions (3-13 lines) where models must predict the output given a function and input. The benchmark tests fundamental code execution reasoning abilities and goes beyond simple code generation to assess deeper understanding of program behavior.
benchmark_id
cruxeval-o
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
CruxEval-O · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

LLM Stats · GitHub archive

0.34

source id
llmStatsArchive
leaderboard name
RepoBench · Normalized (reported)
dimension
general
metric
RepoBench · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
RepoBench
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • code
created_at
2025-07-19T19:56:15.152588+00:00
paper_link
https://arxiv.org/abs/2306.03091
updated_at
2025-07-19T19:56:15.152588+00:00
description
RepoBench is a benchmark for evaluating repository-level code auto-completion systems through three interconnected tasks: RepoBench-R (retrieval of relevant code snippets across files), RepoBench-C (code completion with cross-file and in-file context), and RepoBench-P (pipeline combining retrieval and prediction). Supports Python and Java programming languages and addresses the gap in evaluating real-world, multi-file programming scenarios by providing a more complete comparison of performance in auto-completion systems.
benchmark_id
repobench
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
RepoBench · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

LLM Stats · GitHub archive

0.34

source id
llmStatsArchive
leaderboard name
RepoBench · Raw
dimension
general
metric
RepoBench · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
RepoBench
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • code
created_at
2025-07-19T19:56:15.152588+00:00
paper_link
https://arxiv.org/abs/2306.03091
updated_at
2025-07-19T19:56:15.152588+00:00
description
RepoBench is a benchmark for evaluating repository-level code auto-completion systems through three interconnected tasks: RepoBench-R (retrieval of relevant code snippets across files), RepoBench-C (code completion with cross-file and in-file context), and RepoBench-P (pipeline combining retrieval and prediction). Supports Python and Java programming languages and addresses the gap in evaluating real-world, multi-file programming scenarios by providing a more complete comparison of performance in auto-completion systems.
benchmark_id
repobench
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
RepoBench · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

LLM Stats · GitHub archive

0.782

source id
llmStatsArchive
leaderboard name
MBPP · Normalized (reported)
dimension
general
metric
MBPP · Normalized (reported)
rank
3
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MBPP
language
en
modality
text
verified
false
max_score
100
categories
  • reasoning
  • general
created_at
2025-07-19T19:56:13.453370+00:00
paper_link
https://arxiv.org/abs/2108.07732
updated_at
2025-07-19T19:56:13.453370+00:00
description
MBPP (Mostly Basic Python Problems) is a benchmark of 974 crowd-sourced Python programming problems designed to be solvable by entry-level programmers. Each problem consists of a task description, code solution, and 3 automated test cases covering programming fundamentals and standard library functionality.
benchmark_id
mbpp
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MBPP · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

LLM Stats · GitHub archive

0.782

source id
llmStatsArchive
leaderboard name
MBPP · Raw
dimension
general
metric
MBPP · Raw
rank
3
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MBPP
language
en
modality
text
verified
false
max_score
100
categories
  • reasoning
  • general
created_at
2025-07-19T19:56:13.453370+00:00
paper_link
https://arxiv.org/abs/2108.07732
updated_at
2025-07-19T19:56:13.453370+00:00
description
MBPP (Mostly Basic Python Problems) is a benchmark of 974 crowd-sourced Python programming problems designed to be solvable by entry-level programmers. Each problem consists of a task description, code solution, and 3 automated test cases covering programming fundamentals and standard library functionality.
benchmark_id
mbpp
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MBPP · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

LLM Stats · GitHub archive

0.811

source id
llmStatsArchive
leaderboard name
HumanEval · Raw
dimension
general
metric
HumanEval · Raw
rank
7
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HumanEval
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • code
created_at
2025-07-19T19:56:12.595263+00:00
paper_link
https://arxiv.org/abs/2107.03374
updated_at
2025-07-19T19:56:12.595263+00:00
description
A benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics
benchmark_id
humaneval
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HumanEval · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
10
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

LLM Stats · GitHub archive

0.811

source id
llmStatsArchive
leaderboard name
HumanEval · Normalized (reported)
dimension
general
metric
HumanEval · Normalized (reported)
rank
7
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HumanEval
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • code
created_at
2025-07-19T19:56:12.595263+00:00
paper_link
https://arxiv.org/abs/2107.03374
updated_at
2025-07-19T19:56:12.595263+00:00
description
A benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics
benchmark_id
humaneval
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HumanEval · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/codestral-22b/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/codestral/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/codestral-22b
metric_population
10
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
codestral-22b
Original result ↗

Open LLM Leaderboard v2

57.718%

source id
openLLMLeaderboardV2
leaderboard name
Open LLM v2 IFEval · Raw
dimension
instructionFollowing
metric
Raw accuracy
rank
1376
aggregation scope
suite
Open LLM v2
co2_kg
2.6133391218762
status
archived
precision
bfloat16
task_count
6
metric_kind
Raw accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2025-03-20T12:17:27Z
chat_template
true
suite_version
2
model_revision
8f5fe23af91885222a1563283c87416745a5e212
source_flagged
false
missing_metrics
    dataset_revision
    9c09a7cae43334062a82cb164f2ef255013dafa2
    metric_population
    4576
    ranking_population
    4576
    source_flag_anomaly
    false
    source model id
    mistralai/Codestral-22B-v0.1
    Original result ↗

    Open LLM Leaderboard v2

    57.718%

    source id
    openLLMLeaderboardV2
    leaderboard name
    Open LLM v2 IFEval · Normalized
    dimension
    instructionFollowing
    metric
    Normalized score
    rank
    1376
    aggregation scope
    suite
    Open LLM v2
    co2_kg
    2.6133391218762
    status
    archived
    precision
    bfloat16
    task_count
    6
    metric_kind
    Normalized score
    rank_method
    Derived competition rank over published evaluations with reported scores, including variants and source flags
    weight_type
    Original
    published_at
    2025-03-20T12:17:27Z
    chat_template
    true
    suite_version
    2
    model_revision
    8f5fe23af91885222a1563283c87416745a5e212
    source_flagged
    false
    missing_metrics
      dataset_revision
      9c09a7cae43334062a82cb164f2ef255013dafa2
      metric_population
      4576
      ranking_population
      4576
      source_flag_anomaly
      false
      source model id
      mistralai/Codestral-22B-v0.1
      Original result ↗

      Open LLM Leaderboard v2

      41.871%

      source id
      openLLMLeaderboardV2
      leaderboard name
      Open LLM v2 MUSR · Raw
      dimension
      reasoning
      metric
      Raw accuracy
      rank
      1849
      aggregation scope
      suite
      Open LLM v2
      co2_kg
      2.6133391218762
      status
      archived
      precision
      bfloat16
      task_count
      6
      metric_kind
      Raw accuracy
      rank_method
      Derived competition rank over published evaluations with reported scores, including variants and source flags
      weight_type
      Original
      published_at
      2025-03-20T12:17:27Z
      chat_template
      true
      suite_version
      2
      model_revision
      8f5fe23af91885222a1563283c87416745a5e212
      source_flagged
      false
      missing_metrics
        dataset_revision
        9c09a7cae43334062a82cb164f2ef255013dafa2
        metric_population
        4576
        ranking_population
        4576
        source_flag_anomaly
        false
        source model id
        mistralai/Codestral-22B-v0.1
        Original result ↗

        Open LLM Leaderboard v2

        51.391%

        source id
        openLLMLeaderboardV2
        leaderboard name
        Open LLM v2 BBH · Raw
        dimension
        reasoning
        metric
        Raw accuracy
        rank
        2016
        aggregation scope
        suite
        Open LLM v2
        co2_kg
        2.6133391218762
        status
        archived
        precision
        bfloat16
        task_count
        6
        metric_kind
        Raw accuracy
        rank_method
        Derived competition rank over published evaluations with reported scores, including variants and source flags
        weight_type
        Original
        published_at
        2025-03-20T12:17:27Z
        chat_template
        true
        suite_version
        2
        model_revision
        8f5fe23af91885222a1563283c87416745a5e212
        source_flagged
        false
        missing_metrics
          dataset_revision
          9c09a7cae43334062a82cb164f2ef255013dafa2
          metric_population
          4576
          ranking_population
          4576
          source_flag_anomaly
          false
          source model id
          mistralai/Codestral-22B-v0.1
          Original result ↗

          Open LLM Leaderboard v2

          23.28%

          source id
          openLLMLeaderboardV2
          leaderboard name
          Open LLM v2 Average
          dimension
          general
          metric
          Normalized six-task average
          rank
          2028
          aggregation scope
          suite
          Open LLM v2
          co2_kg
          2.6133391218762
          status
          archived
          precision
          bfloat16
          task_count
          6
          metric_kind
          Normalized six-task average
          rank_method
          Derived competition rank over published evaluations with reported scores, including variants and source flags
          weight_type
          Original
          published_at
          2025-03-20T12:17:27Z
          chat_template
          true
          suite_version
          2
          model_revision
          8f5fe23af91885222a1563283c87416745a5e212
          source_flagged
          false
          missing_metrics
            dataset_revision
            9c09a7cae43334062a82cb164f2ef255013dafa2
            metric_population
            4576
            ranking_population
            4576
            source_flag_anomaly
            false
            source model id
            mistralai/Codestral-22B-v0.1
            Original result ↗

            Open LLM Leaderboard v2

            29.866%

            source id
            openLLMLeaderboardV2
            leaderboard name
            Open LLM v2 GPQA · Raw
            dimension
            knowledge
            metric
            Raw accuracy
            rank
            2057
            aggregation scope
            suite
            Open LLM v2
            co2_kg
            2.6133391218762
            status
            archived
            precision
            bfloat16
            task_count
            6
            metric_kind
            Raw accuracy
            rank_method
            Derived competition rank over published evaluations with reported scores, including variants and source flags
            weight_type
            Original
            published_at
            2025-03-20T12:17:27Z
            chat_template
            true
            suite_version
            2
            model_revision
            8f5fe23af91885222a1563283c87416745a5e212
            source_flagged
            false
            missing_metrics
              dataset_revision
              9c09a7cae43334062a82cb164f2ef255013dafa2
              metric_population
              4576
              ranking_population
              4576
              source_flag_anomaly
              false
              source model id
              mistralai/Codestral-22B-v0.1
              Original result ↗

              Safety assessments

              1–1 / 1

              Foundation Model Transparency Index 2025 ↗

              18 / 100

              source id
              stanfordFMTI
              canonical model id
              huggingface/mistralai/Codestral-22B-v0.1
              taxonomy
              transparency
              hazard category
              transparency
              hazard name
              Organization transparency
              policy area
              Mistral
              assessment type
              organization-level disclosure
              metric
              disclosure_score
              result label
              18 / 100
              sample size
              100
              updated at
              2026-11-09T18:08:05.227Z

              Original sources

              1–4 / 4

              Hugging Face · Model repository ↗

              GitHub · Catalog ↗

              GitHub · Catalog ↗

              Hugging Face · Catalog ↗

              Source links

              1–3 / 3

              Explore more models

              Models

              Loading
              EVIDENCE / COMPARISON

              Benchmarks

              Explore every benchmark

              Loading

              These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

              Install TensorTrace