Mistral Large 2407

This is Mistral AI's flagship model, Mistral Large 2 (version mistral-large-2407). It's a proprietary weights-available model and excels at reasoning, code, JSON, chat, and more. Read the launch anno…

mistralai/mistral-large-2407

This is Mistral AI's flagship model, Mistral Large 2 (version mistral-large-2407). It's a proprietary weights-available model and excels at reasoning, code, JSON, chat, and more. Read the launch announcement [here](https://mistral.ai/news/mistral-large-2407/).

It supports dozens of languages including French, German, Spanish, Italian, Portuguese, Arabic, Hindi, Russian, Chinese, Japanese, and Korean, along with 80+ coding languages including Python, Java, C, C++, JavaScript, and Bash. Its long context window allows precise information recall from large documents.

Specifications & capabilities

Input
text, file
Output
text
Context window · tokens
131072
Knowledge cutoff
2024-03-31
Published model ID
Mistral-Large-Instruct-2407
Capabilities
fileInput, multimodal, promptCaching, structuredOutputs, toolCalling
Description source ↗

Evaluations

1–13 / 13

LLM Stats · GitHub archive

0.828

source id
llmStatsArchive
leaderboard name
MMLU French · Raw
dimension
general
metric
MMLU French · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
fr
benchmark
name
MMLU French
language
fr
modality
text
verified
false
max_score
1
categories
  • language
  • reasoning
  • math
  • general
created_at
2025-07-19T19:56:15.175211+00:00
paper_link
https://arxiv.org/abs/2009.03300
updated_at
2025-07-19T19:56:15.175211+00:00
description
French language variant of the Massive Multitask Language Understanding benchmark, evaluating language models across 57 tasks including elementary mathematics, US history, computer science, law, and other professional and academic subjects. This multilingual version tests model performance in French.
benchmark_id
mmlu-french
multilingual
true
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MMLU French · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/mistral-large-2-2407/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/mistralai/Mistral-Large-Instruct-2407
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/mistral-large-2-2407
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
mistral-large-2-2407
Original result ↗

LLM Stats · GitHub archive

0.828

source id
llmStatsArchive
leaderboard name
MMLU French · Normalized (reported)
dimension
general
metric
MMLU French · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
fr
benchmark
name
MMLU French
language
fr
modality
text
verified
false
max_score
1
categories
  • language
  • reasoning
  • math
  • general
created_at
2025-07-19T19:56:15.175211+00:00
paper_link
https://arxiv.org/abs/2009.03300
updated_at
2025-07-19T19:56:15.175211+00:00
description
French language variant of the Massive Multitask Language Understanding benchmark, evaluating language models across 57 tasks including elementary mathematics, US history, computer science, law, and other professional and academic subjects. This multilingual version tests model performance in French.
benchmark_id
mmlu-french
multilingual
true
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MMLU French · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/mistral-large-2-2407/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/mistralai/Mistral-Large-Instruct-2407
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/mistral-large-2-2407
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
mistral-large-2-2407
Original result ↗

LLM Stats · GitHub archive

0.92

source id
llmStatsArchive
leaderboard name
HumanEval · Normalized (reported)
dimension
general
metric
HumanEval · Normalized (reported)
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HumanEval
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • code
created_at
2025-07-19T19:56:12.595263+00:00
paper_link
https://arxiv.org/abs/2107.03374
updated_at
2025-07-19T19:56:12.595263+00:00
description
A benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics
benchmark_id
humaneval
multilingual
false
analysis_method
Pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HumanEval · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/mistral-large-2-2407/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/mistralai/Mistral-Large-Instruct-2407
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/mistral-large-2-2407
metric_population
9
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
mistral-large-2-2407
Original result ↗

LLM Stats · GitHub archive

0.92

source id
llmStatsArchive
leaderboard name
HumanEval · Raw
dimension
general
metric
HumanEval · Raw
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HumanEval
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • code
created_at
2025-07-19T19:56:12.595263+00:00
paper_link
https://arxiv.org/abs/2107.03374
updated_at
2025-07-19T19:56:12.595263+00:00
description
A benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics
benchmark_id
humaneval
multilingual
false
analysis_method
Pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HumanEval · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/mistral-large-2-2407/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/mistralai/Mistral-Large-Instruct-2407
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/mistral-large-2-2407
metric_population
9
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
mistral-large-2-2407
Original result ↗

LLM Stats · GitHub archive

0.93

source id
llmStatsArchive
leaderboard name
GSM8k · Raw
dimension
general
metric
GSM8k · Raw
rank
3
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
GSM8k
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-07-19T19:56:11.397385+00:00
paper_link
https://arxiv.org/abs/2110.14168
updated_at
2025-07-19T19:56:11.397385+00:00
description
Grade School Math 8K, a dataset of 8.5K high-quality linguistically diverse grade school math word problems requiring multi-step reasoning and elementary arithmetic operations.
benchmark_id
gsm8k
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
GSM8k · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/mistral-large-2-2407/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/mistralai/Mistral-Large-Instruct-2407
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/mistral-large-2-2407
metric_population
7
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
mistral-large-2-2407
Original result ↗

LLM Stats · GitHub archive

0.93

source id
llmStatsArchive
leaderboard name
GSM8k · Normalized (reported)
dimension
general
metric
GSM8k · Normalized (reported)
rank
3
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
GSM8k
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-07-19T19:56:11.397385+00:00
paper_link
https://arxiv.org/abs/2110.14168
updated_at
2025-07-19T19:56:11.397385+00:00
description
Grade School Math 8K, a dataset of 8.5K high-quality linguistically diverse grade school math word problems requiring multi-step reasoning and elementary arithmetic operations.
benchmark_id
gsm8k
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
GSM8k · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/mistral-large-2-2407/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/mistralai/Mistral-Large-Instruct-2407
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/mistral-large-2-2407
metric_population
7
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
mistral-large-2-2407
Original result ↗

LLM Stats · GitHub archive

0.84

source id
llmStatsArchive
leaderboard name
MMLU · Raw
dimension
general
metric
MMLU · Raw
rank
4
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MMLU
language
en
modality
text
verified
false
max_score
1
categories
  • general
  • reasoning
  • language
  • math
created_at
2025-07-19T19:56:11.200416+00:00
paper_link
https://arxiv.org/abs/2009.03300
updated_at
2025-07-19T19:56:11.200416+00:00
description
Massive Multitask Language Understanding benchmark testing knowledge across 57 diverse subjects including STEM, humanities, social sciences, and professional domains
benchmark_id
mmlu
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MMLU · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/mistral-large-2-2407/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/mistral-large-2407/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/mistral-large-2-2407
metric_population
8
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
mistral-large-2-2407
Original result ↗

LLM Stats · GitHub archive

0.84

source id
llmStatsArchive
leaderboard name
MMLU · Normalized (reported)
dimension
general
metric
MMLU · Normalized (reported)
rank
4
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MMLU
language
en
modality
text
verified
false
max_score
1
categories
  • general
  • reasoning
  • language
  • math
created_at
2025-07-19T19:56:11.200416+00:00
paper_link
https://arxiv.org/abs/2009.03300
updated_at
2025-07-19T19:56:11.200416+00:00
description
Massive Multitask Language Understanding benchmark testing knowledge across 57 diverse subjects including STEM, humanities, social sciences, and professional domains
benchmark_id
mmlu
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MMLU · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/mistral/models/mistral-large-2-2407/benchmarks.json
archive_kind
llmStats
evidence_url
https://mistral.ai/news/mistral-large-2407/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
mistral/mistral-large-2-2407
metric_population
8
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
mistral-large-2-2407
Original result ↗

LiveBench

46.875%

source id
liveBench
leaderboard name
LiveBench Coding
dimension
coding
metric
Average score
rank
55
sample size
128
evaluated at
2024-12-10T19:07:20.212Z
source model id
mistral-large-2407
Original result ↗

LiveBench

45.806%

source id
liveBench
leaderboard name
LiveBench Overall
dimension
general
metric
Average score
rank
62
sample size
393
evaluated at
2024-12-10T19:31:49.974Z
source model id
mistral-large-2407
Original result ↗

LiveBench

36.808%

source id
liveBench
leaderboard name
LiveBench Language
dimension
intelligence
metric
Average score
rank
73
sample size
190
evaluated at
2024-12-10T19:31:44.597Z
source model id
mistral-large-2407
Original result ↗

LiveBench

66.778%

source id
liveBench
leaderboard name
LiveBench Instruction Following
dimension
general
metric
Average score
rank
84
sample size
75
evaluated at
2024-12-10T19:31:49.974Z
source model id
mistral-large-2407
Original result ↗

Published prices

1–3 / 3

Safety assessments

1–1 / 1

Foundation Model Transparency Index 2025 ↗

18 / 100

source id
stanfordFMTI
canonical model id
mistralai/mistral-large-2407
taxonomy
transparency
hazard category
transparency
hazard name
Organization transparency
policy area
Mistral
assessment type
organization-level disclosure
metric
disclosure_score
result label
18 / 100
sample size
100
updated at
2026-11-09T18:08:05.227Z

Source specification observations

1–3 / 3

openRouter ↗

field
context_length
value
131072
normalized value
131072
scope
source-model
source id
openRouter
confidence
1

openRouter ↗

field
knowledge_cutoff
reported field
knowledge_cutoff
value
2024-03-31
normalized value
2024-03-31
precision
day
scope
source-model
source id
openRouter
confidence
1

openRouter ↗

field
max_output_tokens
value
104857
normalized value
104857
scope
source-model
source id
openRouter
confidence
1

Original sources

1–6 / 6

Hugging Face · mistralai/Mistral-Large-Instruct-2407 ↗

OpenRouter · Model page ↗

GitHub · Catalog ↗

GitHub · Catalog ↗

OpenRouter · Catalog ↗

livebench.ai · Catalog ↗

Source links

1–6 / 6

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace