Mistral: Mistral Nemo
A 12B parameter model with a 128k token context length built by Mistral in collaboration with NVIDIA. The model is multilingual, supporting English, French, German, Spanish, Italian, Portuguese, Chin…
mistralai/mistral-nemo
A 12B parameter model with a 128k token context length built by Mistral in collaboration with NVIDIA. The model is multilingual, supporting English, French, German, Spanish, Italian, Portuguese, Chinese, Japanese,...
Specifications & capabilities
- Input
- text
- Output
- text
- Context window · tokens
- 131072
- Knowledge cutoff
- 2024-04-30
- Published model ID
- Mistral-Nemo-Instruct-2407
- Capabilities
- structuredOutputs, toolCalling
Evaluations
1–13 / 13
63.802%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 IFEval · Normalized
- dimension
- instructionFollowing
- metric
- Normalized score
- rank
- 1082
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 4.468047939362798
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 4d14c1db68fe20dbf80b8eca85d39b909c5fe1d5
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- mistralai/Mistral-Nemo-Instruct-2407
Original result ↗63.802%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 IFEval · Raw
- dimension
- instructionFollowing
- metric
- Raw accuracy
- rank
- 1082
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 4.468047939362798
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 4d14c1db68fe20dbf80b8eca85d39b909c5fe1d5
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- mistralai/Mistral-Nemo-Instruct-2407
Original result ↗24.666%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 Average
- dimension
- general
- metric
- Normalized six-task average
- rank
- 1676
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 4.468047939362798
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized six-task average
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 4d14c1db68fe20dbf80b8eca85d39b909c5fe1d5
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- mistralai/Mistral-Nemo-Instruct-2407
Original result ↗12.689%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MATH Lvl 5 · Raw
- dimension
- math
- metric
- Raw accuracy
- rank
- 1972
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 4.468047939362798
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 4d14c1db68fe20dbf80b8eca85d39b909c5fe1d5
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- mistralai/Mistral-Nemo-Instruct-2407
Original result ↗12.689%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MATH Lvl 5 · Normalized
- dimension
- math
- metric
- Normalized score
- rank
- 1972
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 4.468047939362798
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 4d14c1db68fe20dbf80b8eca85d39b909c5fe1d5
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- mistralai/Mistral-Nemo-Instruct-2407
Original result ↗35.173%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MMLU-PRO · Raw
- dimension
- knowledge
- metric
- Raw accuracy
- rank
- 2192
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 4.468047939362798
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 4d14c1db68fe20dbf80b8eca85d39b909c5fe1d5
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- mistralai/Mistral-Nemo-Instruct-2407
Original result ↗27.97%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MMLU-PRO · Normalized
- dimension
- knowledge
- metric
- Normalized score
- rank
- 2192
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 4.468047939362798
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 4d14c1db68fe20dbf80b8eca85d39b909c5fe1d5
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- mistralai/Mistral-Nemo-Instruct-2407
Original result ↗29.68%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 BBH · Normalized
- dimension
- reasoning
- metric
- Normalized score
- rank
- 2258
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 4.468047939362798
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 4d14c1db68fe20dbf80b8eca85d39b909c5fe1d5
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- mistralai/Mistral-Nemo-Instruct-2407
Original result ↗50.365%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 BBH · Raw
- dimension
- reasoning
- metric
- Raw accuracy
- rank
- 2290
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 4.468047939362798
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 4d14c1db68fe20dbf80b8eca85d39b909c5fe1d5
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- mistralai/Mistral-Nemo-Instruct-2407
Original result ↗29.027%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 GPQA · Raw
- dimension
- knowledge
- metric
- Raw accuracy
- rank
- 2486
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 4.468047939362798
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 4d14c1db68fe20dbf80b8eca85d39b909c5fe1d5
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- mistralai/Mistral-Nemo-Instruct-2407
Original result ↗5.369%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 GPQA · Normalized
- dimension
- knowledge
- metric
- Normalized score
- rank
- 2486
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 4.468047939362798
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 4d14c1db68fe20dbf80b8eca85d39b909c5fe1d5
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- mistralai/Mistral-Nemo-Instruct-2407
Original result ↗8.483%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MUSR · Normalized
- dimension
- reasoning
- metric
- Normalized score
- rank
- 2706
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 4.468047939362798
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 4d14c1db68fe20dbf80b8eca85d39b909c5fe1d5
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- mistralai/Mistral-Nemo-Instruct-2407
Original result ↗39%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MUSR · Raw
- dimension
- reasoning
- metric
- Raw accuracy
- rank
- 2958
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 4.468047939362798
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 4d14c1db68fe20dbf80b8eca85d39b909c5fe1d5
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- mistralai/Mistral-Nemo-Instruct-2407
Original result ↗Published prices
1–2 / 2
$0.03
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
$0.03
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
Provider specifications & access
1–8 / 8
- source model id
- azure-huggingface/mistralai--mistral-nemo-instruct-2407@1
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 131072
- source model id
- azure-huggingface/mistralai--mistral-nemo-instruct-2407@2
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 131072
- source model id
- azure-huggingface/mistralai--mistral-nemo-instruct-2407@3
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 131072
- source model id
- azure-huggingface/mistralai--mistral-nemo-instruct-2407@4
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 131072
- source model id
- azure-huggingface/mistralai--mistral-nemo-instruct-2407@5
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 131072
- source model id
- azure-huggingface/mistralai--mistral-nemo-instruct-2407@6
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 131072
- source model id
- azure-huggingface/mistralai--mistral-nemo-instruct-2407@7
- hosting
- foundry-managed-compute
- license
- apache-2.0
- context length
- 131072
- source model id
- publishers/mistral-ai/models/mistral@mistral-nemo-instruct-2407
- hosting
- vertex-self-deployed
Safety assessments
1–1 / 1
18 / 100
- source id
- stanfordFMTI
- canonical model id
- mistralai/mistral-nemo
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Mistral
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 18 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–10 / 10
- field
- context_length
- value
- 131072
- normalized value
- 131072
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 131072
- normalized value
- 131072
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 131072
- normalized value
- 131072
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 131072
- normalized value
- 131072
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 131072
- normalized value
- 131072
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 131072
- normalized value
- 131072
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 131072
- normalized value
- 131072
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 131072
- normalized value
- 131072
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-04-30
- normalized value
- 2024-04-30
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 16384
- normalized value
- 16384
- scope
- source-model
- source id
- openRouter
- confidence
- 1
Explore more models