Ollama · mistral

<img src="https://github.com/jmorganca/ollama/assets/3325447/d6be0694-eb35-417b-8f08-47d3b6c2a171" width="200"/> Mistral is a 7B parameter model, distributed with the Apache license. It is available …

ollama/mistral

<img src="https://github.com/jmorganca/ollama/assets/3325447/d6be0694-eb35-417b-8f08-47d3b6c2a171" width="200"/>

Mistral is a 7B parameter model, distributed with the Apache license. It is available in both instruct (instruction following) and text completion.

The Mistral AI team has noted that Mistral 7B:

- Outperforms Llama 2 13B on all benchmarks - Outperforms Llama 1 34B on many benchmarks - Approaches CodeLlama 7B performance on code, while remaining good at English tasks

### Versions

| Tag | Date | Notes | | --------------- | ---------- | ----------------------------------------------------------- | | `v0.3` `latest` | 05/22/2024 | A new version of Mistral 7B that supports function calling. | | `v0.2` | 03/23/2024 | A minor release of Mistral 7B | | `v0.1` | 09/27/2023 | Initial release |

### Function calling

Mistral 0.3 supports function calling with Ollama's **raw mode**.

<sub>Example raw prompt</sub> ``` [AVAILABLE_TOOLS] [{"type": "function", "function": {"name": "get_current_weather", "description": "Get the current weather", "parameters": {"type": "object", "properties": {"location": {"type": "string", "description": "The city and state, e.g. San Francisco, CA"}, "format": {"type": "string", "enum": ["celsius", "fahrenheit"], "description": "The temperature unit to use. Infer this from the users location."}}, "required": ["location", "format"]}}}][/AVAILABLE_TOOLS][INST] What is the weather like today in San Francisco [/INST] ```

<sub>Example response</sub>

``` [TOOL_CALLS] [{"name": "get_current_weather", "arguments": {"location": "San Francisco, CA", "format": "celsius"}}] ```

For more information on raw mode, see the [API documentation](https://github.com/ollama/ollama/blob/main/docs/api.md#request-raw-mode).

### Variations

| | | | ---------- | ---------------------------------------------------------------------------------------------------------------------------------- | | `instruct` | Instruct models follow instructions | | `text` | Text models are the base foundation model without any fine-tuning for conversations, and are best used for simple text completion. |

## Usage

### CLI

Instruct:

``` ollama run mistral ```

### API

Example:

``` curl -X POST http://localhost:11434/api/generate -d '{ "model": "mistral", "prompt":"Here is a story about llamas eating grass" }' ```

## References

[HuggingFace](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)

[Mistral AI News Release](https://mistral.ai/news/announcing-mistral-7b/)

Specifications & capabilities

Published model ID
mistral

Deployments & artifacts

1–20 / 84

ollama

source id
ollama
execution mode
local
parameter size
7.2B
parameter count
7200000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
32000
context window is approximate
true
artifact size bytes
4372823897
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7.2B
parameter count
7200000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
32000
context window is approximate
true
artifact size bytes
4372823897
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
F16
context window
32000
context window is approximate
true
artifact size bytes
14485679813
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q2_K
context window
32000
context window is approximate
true
artifact size bytes
3084046085
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q3_K_L
context window
32000
context window is approximate
true
artifact size bytes
3822972677
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q3_K_M
context window
32000
context window is approximate
true
artifact size bytes
3519934213
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q3_K_S
context window
32000
context window is approximate
true
artifact size bytes
3165515525
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q4_0
context window
32000
context window is approximate
true
artifact size bytes
4109864709
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q4_1
context window
32000
context window is approximate
true
artifact size bytes
4554264325
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
32000
context window is approximate
true
artifact size bytes
4369387269
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q4_K_S
context window
32000
context window is approximate
true
artifact size bytes
4141321989
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q5_0
context window
32000
context window is approximate
true
artifact size bytes
4998663941
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q5_1
context window
32000
context window is approximate
true
artifact size bytes
5443063557
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q5_K_M
context window
32000
context window is approximate
true
artifact size bytes
5132357381
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q5_K_S
context window
32000
context window is approximate
true
artifact size bytes
4998663941
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q6_K
context window
32000
context window is approximate
true
artifact size bytes
5943013125
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q8_0
context window
32000
context window is approximate
true
artifact size bytes
7696805637
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
F16
context window
32000
context window is approximate
true
artifact size bytes
14485679812
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q2_K
context window
32000
context window is approximate
true
artifact size bytes
3084046052
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q3_K_L
context window
32000
context window is approximate
true
artifact size bytes
3822972644
updated at
2026-11-16T08:10:06.079865+00:00

Original sources

1–2 / 2

Ollama · Model page ↗

Ollama · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace