Ollama · zephyr

<img src="https://github.com/jmorganca/ollama/assets/251292/8dab1157-909a-455b-a5c4-f7c31e9bcf0e" width="400" /> Zephyr is a series of language models that are trained to act as helpful assistants. Z…

ollama/zephyr

<img src="https://github.com/jmorganca/ollama/assets/251292/8dab1157-909a-455b-a5c4-f7c31e9bcf0e" width="400" />

Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr 141B-A35B is the latest model in the series, and is a fine-tuned version of [Mixtral 8x22b](https://ollama.com/library/mixtral:8x22b).

## Sizes

* `zephyr:141b`: A Mixture of Experts (MoE) model with 141B total parameters and 35B active parameters. * `zephyr:7b`: The original Zephyr model

## Source:

* [HuggingFace](https://huggingface.co/HuggingFaceH4)

Specifications & capabilities

Published model ID
zephyr

Deployments & artifacts

1–20 / 40

ollama

source id
ollama
execution mode
local
parameter size
141B
parameter count
141000000000
parameter count is approximate
true
quantization level
Q4_0
context window
64000
context window is approximate
true
artifact size bytes
79509225417
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
141B
parameter count
141000000000
parameter count is approximate
true
quantization level
Q4_0
context window
64000
context window is approximate
true
artifact size bytes
79509225417
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
141B
parameter count
141000000000
parameter count is approximate
true
quantization level
F16
context window
64000
context window is approximate
true
artifact size bytes
281243422633
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
141B
parameter count
141000000000
parameter count is approximate
true
quantization level
Q2_K
context window
64000
context window is approximate
true
artifact size bytes
52103176137
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
141B
parameter count
141000000000
parameter count is approximate
true
quantization level
Q4_0
context window
64000
context window is approximate
true
artifact size bytes
79509225417
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
141B
parameter count
141000000000
parameter count is approximate
true
quantization level
Q8_0
context window
64000
context window is approximate
true
artifact size bytes
149414809545
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q4_0
context window
32000
context window is approximate
true
artifact size bytes
4109854451
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q4_0
context window
32000
context window is approximate
true
artifact size bytes
4109854451
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
F16
context window
32000
context window is approximate
true
artifact size bytes
14485669555
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q2_K
context window
32000
context window is approximate
true
artifact size bytes
3084035827
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q3_K_L
context window
32000
context window is approximate
true
artifact size bytes
3822962419
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q3_K_M
context window
32000
context window is approximate
true
artifact size bytes
3519923955
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q3_K_S
context window
32000
context window is approximate
true
artifact size bytes
3165505267
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q4_0
context window
32000
context window is approximate
true
artifact size bytes
4109854451
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q4_1
context window
32000
context window is approximate
true
artifact size bytes
4554254067
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
32000
context window is approximate
true
artifact size bytes
4369377011
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q4_K_S
context window
32000
context window is approximate
true
artifact size bytes
4141311731
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q5_0
context window
32000
context window is approximate
true
artifact size bytes
4998653683
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q5_1
context window
32000
context window is approximate
true
artifact size bytes
5443053299
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
7B
parameter count
7000000000
parameter count is approximate
true
quantization level
Q5_K_M
context window
32000
context window is approximate
true
artifact size bytes
5132347123
updated at
2026-11-16T08:10:06.079865+00:00

Original sources

1–2 / 2

Ollama · Model page ↗

Ollama · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace