Ollama · granite3-moe

![An illustration of Ollama holding a beautiful flower with the IBM Rebus logo of the Eye, Bee and M, made by Paul Rand.](https://ollama.com/assets/library/granite3-moe/6ea49528-3ff2-4fcc-98b2-01f610…

ollama/granite3-moe

![An illustration of Ollama holding a beautiful flower with the IBM Rebus logo of the Eye, Bee and M, made by Paul Rand.](https://ollama.com/assets/library/granite3-moe/6ea49528-3ff2-4fcc-98b2-01f6104254d2)

### Granite mixture of experts models

The IBM Granite **1B and 3B models** are the first mixture of experts (MoE) Granite models from IBM designed for low latency usage.

The models are trained on over 10 trillion tokens of data, the Granite MoE models are ideal for deployment in on-device applications or situations requiring instantaneous inference.

## Parameter Sizes

**1B:** `ollama run granite3-moe:1b`

**3B:**

`ollama run granite3-moe:3b`

## Supported Languages English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, Chinese (Simplified)

### Capabilities * Summarization * Text classification * Text extraction * Question-answering * Retrieval Augmented Generation (RAG) * Code related * Function-calling * Multilingual dialog use cases

### Granite dense models

The Granite dense models are available in **2B and 8B** parameter sizes designed to support tool-based use cases and for retrieval augmented generation (RAG), streamlining code generation, translation and bug fixing.

[See model page](https://ollama.com/library/granite3-dense)

### Learn more

- **Developers:** IBM Research - **GitHub Repository:** [ibm-granite/granite-3.0-language-models](https://github.com/ibm-granite/granite-3.0-language-models) - **Website**: [Granite Docs](https://www.ibm.com/granite/docs/) - **Release Date**: October 21st, 2024 - **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0).

Specifications & capabilities

Published model ID
granite3-moe

Deployments & artifacts

1–20 / 33

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
4000
context window is approximate
true
artifact size bytes
821856746
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
F16
context window
4000
context window is approximate
true
artifact size bytes
2672678922
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q2_K
context window
4000
context window is approximate
true
artifact size bytes
512248298
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q3_K_L
context window
4000
context window is approximate
true
artifact size bytes
711412202
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q3_K_M
context window
4000
context window is approximate
true
artifact size bytes
658590186
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q3_K_S
context window
4000
context window is approximate
true
artifact size bytes
597871082
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q4_0
context window
4000
context window is approximate
true
artifact size bytes
768330218
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q4_1
context window
4000
context window is approximate
true
artifact size bytes
848546282
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
4000
context window is approximate
true
artifact size bytes
821856746
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q4_K_S
context window
4000
context window is approximate
true
artifact size bytes
774883818
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q5_0
context window
4000
context window is approximate
true
artifact size bytes
928762346
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q5_1
context window
4000
context window is approximate
true
artifact size bytes
1008978410
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q5_K_M
context window
4000
context window is approximate
true
artifact size bytes
956336618
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q5_K_S
context window
4000
context window is approximate
true
artifact size bytes
928762346
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q6_K
context window
4000
context window is approximate
true
artifact size bytes
1099221482
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q8_0
context window
4000
context window is approximate
true
artifact size bytes
1422249162
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
3.4B
parameter count
3400000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
4000
context window is approximate
true
artifact size bytes
2059367771
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
3.4B
parameter count
3400000000
parameter count is approximate
true
quantization level
F16
context window
4000
context window is approximate
true
artifact size bytes
6754477147
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
3.4B
parameter count
3400000000
parameter count is approximate
true
quantization level
Q2_K
context window
4000
context window is approximate
true
artifact size bytes
1266151739
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
3.4B
parameter count
3400000000
parameter count is approximate
true
quantization level
Q3_K_L
context window
4000
context window is approximate
true
artifact size bytes
1773990651
updated at
2026-11-16T08:10:06.079865+00:00

Original sources

1–2 / 2

Ollama · Model page ↗

Ollama · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace