Ollama · granite3.1-moe

## Granite mixture of experts models The IBM Granite **1B and 3B models** are long-context mixture of experts (MoE) Granite models from IBM designed for low latency usage. The models are trained on o…

ollama/granite3.1-moe

## Granite mixture of experts models

The IBM Granite **1B and 3B models** are long-context mixture of experts (MoE) Granite models from IBM designed for low latency usage.

The models are trained on over 10 trillion tokens of data, the Granite MoE models are ideal for deployment in on-device applications or situations requiring instantaneous inference.

### Parameter Sizes

**1B:** `ollama run granite3.1-moe:1b`

**3B:**

`ollama run granite3.1-moe:3b`

### Supported Languages English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, Chinese (Simplified)

### Capabilities * Summarization * Text classification * Text extraction * Question-answering * Retrieval Augmented Generation (RAG) * Code related tasks * Function-calling tasks * Multilingual dialog use cases * Long-context tasks including long document/meeting summarization, long document QA, etc.

## Granite dense models

The Granite dense models are available in **2B and 8B** parameter sizes designed to support tool-based use cases and for retrieval augmented generation (RAG), streamlining code generation, translation and bug fixing.

[See model page](https://ollama.com/library/granite3-dense)

## Learn more

- **Developers:** IBM Research - **GitHub Repository:** [ibm-granite/granite-language-models](https://github.com/ibm-granite/granite-3.1-language-models) - **Website**: [Granite Docs](https://www.ibm.com/granite/docs/) - **Release Date**: December 18th, 2024 - **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0).

Specifications & capabilities

Published model ID
granite3.1-moe

Deployments & artifacts

1–20 / 33

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q8_0
context window
128000
context window is approximate
true
artifact size bytes
1422252587
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
F16
context window
128000
context window is approximate
true
artifact size bytes
2672682347
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q2_K
context window
128000
context window is approximate
true
artifact size bytes
524442155
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q3_K_L
context window
128000
context window is approximate
true
artifact size bytes
723606059
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q3_K_M
context window
128000
context window is approximate
true
artifact size bytes
670784043
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q3_K_S
context window
128000
context window is approximate
true
artifact size bytes
610064939
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q4_0
context window
128000
context window is approximate
true
artifact size bytes
780524075
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q4_1
context window
128000
context window is approximate
true
artifact size bytes
860740139
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
128000
context window is approximate
true
artifact size bytes
834050603
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q4_K_S
context window
128000
context window is approximate
true
artifact size bytes
787077675
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q5_0
context window
128000
context window is approximate
true
artifact size bytes
940956203
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q5_1
context window
128000
context window is approximate
true
artifact size bytes
1021172267
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q5_K_M
context window
128000
context window is approximate
true
artifact size bytes
968530475
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q5_K_S
context window
128000
context window is approximate
true
artifact size bytes
940956203
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q6_K
context window
128000
context window is approximate
true
artifact size bytes
1111415339
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
1.3B
parameter count
1300000000
parameter count is approximate
true
quantization level
Q8_0
context window
128000
context window is approximate
true
artifact size bytes
1422252587
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
3.3B
parameter count
3300000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
128000
context window is approximate
true
artifact size bytes
2035186859
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
3.3B
parameter count
3300000000
parameter count is approximate
true
quantization level
F16
context window
128000
context window is approximate
true
artifact size bytes
6603476363
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
3.3B
parameter count
3300000000
parameter count is approximate
true
quantization level
Q2_K
context window
128000
context window is approximate
true
artifact size bytes
1259666603
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
3.3B
parameter count
3300000000
parameter count is approximate
true
quantization level
Q3_K_L
context window
128000
context window is approximate
true
artifact size bytes
1759837355
updated at
2026-11-16T08:10:06.079865+00:00

Original sources

1–2 / 2

Ollama · Model page ↗

Ollama · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace