Ollama · granite3-guardian

## Granite guardian models The IBM Granite Guardian 3.0 **2B and 8B models** are designed to detect risks in prompts and/or responses. They can help with risk detection along many key dimensions cata…

ollama/granite3-guardian

## Granite guardian models

The IBM Granite Guardian 3.0 **2B and 8B models** are designed to detect risks in prompts and/or responses. They can help with risk detection along many key dimensions catalogued in the [IBM AI Risk Atlas](https://www.ibm.com/docs/en/watsonx/saas?topic=ai-risk-atlas). They are trained on unique data comprising human annotations and synthetic data informed by internal red-teaming, and they outperform other open-source models in the same space on standard benchmarks.

### Parameter Sizes

The model will produce a single output token, either `Yes` or `No`. By default, the general-purpose `harm` category is used, but other categories can be selected by setting the system prompt.

**2B:** ``` ollama run granite3-guardian:2b >>> /set system profanity ```

**8B:**

``` ollama run granite3-guardian:8b >>> /set system violence ```

### Supported Uses

* Risk detection in prompt text or model response (i.e. as guardrails), such as: * Harm (`harm`): content considered generally harmful * Social Bias (`social_bias`): prejudice based on identity or characteristics * Jailbreaking (`jailbreak`): deliberate instances of manipulating AI to generate harmful, undesired, or inappropriate content * Violence (`violence`): content promoting physical, mental, or sexual harm * Profanity (`profanity`): use of offensive language or insults * Sexual Content (`sexual_content`): explicit or suggestive material of a sexual nature * Unethical Behavior (`unethical_behavior`): actions that violate moral or legal standards

* RAG (retrieval-augmented generation) to assess: * Context relevance (`relevance`): whether the retrieved context is relevant to the query * Groundedness (`groundedness`): whether the response is accurate and faithful to the provided context * Answer relevance (`answer_relevance`): whether the response directly addresses the user's query

## Granite dense models

The Granite dense models are available in **2B and 8B** parameter sizes designed to support tool-based use cases and for retrieval augmented generation (RAG), streamlining code generation, translation and bug fixing.

[See model page](https://ollama.com/library/granite3-dense)

## Granite mixture of experts models

The Granite MoE models are available in **1B and 3B** parameter sizes designed for low latency usage and to support deployment in on-device applications or situations requiring instantaneous inference.

[See model page](https://ollama.com/library/granite3-moe)

## Learn more

- **Developers:** IBM Research - **GitHub Repository:** [ibm-granite/granite-guardian](https://github.com/ibm-granite/granite-guardian) - **Website**: [Granite Guardian Docs](https://www.ibm.com/granite/docs/models/guardian/) - **Cookbook**: [Granite Guardian Snack](https://github.com/ibm-granite-community/granite-snack-cookbook/blob/main/recipes/Granite_Guardian/Granite_Guardian_Detailed_Guide.ipynb) - **Release Date**: October 21st, 2024 - **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0).

Specifications & capabilities

Published model ID
granite3-guardian

Deployments & artifacts

1–10 / 10

ollama

source id
ollama
execution mode
local
parameter size
2.5B
parameter count
2500000000
parameter count is approximate
true
quantization level
Q8_0
context window
8000
context window is approximate
true
artifact size bytes
2694132783
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
2.5B
parameter count
2500000000
parameter count is approximate
true
quantization level
F16
context window
8000
context window is approximate
true
artifact size bytes
5069163183
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
2.5B
parameter count
2500000000
parameter count is approximate
true
quantization level
Q8_0
context window
8000
context window is approximate
true
artifact size bytes
2694132783
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
8.2B
parameter count
8200000000
parameter count is approximate
true
quantization level
Q5_K_M
context window
8000
context window is approximate
true
artifact size bytes
5797470735
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
8.2B
parameter count
8200000000
parameter count is approximate
true
quantization level
F16
context window
8000
context window is approximate
true
artifact size bytes
16344128175
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
8.2B
parameter count
8200000000
parameter count is approximate
true
quantization level
Q5_K_M
context window
8000
context window is approximate
true
artifact size bytes
5797470735
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
8.2B
parameter count
8200000000
parameter count is approximate
true
quantization level
Q5_K_S
context window
8000
context window is approximate
true
artifact size bytes
5647065615
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
8.2B
parameter count
8200000000
parameter count is approximate
true
quantization level
Q6_K
context window
8000
context window is approximate
true
artifact size bytes
6705472015
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
8.2B
parameter count
8200000000
parameter count is approximate
true
quantization level
Q8_0
context window
8000
context window is approximate
true
artifact size bytes
8684268975
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
2.5B
parameter count
2500000000
parameter count is approximate
true
quantization level
Q8_0
context window
8000
context window is approximate
true
artifact size bytes
2694132783
updated at
2026-11-16T08:10:06.079865+00:00

Original sources

1–2 / 2

Ollama · Model page ↗

Ollama · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace