Ollama · nemotron-mini

<img src="https://ollama.com/assets/library/nemotron-mini/4e0ea563-a507-45e7-ad0b-b083918ec11b" width="320" /> Nemotron-Mini-4B-Instruct is a model for generating responses for roleplaying, retrieval…

ollama/nemotron-mini

<img src="https://ollama.com/assets/library/nemotron-mini/4e0ea563-a507-45e7-ad0b-b083918ec11b" width="320" />

Nemotron-Mini-4B-Instruct is a model for generating responses for roleplaying, retrieval augmented generation, and function calling. It is a small language model (SLM) optimized through distillation, pruning and quantization for speed and on-device deployment.

This instruct model is optimized for roleplay, RAG QA, and function calling in English. It supports a context length of 4,096 tokens. This model is ready for commercial use.

## References

[Blog](https://blogs.nvidia.com/blog/digital-human-technology-mecha-break/)

[HuggingFace](https://huggingface.co/nvidia/Nemotron-Mini-4B-Instruct)

Specifications & capabilities

Published model ID
nemotron-mini

Deployments & artifacts

1–17 / 17

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
4000
context window is approximate
true
artifact size bytes
2697402127
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
F16
context window
4000
context window is approximate
true
artifact size bytes
8388171535
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q2_K
context window
4000
context window is approximate
true
artifact size bytes
1902810895
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q3_K_L
context window
4000
context window is approximate
true
artifact size bytes
2452969231
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q3_K_M
context window
4000
context window is approximate
true
artifact size bytes
2297255695
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q3_K_S
context window
4000
context window is approximate
true
artifact size bytes
2115589903
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q4_0
context window
4000
context window is approximate
true
artifact size bytes
2567640847
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q4_1
context window
4000
context window is approximate
true
artifact size bytes
2780370703
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
4000
context window is approximate
true
artifact size bytes
2697402127
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q4_K_S
context window
4000
context window is approximate
true
artifact size bytes
2583369487
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q5_0
context window
4000
context window is approximate
true
artifact size bytes
2993100559
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q5_1
context window
4000
context window is approximate
true
artifact size bytes
3205830415
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q5_K_M
context window
4000
context window is approximate
true
artifact size bytes
3059947279
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q5_K_S
context window
4000
context window is approximate
true
artifact size bytes
2993100559
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q6_K
context window
4000
context window is approximate
true
artifact size bytes
3445151503
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q8_0
context window
4000
context window is approximate
true
artifact size bytes
4459943695
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
4.2B
parameter count
4200000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
4000
context window is approximate
true
artifact size bytes
2697402127
updated at
2026-11-16T08:10:06.079865+00:00

Original sources

1–2 / 2

Ollama · Model page ↗

Ollama · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace