Ollama · nemotron-mini
<img src="https://ollama.com/assets/library/nemotron-mini/4e0ea563-a507-45e7-ad0b-b083918ec11b" width="320" /> Nemotron-Mini-4B-Instruct is a model for generating responses for roleplaying, retrieval…
ollama/nemotron-mini
<img src="https://ollama.com/assets/library/nemotron-mini/4e0ea563-a507-45e7-ad0b-b083918ec11b" width="320" />
Nemotron-Mini-4B-Instruct is a model for generating responses for roleplaying, retrieval augmented generation, and function calling. It is a small language model (SLM) optimized through distillation, pruning and quantization for speed and on-device deployment.
This instruct model is optimized for roleplay, RAG QA, and function calling in English. It supports a context length of 4,096 tokens. This model is ready for commercial use.
## References
[Blog](https://blogs.nvidia.com/blog/digital-human-technology-mecha-break/)
[HuggingFace](https://huggingface.co/nvidia/Nemotron-Mini-4B-Instruct)
Specifications & capabilities
- Published model ID
- nemotron-mini
Deployments & artifacts
1–17 / 17
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q4_K_M
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 2697402127
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- F16
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 8388171535
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q2_K
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 1902810895
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q3_K_L
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 2452969231
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q3_K_M
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 2297255695
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q3_K_S
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 2115589903
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q4_0
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 2567640847
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q4_1
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 2780370703
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q4_K_M
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 2697402127
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q4_K_S
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 2583369487
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q5_0
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 2993100559
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q5_1
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 3205830415
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q5_K_M
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 3059947279
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q5_K_S
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 2993100559
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q6_K
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 3445151503
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q8_0
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 4459943695
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 4.2B
- parameter count
- 4200000000
- parameter count is approximate
- true
- quantization level
- Q4_K_M
- context window
- 4000
- context window is approximate
- true
- artifact size bytes
- 2697402127
- updated at
- 2026-11-16T08:10:06.079865+00:00
Explore more models