Ollama · nemotron
<img src="https://ollama.com/assets/library/nemotron-mini/4e0ea563-a507-45e7-ad0b-b083918ec11b" width="320" /> Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improv…
ollama/nemotron
<img src="https://ollama.com/assets/library/nemotron-mini/4e0ea563-a507-45e7-ad0b-b083918ec11b" width="320" />
Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries.
This model was trained using RLHF (specifically, REINFORCE), [Llama-3.1-Nemotron-70B-Reward](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Reward) and [HelpSteer2-Preference prompts](https://huggingface.co/datasets/nvidia/HelpSteer2) on a [Llama-3.1-70B-Instruct](https://ai.meta.com/blog/meta-llama-3-1/) model as the initial policy.
```
$ ollama run nemotron
>>> How many r in strawberry?
A sweet question!
Let's count the "R"s in "strawberry":
1. S
2. T
3. R
4. A
5. W
6. B
7. E
8. R
9. R
10. Y
There are **3** "R"s in the word "strawberry".
```
## Reference
[Hugging Face](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF)
Specifications & capabilities
- Published model ID
- nemotron
Deployments & artifacts
1–17 / 17
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q4_K_M
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 42520412011
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- F16
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 141117931371
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q2_K
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 26375126891
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q3_K_L
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 37140610923
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q3_K_M
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 34267512683
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q3_K_S
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 30912069483
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q4_0
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 39969750891
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q4_1
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 44313608043
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q4_K_M
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 42520412011
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q4_K_S
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 40347238251
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q5_0
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 48657465195
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q5_1
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 53001322347
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q5_K_M
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 49949835115
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q5_K_S
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 48657465195
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q6_K
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 57888161643
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q8_0
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 74975068011
- updated at
- 2026-11-16T08:10:06.079865+00:00
ollama
- source id
- ollama
- execution mode
- local
- parameter size
- 70.6B
- parameter count
- 70600000000
- parameter count is approximate
- true
- quantization level
- Q4_K_M
- context window
- 128000
- context window is approximate
- true
- artifact size bytes
- 42520412011
- updated at
- 2026-11-16T08:10:06.079865+00:00
Explore more models