Ollama · nemotron

<img src="https://ollama.com/assets/library/nemotron-mini/4e0ea563-a507-45e7-ad0b-b083918ec11b" width="320" /> Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improv…

ollama/nemotron

<img src="https://ollama.com/assets/library/nemotron-mini/4e0ea563-a507-45e7-ad0b-b083918ec11b" width="320" />

Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries.

This model was trained using RLHF (specifically, REINFORCE), [Llama-3.1-Nemotron-70B-Reward](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Reward) and [HelpSteer2-Preference prompts](https://huggingface.co/datasets/nvidia/HelpSteer2) on a [Llama-3.1-70B-Instruct](https://ai.meta.com/blog/meta-llama-3-1/) model as the initial policy.

``` $ ollama run nemotron >>> How many r in strawberry? A sweet question!

Let's count the "R"s in "strawberry":

1. S 2. T 3. R 4. A 5. W 6. B 7. E 8. R 9. R 10. Y

There are **3** "R"s in the word "strawberry". ```

## Reference [Hugging Face](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF)

Specifications & capabilities

Published model ID
nemotron

Deployments & artifacts

1–17 / 17

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
128000
context window is approximate
true
artifact size bytes
42520412011
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
F16
context window
128000
context window is approximate
true
artifact size bytes
141117931371
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q2_K
context window
128000
context window is approximate
true
artifact size bytes
26375126891
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q3_K_L
context window
128000
context window is approximate
true
artifact size bytes
37140610923
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q3_K_M
context window
128000
context window is approximate
true
artifact size bytes
34267512683
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q3_K_S
context window
128000
context window is approximate
true
artifact size bytes
30912069483
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q4_0
context window
128000
context window is approximate
true
artifact size bytes
39969750891
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q4_1
context window
128000
context window is approximate
true
artifact size bytes
44313608043
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
128000
context window is approximate
true
artifact size bytes
42520412011
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q4_K_S
context window
128000
context window is approximate
true
artifact size bytes
40347238251
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q5_0
context window
128000
context window is approximate
true
artifact size bytes
48657465195
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q5_1
context window
128000
context window is approximate
true
artifact size bytes
53001322347
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q5_K_M
context window
128000
context window is approximate
true
artifact size bytes
49949835115
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q5_K_S
context window
128000
context window is approximate
true
artifact size bytes
48657465195
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q6_K
context window
128000
context window is approximate
true
artifact size bytes
57888161643
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q8_0
context window
128000
context window is approximate
true
artifact size bytes
74975068011
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
70.6B
parameter count
70600000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
128000
context window is approximate
true
artifact size bytes
42520412011
updated at
2026-11-16T08:10:06.079865+00:00

Original sources

1–2 / 2

Ollama · Model page ↗

Ollama · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace