Ollama · wizardlm

<img src="https://user-images.githubusercontent.com/633681/263121166-8b16834a-1da2-4a68-8aac-13d19775e7d7.png" style="max-width:60%" /> WizardLM is a 70B parameter model based on Llama 2 trained by W…

ollama/wizardlm

<img src="https://user-images.githubusercontent.com/633681/263121166-8b16834a-1da2-4a68-8aac-13d19775e7d7.png" style="max-width:60%" />

WizardLM is a 70B parameter model based on Llama 2 trained by WizardLM.

## Get started with WizardLM

The model used in the example below is the WizardLM model, with 70b parameters, which is a general-use model.

### API

1. Start Ollama server (Run `ollama serve`) 2. Run the model

```bash curl -X POST http://localhost:11434/api/generate -d '{ "model": "wizardlm:70b-llama2-q4_0", "prompt":"Why is the sky blue?" }' ```

### CLI

1. Install Ollama 2. Open the terminal and run `ollama run wizardlm:70b-llama2-q4_0`

Note: The `ollama run` command performs an `ollama pull` if the model is not already downloaded. To download the model without running it, use `ollama pull wizardlm:70b-llama2-q4_0`

## Memory requirements

- 70b models generally require at least 64GB of RAM

If you run into issues with higher quantization levels, try using the q4 model or shut down any other programs that are using a lot of memory.

## Model variants

By default, Ollama uses 4-bit quantization. To try other quantization levels, please try the other tags. The number after the q represents the number of bits used for quantization (i.e. q4 means 4-bit quantization). The higher the number, the more accurate the model is, but the slower it runs, and the more memory it requires.

## Model source

**WizardLM source on Ollama**

70b parameters source: [The Bloke](https://huggingface.co/TheBloke/WizardLM-70B-V1.0-GGML)

70b parameters original source: [WizardLM](https://huggingface.co/WizardLM/WizardLM-70B-V1.0)

Specifications & capabilities

Published model ID
wizardlm

Deployments & artifacts

1–20 / 73

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
F16
context window
2000
context window is approximate
true
artifact size bytes
26033324134
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
F16
context window
4000
context window is approximate
true
artifact size bytes
26033303622
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q2_K
context window
4000
context window is approximate
true
artifact size bytes
5429348454
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q3_K_L
context window
4000
context window is approximate
true
artifact size bytes
6929559654
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q3_K_M
context window
4000
context window is approximate
true
artifact size bytes
6337769574
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q3_K_S
context window
4000
context window is approximate
true
artifact size bytes
5658980454
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q4_0
context window
4000
context window is approximate
true
artifact size bytes
7365834854
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q4_1
context window
4000
context window is approximate
true
artifact size bytes
8169060454
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q4_K_M
context window
4000
context window is approximate
true
artifact size bytes
7865956454
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q4_K_S
context window
4000
context window is approximate
true
artifact size bytes
7414331494
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q5_0
context window
4000
context window is approximate
true
artifact size bytes
8972286054
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q5_1
context window
4000
context window is approximate
true
artifact size bytes
9775511654
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q5_K_M
context window
4000
context window is approximate
true
artifact size bytes
9229924454
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q5_K_S
context window
4000
context window is approximate
true
artifact size bytes
8972286054
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q6_K
context window
4000
context window is approximate
true
artifact size bytes
10679140454
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q8_0
context window
4000
context window is approximate
true
artifact size bytes
13831319654
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q2_K
context window
2000
context window is approximate
true
artifact size bytes
5429354406
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q3_K_L
context window
2000
context window is approximate
true
artifact size bytes
6929566118
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q3_K_M
context window
2000
context window is approximate
true
artifact size bytes
6337776038
updated at
2026-11-16T08:10:06.079865+00:00

ollama

source id
ollama
execution mode
local
parameter size
13B
parameter count
13000000000
parameter count is approximate
true
quantization level
Q3_K_S
context window
2000
context window is approximate
true
artifact size bytes
5658986918
updated at
2026-11-16T08:10:06.079865+00:00

Original sources

1–2 / 2

Ollama · Model page ↗

Ollama · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace