Google: Gemma 4 31B

Gemma 4 31B Instruct is Google DeepMind's 30.7B dense multimodal model supporting text and image input with text output. Features a 256K token context window, configurable thinking/reasoning mode, na…

google/gemma-4-31b-it-20260402

Gemma 4 31B Instruct is Google DeepMind's 30.7B dense multimodal model supporting text and image input with text output. Features a 256K token context window, configurable thinking/reasoning mode, native function calling, and multilingual support across 140+ languages. Strong on coding, reasoning, and document understanding tasks. Apache 2.0 license.

Specifications & capabilities

Input
image, text, video
Output
text
Context window · tokens
262144
Published model ID
gemma4@gemma-4-31b-it
Capabilities
multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput
Description source ↗

Evaluations

1–20 / 44

OpenRouter Benchmarks

76.44%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · SambaNova
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
1
sample size
191
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
4
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
SambaNova
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T19:43:06.929Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
191
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.76439777486911
accuracy_std_dev
0.015263579494993957
cost_per_task_usd
0.06284435078534031
output_tokens_per_task
9570.141361256545
latency_seconds_per_task
156.78002094240838
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
5
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

74%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · KT
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
1
sample size
50
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
1
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
KT
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-13T08:16:50.682Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
50
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.74
cost_per_task_usd
0.01977924
output_tokens_per_task
11452.5
latency_seconds_per_task
63.87722
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
4
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

84.596%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · KT
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
2
sample size
396
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
KT
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-11T01:47:13.395Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
396
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8459595
accuracy_std_dev
0.002525500000000014
cost_per_task_usd
0.006682772727272727
output_tokens_per_task
19423.946969696968
latency_seconds_per_task
172.00225757575757
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
4
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

77.483%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Cerebras
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
2
sample size
396
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Cerebras
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-08-29T18:58:30.919Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
396
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.7748314999999999
accuracy_std_dev
0.0012624999999999997
cost_per_task_usd
0.004441212121212121
output_tokens_per_task
2455.989898989899
latency_seconds_per_task
4.186169191919192
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
3
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

76.417%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Friendli
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
2
sample size
400
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
8
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Friendli
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T19:08:17.847Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
400
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.764166625
accuracy_std_dev
0.019418799956083154
cost_per_task_usd
0.0292764325
output_tokens_per_task
12042.5375
latency_seconds_per_task
122.942345
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
7
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

75.833%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · OpenInference
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
2
sample size
100
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
OpenInference
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-08-29T16:47:05.637Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
100
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7583335
accuracy_std_dev
0.011666500000000024
cost_per_task_usd
0.01736758
output_tokens_per_task
12204.57
latency_seconds_per_task
642.59416
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
6
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

84.287%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Chutes
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
3
sample size
1293
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Chutes
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:04:29.121Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1293
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8428716426914153
accuracy_std_dev
0.019938122355458276
cost_per_task_usd
0.006783645784996132
output_tokens_per_task
18142.77648878577
latency_seconds_per_task
813.2033232791957
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
7
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

84.064%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · SambaNova
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
3
sample size
1255
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
8
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
SambaNova
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-11T18:58:39.610Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1255
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8406374175298806
accuracy_std_dev
0.019535919283063564
cost_per_task_usd
0.019024535458167333
output_tokens_per_task
16342.26374501992
latency_seconds_per_task
105.36314422310757
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
8
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

55.667%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Cerebras
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
3
sample size
100
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Cerebras
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-08-29T17:07:32.456Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
100
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.556667
accuracy_std_dev
0.04999999999999999
cost_per_task_usd
0.16220164
output_tokens_per_task
2975.77
latency_seconds_per_task
20.56007
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
3
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

85.883%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · DekaLLM
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
4
sample size
438
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
3
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
DekaLLM
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:45:39.994Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
438
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8588278767123287
accuracy_std_dev
0.014585318196353787
cost_per_task_usd
0.005061143835616439
output_tokens_per_task
13714.753424657534
latency_seconds_per_task
414.4710730593607
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
12
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

74.889%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · ModelRun
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
4
sample size
600
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
12
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
ModelRun
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T18:56:42.115Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
600
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7488888333333333
accuracy_std_dev
0.024993786884054944
cost_per_task_usd
0.08968307666666667
output_tokens_per_task
12273.018333333333
latency_seconds_per_task
142.39351000000002
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
8
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

42.823%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Chutes
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
5
sample size
346
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Chutes
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T19:55:29.787Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
346
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.42822731213872833
accuracy_std_dev
0.02920419045134392
cost_per_task_usd
0.0052024595375722545
output_tokens_per_task
4868.939306358381
latency_seconds_per_task
337.1910375722543
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
5
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

85.173%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Crusoe
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
6
sample size
1105
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Crusoe
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:08:33.701Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1105
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8517346009049774
accuracy_std_dev
0.012647581720936017
cost_per_task_usd
0.00618648778280543
output_tokens_per_task
15241.635294117646
latency_seconds_per_task
347.94131402714936
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
15
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

84.951%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · NextBit
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
6
sample size
1185
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
6
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
NextBit
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-02T17:22:59.212Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1185
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8495076506329113
accuracy_std_dev
0.005079115528864803
cost_per_task_usd
0.007176422784810127
output_tokens_per_task
17778.172151898732
latency_seconds_per_task
1312.4527088607595
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
10
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

73.556%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · NextBit
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
6
sample size
300
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
6
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
NextBit
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-03T00:15:40.640Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
300
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7355556666666666
accuracy_std_dev
0.01369867976201439
cost_per_task_usd
0.01667712
output_tokens_per_task
11802.333333333334
latency_seconds_per_task
656.5032166666667
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
8
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

84.711%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · ModelRun
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
7
sample size
2178
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
11
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
ModelRun
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:05:14.635Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
2178
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8471073636363637
accuracy_std_dev
0.010373179378243821
cost_per_task_usd
0.019450327364554636
output_tokens_per_task
18981.601469237834
latency_seconds_per_task
145.90390633608814
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
8
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

75.524%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Venice
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
7
sample size
350
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Venice
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T19:04:16.045Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
350
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7552381428571429
accuracy_std_dev
0.023015459657919207
cost_per_task_usd
0.021888451428571428
output_tokens_per_task
13683.494285714285
latency_seconds_per_task
479.5023685714286
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
38
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

69.045%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Friendli
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
7
sample size
1584
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
8
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Friendli
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:08:56.904Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1584
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.690446125
accuracy_std_dev
0.011976425410337372
cost_per_task_usd
0.00649373611111111
output_tokens_per_task
15958.085227272728
latency_seconds_per_task
110.58678093434344
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
7
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

68.098%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · OpenInference
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
7
sample size
396
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
OpenInference
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-08-29T18:40:21.422Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
396
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.6809765
accuracy_std_dev
0.000841499999999995
cost_per_task_usd
0.00570934090909091
output_tokens_per_task
16193.580808080807
latency_seconds_per_task
525.9806186868686
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
7
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

OpenRouter Benchmarks

84.432%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Modal
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
8
sample size
182
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
1
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Modal
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-04T09:00:10.020Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
182
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.844322
cost_per_task_usd
0.0016337307692307693
output_tokens_per_task
15097.615384615385
latency_seconds_per_task
52.884664835164834
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
11
benchmark_evaluation
true
openrouter_permaslug
google/gemma-4-31b-it-20260402
source model id
google/gemma-4-31b-it-20260402
Original result ↗

Published prices

1–20 / 21

gemma-4-31b-it ↗

$0.16

Inference provider
cheaperInference
Platform
Cheaper Inference
Unit
input_tokens_per_million
Currency
USD
Billing conditions
zdr
false
protocol
chat_completions
service_tier
standard
Billing label
Input tokens (per 1M)

gemma-4-31b-it ↗

$0.49

Inference provider
cheaperInference
Platform
Cheaper Inference
Unit
output_tokens_per_million
Currency
USD
Billing conditions
zdr
false
protocol
chat_completions
service_tier
standard
Billing label
Output tokens (per 1M)

google/gemma-4-31b-it ↗

$0.20

Inference provider
openRouter
Platform
OpenRouter
Unit
input_tokens_per_million
Currency
USD
Billing conditions

google/gemma-4-31b-it ↗

$0.40

Inference provider
openRouter
Platform
OpenRouter
Unit
output_tokens_per_million
Currency
USD
Billing conditions

google/gemma-4-31B-it ↗

$0.25

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
Billing label
Cached input tokens (per 1M)

google/gemma-4-31B-it ↗

$0.75

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
input_tokens_per_million
Currency
USD
Billing conditions
Billing label
Input tokens (per 1M)

google/gemma-4-31B-it ↗

$1.00

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
output_tokens_per_million
Currency
USD
Billing conditions
Billing label
Output tokens (per 1M)

google/gemma-4-31b-it ↗

$0.14

Inference provider
vercelAIGatewayCatalog
Platform
friendli
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
friendli | google/gemma-4-31b-it
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

google/gemma-4-31b-it ↗

$0.40

Inference provider
vercelAIGatewayCatalog
Platform
friendli
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
friendli | google/gemma-4-31b-it
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

google/gemma-4-31b-it ↗

$0.10

Inference provider
vercelAIGatewayCatalog
Platform
gmicloud
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
gmicloud | google/gemma-4-31b-it
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

google/gemma-4-31b-it ↗

$0.14

Inference provider
vercelAIGatewayCatalog
Platform
gmicloud
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
gmicloud | google/gemma-4-31b-it
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

google/gemma-4-31b-it ↗

$0.40

Inference provider
vercelAIGatewayCatalog
Platform
gmicloud
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
gmicloud | google/gemma-4-31b-it
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

google/gemma-4-31b-it ↗

$0.14

Inference provider
vercelAIGatewayCatalog
Platform
novita
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
novita | google/gemma-4-31b-it
model_type
language
quantization
bf16
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

google/gemma-4-31b-it ↗

$0.40

Inference provider
vercelAIGatewayCatalog
Platform
novita
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
novita | google/gemma-4-31b-it
model_type
language
quantization
bf16
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

google/gemma-4-31b-it ↗

$0.06

Inference provider
vercelAIGatewayCatalog
Platform
parasail
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
parasail | google/gemma-4-31b-it
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

google/gemma-4-31b-it ↗

$0.15

Inference provider
vercelAIGatewayCatalog
Platform
parasail
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
parasail | google/gemma-4-31b-it
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

google/gemma-4-31b-it ↗

$0.40

Inference provider
vercelAIGatewayCatalog
Platform
parasail
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
parasail | google/gemma-4-31b-it
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

google/gemma-4-31b-it ↗

$0.14

Inference provider
vercelAIGatewayCatalog
Platform
Vercel AI Gateway
Unit
input_tokens_per_million
Currency
USD
Billing conditions
model_type
language
quote_scope
gateway_catalog
billing_scope
Vercel public catalog; endpoint prices may differ
varies_by_provider
true
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

Provider specifications & access

1–14 / 14

google/gemma-4-31B-it ↗

source model id
azure-huggingface/google--gemma-4-31b-it@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
apache-2.0
context length
262144
architecture
input_modalities
  • text
  • image
  • video
output_modalities
  • text
capabilities

    google/gemma-4-31B-it ↗

    source model id
    azure-huggingface/google--gemma-4-31b-it@2
    hosting
    foundry-managed-compute
    platforms
    • Microsoft Foundry
    license
    apache-2.0
    context length
    262144
    architecture
    input_modalities
    • text
    • image
    • video
    output_modalities
    • text
    capabilities

      google/gemma-4-31B-it ↗

      source model id
      azure-huggingface/google--gemma-4-31b-it@3
      hosting
      foundry-managed-compute
      platforms
      • Microsoft Foundry
      license
      apache-2.0
      context length
      262144
      architecture
      input_modalities
      • text
      • image
      • video
      output_modalities
      • text
      capabilities

        google/gemma-4-31B-it ↗

        source model id
        azure-huggingface/google--gemma-4-31b-it@4
        hosting
        foundry-managed-compute
        platforms
        • Microsoft Foundry
        license
        apache-2.0
        context length
        262144
        architecture
        input_modalities
        • text
        • image
        • video
        output_modalities
        • text
        capabilities

          google/gemma-4-31B-it ↗

          source model id
          azure-huggingface/google--gemma-4-31b-it@5
          hosting
          foundry-managed-compute
          platforms
          • Microsoft Foundry
          license
          apache-2.0
          context length
          262144
          architecture
          input_modalities
          • text
          • image
          • video
          output_modalities
          • text
          capabilities

            google/gemma-4-31B-it ↗

            source model id
            azure-huggingface/google--gemma-4-31b-it@6
            hosting
            foundry-managed-compute
            platforms
            • Microsoft Foundry
            license
            apache-2.0
            context length
            262144
            architecture
            input_modalities
            • text
            • image
            • video
            output_modalities
            • text
            capabilities

              google/gemma-4-31B-it ↗

              source model id
              azure-huggingface/google--gemma-4-31b-it@7
              hosting
              foundry-managed-compute
              platforms
              • Microsoft Foundry
              license
              apache-2.0
              context length
              262144
              architecture
              input_modalities
              • text
              • image
              • video
              output_modalities
              • text
              capabilities

                gemma-4-31b-it ↗

                source model id
                gemma-4-31b-it
                hosting
                gateway
                platforms
                • Cheaper Inference
                context length
                262144
                max output tokens
                262144
                architecture
                input_modalities
                • text
                • image
                output_modalities
                • text
                capabilities
                • reasoning
                • structuredOutputs
                • toolCalling
                • visionInput

                gemma-4-31b-it ↗

                source model id
                google/gemma-4-31b-it
                hosting
                nvidia-catalog
                platforms
                • NVIDIA Build / NIM
                context length
                262144
                architecture
                input_modalities
                • text
                • image
                • video
                output_modalities
                • text
                capabilities
                • toolCalling
                • reasoning

                Gemma 4 31B IT ↗

                source model id
                google/gemma-4-31b-it
                hosting
                vercel-gateway
                platforms
                • Vercel AI Gateway
                context length
                262144
                max output tokens
                131072
                architecture
                input_modalities
                • text
                • image
                • pdf
                output_modalities
                • text
                capabilities
                • reasoning
                • structuredOutputs
                • toolCalling
                • visionInput

                gemma-4-31B ↗

                source model id
                google/gemma-4-31B-it
                hosting
                siliconflow-hosted
                platforms
                • SiliconFlow
                max output tokens
                262144
                architecture
                input_modalities
                • text
                • image
                output_modalities
                • text
                capabilities
                • promptCaching
                • reasoning
                • structuredOutputs
                • toolCalling

                google/gemma-4-31B-it ↗

                source model id
                HuggingFace/google-gemma-4-31b-it@2
                hosting
                foundry-managed-compute
                platforms
                • Microsoft Foundry
                license
                apache-2.0
                architecture
                input_modalities
                • text
                output_modalities
                • text
                capabilities

                  gemma-4-31B-it ↗

                  source model id
                  publishers/google/models/gemma4@gemma-4-31b-it
                  hosting
                  vertex-self-deployed
                  platforms
                  • Google Cloud Vertex AI
                  architecture
                  input_modalities
                  • text
                  output_modalities
                  • text
                  capabilities

                    google/gemma-4-31B-it ↗

                    source model id
                    publishers/hf-google/models/gemma-4-31b-it@001
                    hosting
                    vertex-self-deployed
                    platforms
                    • Google Cloud Vertex AI
                    architecture
                    input_modalities
                    • image
                    • text
                    output_modalities
                    • text
                    capabilities
                    • multimodal
                    • visionInput

                    Safety assessments

                    1–1 / 1

                    Foundation Model Transparency Index 2025 ↗

                    41 / 100

                    source id
                    stanfordFMTI
                    canonical model id
                    google/gemma-4-31b-it-20260402
                    taxonomy
                    transparency
                    hazard category
                    transparency
                    hazard name
                    Organization transparency
                    policy area
                    Google
                    assessment type
                    organization-level disclosure
                    metric
                    disclosure_score
                    result label
                    41 / 100
                    sample size
                    100
                    updated at
                    2026-11-09T18:08:05.227Z

                    Source specification observations

                    1–16 / 16

                    azureFoundry ↗

                    field
                    context_length
                    value
                    262144
                    normalized value
                    262144
                    scope
                    source-model
                    source id
                    azureFoundry
                    confidence
                    1

                    azureFoundry ↗

                    field
                    context_length
                    value
                    262144
                    normalized value
                    262144
                    scope
                    source-model
                    source id
                    azureFoundry
                    confidence
                    1

                    azureFoundry ↗

                    field
                    context_length
                    value
                    262144
                    normalized value
                    262144
                    scope
                    source-model
                    source id
                    azureFoundry
                    confidence
                    1

                    azureFoundry ↗

                    field
                    context_length
                    value
                    262144
                    normalized value
                    262144
                    scope
                    source-model
                    source id
                    azureFoundry
                    confidence
                    1

                    azureFoundry ↗

                    field
                    context_length
                    value
                    262144
                    normalized value
                    262144
                    scope
                    source-model
                    source id
                    azureFoundry
                    confidence
                    1

                    azureFoundry ↗

                    field
                    context_length
                    value
                    262144
                    normalized value
                    262144
                    scope
                    source-model
                    source id
                    azureFoundry
                    confidence
                    1

                    azureFoundry ↗

                    field
                    context_length
                    value
                    262144
                    normalized value
                    262144
                    scope
                    source-model
                    source id
                    azureFoundry
                    confidence
                    1

                    nvidiaNim ↗

                    field
                    context_length
                    value
                    262144
                    normalized value
                    262144
                    scope
                    source-model
                    source id
                    nvidiaNim
                    confidence
                    1

                    openRouter ↗

                    field
                    context_length
                    value
                    262144
                    normalized value
                    262144
                    scope
                    source-model
                    source id
                    openRouter
                    confidence
                    1

                    openRouter ↗

                    field
                    context_length
                    value
                    262144
                    normalized value
                    262144
                    scope
                    source-model
                    source id
                    openRouter
                    confidence
                    1

                    siliconFlow ↗

                    field
                    context_length
                    value
                    262K
                    scope
                    source-model
                    source id
                    siliconFlow
                    confidence
                    1

                    vercelAIGatewayCatalog ↗

                    field
                    context_length
                    value
                    262144
                    normalized value
                    262144
                    scope
                    source-model
                    source id
                    vercelAIGatewayCatalog
                    confidence
                    1

                    openRouter ↗

                    field
                    max_output_tokens
                    value
                    16384
                    normalized value
                    16384
                    scope
                    source-model
                    source id
                    openRouter
                    confidence
                    1

                    openRouter ↗

                    field
                    max_output_tokens
                    value
                    32768
                    normalized value
                    32768
                    scope
                    source-model
                    source id
                    openRouter
                    confidence
                    1

                    siliconFlow ↗

                    field
                    max_output_tokens
                    value
                    262K
                    scope
                    source-model
                    source id
                    siliconFlow
                    confidence
                    1

                    vercelAIGatewayCatalog ↗

                    field
                    max_output_tokens
                    value
                    131072
                    normalized value
                    131072
                    scope
                    source-model
                    source id
                    vercelAIGatewayCatalog
                    confidence
                    1

                    Original sources

                    1–20 / 32

                    SiliconFlow · Model page ↗

                    Hugging Face · Model repository ↗

                    Google Cloud · Model page ↗

                    Google Cloud · Model page ↗

                    Microsoft Foundry · Model page ↗

                    Microsoft Foundry · Model page ↗

                    Microsoft Foundry · Model page ↗

                    Microsoft Foundry · Model page ↗

                    Microsoft Foundry · Model page ↗

                    Microsoft Foundry · Model page ↗

                    Microsoft Foundry · Model page ↗

                    Microsoft Foundry · Model page ↗

                    NVIDIA · Model page ↗

                    OpenRouter · Model page ↗

                    OpenRouter · Model page ↗

                    SiliconFlow · Playground ↗

                    Vercel AI Gateway · Model page ↗

                    Microsoft Foundry · Model documentation ↗

                    NVIDIA · Documentation ↗

                    SiliconFlow · API documentation ↗

                    Source links

                    1–12 / 12

                    Hugging Face model card

                    1–1 / 1

                    Explore more models

                    Models

                    Loading
                    EVIDENCE / COMPARISON

                    Benchmarks

                    Explore every benchmark

                    Loading

                    These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

                    Install TensorTrace