DeepSeek: DeepSeek V4 Flash 0731

DeepSeek V4 Flash 0731 is a sparse mixture-of-experts model from DeepSeek, with 13B active parameters out of 284B total. This re-post-trained revision is suited for coding, reasoning, and agent workf…

deepseek/deepseek-v4-flash-20260731

DeepSeek V4 Flash 0731 is a sparse mixture-of-experts model from DeepSeek, with 13B active parameters out of 284B total. This re-post-trained revision is suited for coding, reasoning, and agent workflows. This is the GA release of DeepSeek V4 Flash.

Specifications & capabilities

Input
text
Output
text
Context window · tokens
1048576
Knowledge cutoff
2025-05
Published model ID
DeepSeek-V4-Flash-0731
Capabilities
promptCaching, reasoning, structuredOutputs, toolCalling
Description source ↗

Evaluations

1–20 / 77

OpenRouter Benchmarks

88.72%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Ambient
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
1
sample size
396
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Ambient
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-08-29T10:57:26.955Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
396
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8872049999999999
accuracy_std_dev
0.006734000000000018
cost_per_task_usd
0.004174421717171718
output_tokens_per_task
22838.073232323233
latency_seconds_per_task
214.5158207070707
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
4
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

79.812%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · BaseTen
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
1
sample size
142
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
3
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
BaseTen
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T11:56:20.980Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
142
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7981221830985916
accuracy_std_dev
0.05639978873679898
cost_per_task_usd
0.007624964788732395
output_tokens_per_task
8761.732394366198
latency_seconds_per_task
30.939802816901405
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
14
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

76.218%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Cohere
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
1
sample size
349
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Cohere
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T11:55:25.455Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
349
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.762177653295129
accuracy_std_dev
0.016008036097981727
cost_per_task_usd
0.027902553008595985
output_tokens_per_task
17491.627507163324
latency_seconds_per_task
104.07765616045846
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
7
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

88.917%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Reka
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
2
sample size
3349
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
17
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Reka
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T09:08:32.372Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
3349
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8891708512988952
accuracy_std_dev
0.008107170901595804
cost_per_task_usd
0.015164630934607346
output_tokens_per_task
27111.550313526426
latency_seconds_per_task
200.1460895789788
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
13
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

88.828%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Mancer 2
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
2
sample size
2178
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
11
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Mancer 2
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T08:24:31.558Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
2178
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8882767272727271
accuracy_std_dev
0.018777918676858473
cost_per_task_usd
0.013537202938475667
output_tokens_per_task
23738.730945821855
latency_seconds_per_task
349.2070454545455
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
6
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

76.667%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · NextBit
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
2
sample size
400
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
8
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
NextBit
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-03T08:39:48.671Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
400
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.76666675
accuracy_std_dev
0.024267078752653787
cost_per_task_usd
0.036940722499999995
output_tokens_per_task
17358.2575
latency_seconds_per_task
209.47017000000002
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
8
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

75.63%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Mancer 2
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
2
sample size
450
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
9
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Mancer 2
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T12:45:59.472Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
450
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7562962222222223
accuracy_std_dev
0.035011314652957475
cost_per_task_usd
0.04747446444444444
output_tokens_per_task
14674.364444444445
latency_seconds_per_task
235.6986
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
5
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

71.667%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Ambient
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
2
sample size
100
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Ambient
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-08-29T09:31:13.940Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
100
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7166665000000001
accuracy_std_dev
0.01666650000000003
cost_per_task_usd
0.00699117
output_tokens_per_task
13794.25
latency_seconds_per_task
151.32810999999998
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
4
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

Vercel AI Gateway

10.855%

source id
vercelAIGateway
leaderboard name
AI Gateway Text Requests Share
dimension
popularity
metric
Requests
rank
2
evaluated at
2026-11-11T00:00:00.000Z
source model id
DeepSeek V4 Flash 0731
Original result ↗

OpenRouter Benchmarks

90.189%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · PrimeIntellect
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
3
sample size
671
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
6
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
PrimeIntellect
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-02T17:22:52.620Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
671
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.9018877466467959
accuracy_std_dev
0.01830165892678099
cost_per_task_usd
0.0035507228017883754
output_tokens_per_task
15221.761549925484
latency_seconds_per_task
96.27304172876305
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
22
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

89.936%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · NextBit
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
3
sample size
1782
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
9
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
NextBit
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-03T10:19:34.320Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1782
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8993638888888887
accuracy_std_dev
0.004029367042778795
cost_per_task_usd
0.030411617283950615
output_tokens_per_task
26633.1290684624
latency_seconds_per_task
237.5536509539843
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
10
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

89.514%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Cohere
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
3
sample size
1386
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Cohere
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T09:09:17.234Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1386
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8951417142857143
accuracy_std_dev
0.009679824699036726
cost_per_task_usd
0.008688588023088023
output_tokens_per_task
30552.396103896102
latency_seconds_per_task
171.10775108225107
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
7
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

88.809%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · AkashML
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
3
sample size
557
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
3
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
AkashML
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-09-05T08:24:32.148Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
557
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8880907953321364
accuracy_std_dev
0.02107123389837437
cost_per_task_usd
0.004236710951526032
output_tokens_per_task
16317.405745062837
latency_seconds_per_task
379.49359605026933
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
10
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

88.522%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Inceptron
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
3
sample size
2361
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
12
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Inceptron
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T08:07:18.580Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
2361
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8852179872935196
accuracy_std_dev
0.008384701841581625
cost_per_task_usd
0.007895573909360442
output_tokens_per_task
20775.56925031766
latency_seconds_per_task
349.1453604404913
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
6
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

76.917%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Together
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
3
sample size
400
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
8
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Together
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-17T11:00:48.267Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
400
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.769166625
accuracy_std_dev
0.028272094359710526
cost_per_task_usd
0.014342402500000002
output_tokens_per_task
15618.9
latency_seconds_per_task
227.243235
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
22
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

76.467%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Cloudflare
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
3
sample size
500
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
10
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Cloudflare
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T12:46:55.135Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
500
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7646666
accuracy_std_dev
0.016343743623784605
cost_per_task_usd
0.035043700000000004
output_tokens_per_task
15530.04
latency_seconds_per_task
223.77017600000002
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
15
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

76.067%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Sail Research
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
3
sample size
1000
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
20
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Sail Research
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-06T22:45:20.558Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1000
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.76066665
accuracy_std_dev
0.019194930466857663
cost_per_task_usd
0.011314683
output_tokens_per_task
15148.268
latency_seconds_per_task
308.174577
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
11
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

74.35%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · PrimeIntellect
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
3
sample size
295
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
6
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
PrimeIntellect
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-02T17:51:25.369Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
295
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.743502793220339
accuracy_std_dev
0.018213736559866647
cost_per_task_usd
0.010024135593220337
output_tokens_per_task
13505.108474576271
latency_seconds_per_task
123.31584745762713
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
21
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

73.679%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Inceptron
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
3
sample size
549
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
11
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Inceptron
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T11:58:45.245Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
549
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7367941894353369
accuracy_std_dev
0.02953072467422912
cost_per_task_usd
0.01213822586520947
output_tokens_per_task
14294.963570127504
latency_seconds_per_task
405.30262841530055
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
6
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

OpenRouter Benchmarks

90.262%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · GMICloud
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
4
sample size
2574
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
13
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
GMICloud
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-10T06:09:57.337Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
2574
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.9026157692307694
accuracy_std_dev
0.012508586614825496
cost_per_task_usd
0.022228931623931622
output_tokens_per_task
26432.28243978244
latency_seconds_per_task
201.34069813519812
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
26
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260731
source model id
deepseek/deepseek-v4-flash-20260731
Original result ↗

Published prices

21–40 / 68

deepseek/deepseek-v4-flash-0731 ↗

$0.03

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
baseten | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.03

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
region
scope
zone
geo_region
us
endpoint
baseten | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.13

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
baseten | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.13

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
input_tokens_per_million
Currency
USD
Billing conditions
region
scope
zone
geo_region
us
endpoint
baseten | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.26

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
baseten | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.26

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
output_tokens_per_million
Currency
USD
Billing conditions
region
scope
zone
geo_region
us
endpoint
baseten | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.02

Inference provider
vercelAIGatewayCatalog
Platform
boundless
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
boundless | deepseek/deepseek-v4-flash-0731
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.04

Inference provider
vercelAIGatewayCatalog
Platform
boundless
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
boundless | deepseek/deepseek-v4-flash-0731
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.21

Inference provider
vercelAIGatewayCatalog
Platform
boundless
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
boundless | deepseek/deepseek-v4-flash-0731
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.02

Inference provider
vercelAIGatewayCatalog
Platform
deepinfra
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
deepinfra | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.06

Inference provider
vercelAIGatewayCatalog
Platform
deepinfra
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
deepinfra | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.18

Inference provider
vercelAIGatewayCatalog
Platform
deepinfra
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
deepinfra | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.02

Inference provider
vercelAIGatewayCatalog
Platform
digitalocean
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
digitalocean | deepseek/deepseek-v4-flash-0731
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.08

Inference provider
vercelAIGatewayCatalog
Platform
digitalocean
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
digitalocean | deepseek/deepseek-v4-flash-0731
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.25

Inference provider
vercelAIGatewayCatalog
Platform
digitalocean
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
digitalocean | deepseek/deepseek-v4-flash-0731
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.01

Inference provider
vercelAIGatewayCatalog
Platform
gmicloud
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
gmicloud | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.29

Inference provider
vercelAIGatewayCatalog
Platform
gmicloud
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
gmicloud | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.86

Inference provider
vercelAIGatewayCatalog
Platform
gmicloud
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
gmicloud | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.07

Inference provider
vercelAIGatewayCatalog
Platform
inceptron
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
inceptron | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp4
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash-0731 ↗

$0.13

Inference provider
vercelAIGatewayCatalog
Platform
inceptron
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
inceptron | deepseek/deepseek-v4-flash-0731
model_type
language
quantization
fp4
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

Provider specifications & access

1–9 / 9

deepseek-ai/DeepSeek-V4-Flash-0731 ↗

source model id
azure-huggingface/deepseek-ai--deepseek-v4-flash-0731@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
MIT
context length
1048576
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    deepseek-ai/DeepSeek-V4-Flash-0731 ↗

    source model id
    azure-huggingface/deepseek-ai--deepseek-v4-flash-0731@2
    hosting
    foundry-managed-compute
    platforms
    • Microsoft Foundry
    license
    MIT
    context length
    1048576
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      deepseek-ai/DeepSeek-V4-Flash-0731 ↗

      source model id
      azure-huggingface/deepseek-ai--deepseek-v4-flash-0731@3
      hosting
      foundry-managed-compute
      platforms
      • Microsoft Foundry
      license
      MIT
      context length
      1048576
      architecture
      input_modalities
      • text
      output_modalities
      • text
      capabilities

        deepseek-ai/DeepSeek-V4-Flash-0731 ↗

        source model id
        azure-huggingface/deepseek-ai--deepseek-v4-flash-0731@4
        hosting
        foundry-managed-compute
        platforms
        • Microsoft Foundry
        license
        MIT
        context length
        1048576
        architecture
        input_modalities
        • text
        output_modalities
        • text
        capabilities

          deepseek-ai/DeepSeek-V4-Flash-0731 ↗

          source model id
          azure-huggingface/deepseek-ai--deepseek-v4-flash-0731@5
          hosting
          foundry-managed-compute
          platforms
          • Microsoft Foundry
          license
          MIT
          context length
          1048576
          architecture
          input_modalities
          • text
          output_modalities
          • text
          capabilities

            deepseek-v4-flash-0731 ↗

            source model id
            @cf/deepseek-ai/deepseek-v4-flash-0731
            hosting
            cloudflare-hosted
            platforms
            • Cloudflare Workers AI
            context length
            1048576
            architecture
            input_modalities
            • text
            output_modalities
            • text
            capabilities
            • toolCalling

            DeepSeek-V4-Flash-0731 ↗

            source model id
            deepseek-ai/DeepSeek-V4-Flash-0731
            hosting
            siliconflow-hosted
            platforms
            • SiliconFlow
            max output tokens
            393216
            architecture
            input_modalities
            • text
            output_modalities
            • text
            capabilities
            • promptCaching
            • reasoning
            • structuredOutputs
            • toolCalling

            DeepSeek V4 Flash 0731 ↗

            source model id
            deepseek/deepseek-v4-flash-0731
            hosting
            vercel-gateway
            platforms
            • Vercel AI Gateway
            context length
            1000000
            max output tokens
            384000
            architecture
            input_modalities
            • text
            output_modalities
            • text
            capabilities
            • promptCaching
            • reasoning
            • structuredOutputs
            • toolCalling
            regions
            • us

            deepseek-ai/DeepSeek-V4-Flash-0731 ↗

            source model id
            publishers/deepseek-ai/models/deepseek-v4@deepseek-v4-flash-0731
            hosting
            vertex-self-deployed
            platforms
            • Google Cloud Vertex AI
            architecture
            input_modalities
            • text
            output_modalities
            • text
            capabilities

              Safety assessments

              1–1 / 1

              Foundation Model Transparency Index 2025 ↗

              32 / 100

              source id
              stanfordFMTI
              canonical model id
              deepseek/deepseek-v4-flash-20260731
              taxonomy
              transparency
              hazard category
              transparency
              hazard name
              Organization transparency
              policy area
              DeepSeek
              assessment type
              organization-level disclosure
              metric
              disclosure_score
              result label
              32 / 100
              sample size
              100
              updated at
              2026-11-09T18:08:05.227Z

              Source specification observations

              1–16 / 16

              azureFoundry ↗

              field
              context_length
              value
              1048576
              normalized value
              1048576
              scope
              source-model
              source id
              azureFoundry
              confidence
              1

              azureFoundry ↗

              field
              context_length
              value
              1048576
              normalized value
              1048576
              scope
              source-model
              source id
              azureFoundry
              confidence
              1

              azureFoundry ↗

              field
              context_length
              value
              1048576
              normalized value
              1048576
              scope
              source-model
              source id
              azureFoundry
              confidence
              1

              azureFoundry ↗

              field
              context_length
              value
              1048576
              normalized value
              1048576
              scope
              source-model
              source id
              azureFoundry
              confidence
              1

              azureFoundry ↗

              field
              context_length
              value
              1048576
              normalized value
              1048576
              scope
              source-model
              source id
              azureFoundry
              confidence
              1

              openRouter ↗

              field
              context_length
              value
              1048576
              normalized value
              1048576
              scope
              source-model
              source id
              openRouter
              confidence
              1

              openRouter ↗

              field
              context_length
              value
              1048576
              normalized value
              1048576
              scope
              source-model
              source id
              openRouter
              confidence
              1

              openRouter ↗

              field
              context_length
              value
              1048576
              normalized value
              1048576
              scope
              source-model
              source id
              openRouter
              confidence
              1

              siliconFlow ↗

              field
              context_length
              value
              1049K
              scope
              source-model
              source id
              siliconFlow
              confidence
              1

              vercelAIGatewayCatalog ↗

              field
              context_length
              value
              1000000
              normalized value
              1000000
              scope
              source-model
              source id
              vercelAIGatewayCatalog
              confidence
              1

              vercelAIGatewayCatalog ↗

              field
              knowledge_cutoff
              reported field
              knowledge_cutoff
              value
              2025-05
              normalized value
              2025-05
              precision
              month
              scope
              source-model
              source id
              vercelAIGatewayCatalog
              confidence
              1

              openRouter ↗

              field
              max_output_tokens
              value
              384000
              normalized value
              384000
              scope
              source-model
              source id
              openRouter
              confidence
              1

              openRouter ↗

              field
              max_output_tokens
              value
              384000
              normalized value
              384000
              scope
              source-model
              source id
              openRouter
              confidence
              1

              openRouter ↗

              field
              max_output_tokens
              value
              943718
              normalized value
              943718
              scope
              source-model
              source id
              openRouter
              confidence
              1

              siliconFlow ↗

              field
              max_output_tokens
              value
              393K
              scope
              source-model
              source id
              siliconFlow
              confidence
              1

              vercelAIGatewayCatalog ↗

              field
              max_output_tokens
              value
              384000
              normalized value
              384000
              scope
              source-model
              source id
              vercelAIGatewayCatalog
              confidence
              1

              Original sources

              1–20 / 30

              SiliconFlow · Model page ↗

              Hugging Face · Model reference ↗

              Cloudflare AI · Model page ↗

              Google Cloud · Model page ↗

              Microsoft Foundry · Model page ↗

              Microsoft Foundry · Model page ↗

              Microsoft Foundry · Model page ↗

              Microsoft Foundry · Model page ↗

              Microsoft Foundry · Model page ↗

              OpenRouter · Model page ↗

              OpenRouter · Model page ↗

              SiliconFlow · Playground ↗

              Vercel AI Gateway · Model page ↗

              Google Cloud · Model documentation ↗

              Microsoft Foundry · Model documentation ↗

              SiliconFlow · API documentation ↗

              arXiv · Paper · 2606.19348 ↗

              GitHub · Source snapshot ↗

              Cloudflare AI · Catalog ↗

              Epoch AI · Catalog ↗

              Source links

              1–13 / 13

              Hugging Face model card

              1–1 / 1

              Explore more models

              Models

              Loading
              EVIDENCE / COMPARISON

              Benchmarks

              Explore every benchmark

              Loading

              These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

              Install TensorTrace