DeepSeek: DeepSeek V4 Flash 0423

DeepSeek V4 Flash is an efficiency-optimized Mixture-of-Experts model from DeepSeek with 284B total parameters and 13B activated parameters, supporting a 1M-token context window. It is designed for f…

deepseek/deepseek-v4-flash-20260423

DeepSeek V4 Flash is an efficiency-optimized Mixture-of-Experts model from DeepSeek with 284B total parameters and 13B activated parameters, supporting a 1M-token context window. It is designed for fast inference and high-throughput workloads, while maintaining strong reasoning and coding performance.

The model includes hybrid attention for efficient long-context processing. Reasoning efforts `high` and `xhigh` are supported; `xhigh` maps to max reasoning. It is well suited for applications such as coding assistants, chat systems, and agent workflows where responsiveness and cost efficiency are important.

Specifications & capabilities

Input
text
Output
text
Context window · tokens
1048576
Knowledge cutoff
2025-05
Published model ID
DeepSeek-V4-Flash
Capabilities
promptCaching, reasoning, structuredOutputs, toolCalling
Description source ↗

Evaluations

41–60 / 71

OpenCompass LLM

79%

source id
openCompass
leaderboard name
Average
dimension
general
metric
Average
rank
11
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
CodeTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Average
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenCompass LLM

79%

source id
openCompass
leaderboard name
Code
dimension
general
metric
Code
rank
11
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
OverallTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Code
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenCompass LLM

75%

source id
openCompass
leaderboard name
Math_College
dimension
general
metric
Math_College
rank
11
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MathTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Math_College
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenCompass LLM

61%

source id
openCompass
leaderboard name
Reasoning
dimension
general
metric
Reasoning
rank
11
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
OverallTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Reasoning
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenCompass LLM

61%

source id
openCompass
leaderboard name
Average
dimension
general
metric
Average
rank
11
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
ReasonTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Average
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenRouter Benchmarks

88.215%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Novita
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
12
sample size
594
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
3
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Novita
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-03T16:57:09.267Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
594
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8821546666666666
accuracy_std_dev
0.015120291935747206
cost_per_task_usd
0.007597324915824916
output_tokens_per_task
26812.25925925926
latency_seconds_per_task
210.52051515151513
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
59
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260423
source model id
deepseek/deepseek-v4-flash-20260423
Original result ↗

OpenRouter Benchmarks

86.229%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · DigitalOcean
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
12
sample size
990
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
5
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
DigitalOcean
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:46:54.774Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
990
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8622894
accuracy_std_dev
0.02509268697130698
cost_per_task_usd
0.0055417101010101
output_tokens_per_task
29101.413131313133
latency_seconds_per_task
936.3557888888889
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
23
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260423
source model id
deepseek/deepseek-v4-flash-20260423
Original result ↗

OpenCompass LLM

73%

source id
openCompass
leaderboard name
Common_Reasoning
dimension
general
metric
Common_Reasoning
rank
12
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
ReasonTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Common_Reasoning
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenRouter Benchmarks

84.752%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · AtlasCloud
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
13
sample size
1386
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
AtlasCloud
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:04:29.124Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1386
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8475227142857141
accuracy_std_dev
0.03525429692033209
cost_per_task_usd
0.01139066955266955
output_tokens_per_task
40336.09018759019
latency_seconds_per_task
480.83486796536795
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
30
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260423
source model id
deepseek/deepseek-v4-flash-20260423
Original result ↗

OpenCompass LLM

73.7%

source id
openCompass
leaderboard name
Average
dimension
general
metric
Average
rank
13
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
OverallTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Average
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenCompass LLM

70.4%

source id
openCompass
leaderboard name
Math
dimension
general
metric
Math
rank
13
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
OverallTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Math
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenCompass LLM

70.4%

source id
openCompass
leaderboard name
Average
dimension
general
metric
Average
rank
13
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MathTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Average
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenRouter Benchmarks

34.68%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Reka
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
13
sample size
198
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
1
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Reka
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-03T00:19:24.096Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
198
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.346801
cost_per_task_usd
0.008616373737373737
output_tokens_per_task
32995.232323232325
latency_seconds_per_task
1179.1815303030303
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
13
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260423
source model id
deepseek/deepseek-v4-flash-20260423
Original result ↗

OpenCompass LLM

83.3%

source id
openCompass
leaderboard name
Knowledge_Engineering
dimension
general
metric
Knowledge_Engineering
rank
14
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
KnowledgeTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Knowledge_Engineering
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenCompass LLM

84.5%

source id
openCompass
leaderboard name
Knowledge
dimension
general
metric
Knowledge
rank
15
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
OverallTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Knowledge
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenCompass LLM

84.5%

source id
openCompass
leaderboard name
Average
dimension
general
metric
Average
rank
15
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
KnowledgeTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Average
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenCompass LLM

84.2%

source id
openCompass
leaderboard name
Knowledge_Science
dimension
general
metric
Knowledge_Science
rank
15
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
KnowledgeTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Knowledge_Science
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenRouter Benchmarks

84.091%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · StreamLake
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
15
sample size
1584
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
8
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
StreamLake
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:18:02.140Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1584
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8409089999999999
accuracy_std_dev
0.045212357351171156
cost_per_task_usd
0.0038926938131313127
output_tokens_per_task
43083.319444444445
latency_seconds_per_task
564.2816047979799
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
30
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260423
source model id
deepseek/deepseek-v4-flash-20260423
Original result ↗

OpenCompass LLM

77.9%

source id
openCompass
leaderboard name
Knowledge_CommonSense
dimension
general
metric
Knowledge_CommonSense
rank
15
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
KnowledgeTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Knowledge_CommonSense
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Flash
Original result ↗

OpenRouter Benchmarks

76%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · DeepInfra
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
15
sample size
250
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
5
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
DeepInfra
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T20:10:56.893Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
250
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7599998
accuracy_std_dev
0.007302967435227963
cost_per_task_usd
0.007451167999999999
output_tokens_per_task
12454.056
latency_seconds_per_task
324.20324
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
63
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-flash-20260423
source model id
deepseek/deepseek-v4-flash-20260423
Original result ↗

Published prices

1–20 / 39

deepseek-ai/DeepSeek-V4-Flash ↗

$0.03

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
Billing label
Cached input tokens (per 1M)

deepseek-ai/DeepSeek-V4-Flash ↗

$0.13

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
input_tokens_per_million
Currency
USD
Billing conditions
Billing label
Input tokens (per 1M)

deepseek-ai/DeepSeek-V4-Flash ↗

$0.28

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
output_tokens_per_million
Currency
USD
Billing conditions
Billing label
Output tokens (per 1M)

deepseek/deepseek-v4-flash ↗

$0.02

Inference provider
vercelAIGatewayCatalog
Platform
alibaba
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
alibaba | deepseek/deepseek-v4-flash
model_type
language
peak_pricing
windows
  • end_minute_utc
    840
    start_minute_utc
    0
multiplier
2
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash ↗

$0.22

Inference provider
vercelAIGatewayCatalog
Platform
alibaba
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
alibaba | deepseek/deepseek-v4-flash
model_type
language
peak_pricing
windows
  • end_minute_utc
    840
    start_minute_utc
    0
multiplier
2
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash ↗

$0.66

Inference provider
vercelAIGatewayCatalog
Platform
alibaba
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
alibaba | deepseek/deepseek-v4-flash
model_type
language
peak_pricing
windows
  • end_minute_utc
    840
    start_minute_utc
    0
multiplier
2
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash ↗

$0.03

Inference provider
vercelAIGatewayCatalog
Platform
azure
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
azure | deepseek/deepseek-v4-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash ↗

$0.19

Inference provider
vercelAIGatewayCatalog
Platform
azure
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
azure | deepseek/deepseek-v4-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash ↗

$0.51

Inference provider
vercelAIGatewayCatalog
Platform
azure
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
azure | deepseek/deepseek-v4-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash ↗

$0.03

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
baseten | deepseek/deepseek-v4-flash
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash ↗

$0.03

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
region
scope
zone
geo_region
us
endpoint
baseten | deepseek/deepseek-v4-flash
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash ↗

$0.13

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
baseten | deepseek/deepseek-v4-flash
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash ↗

$0.13

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
input_tokens_per_million
Currency
USD
Billing conditions
region
scope
zone
geo_region
us
endpoint
baseten | deepseek/deepseek-v4-flash
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash ↗

$0.26

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
baseten | deepseek/deepseek-v4-flash
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash ↗

$0.26

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
output_tokens_per_million
Currency
USD
Billing conditions
region
scope
zone
geo_region
us
endpoint
baseten | deepseek/deepseek-v4-flash
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash ↗

$0.02

Inference provider
vercelAIGatewayCatalog
Platform
deepinfra
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
deepinfra | deepseek/deepseek-v4-flash
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-flash ↗

$0.06

Inference provider
vercelAIGatewayCatalog
Platform
deepinfra
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
deepinfra | deepseek/deepseek-v4-flash
model_type
language
quantization
fp8
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

Provider specifications & access

1–4 / 4

DeepSeek-V4-Flash ↗

source model id
deepseek-ai/DeepSeek-V4-Flash
hosting
siliconflow-hosted
platforms
  • SiliconFlow
max output tokens
393216
architecture
input_modalities
  • text
output_modalities
  • text
capabilities
  • promptCaching
  • reasoning
  • structuredOutputs
  • toolCalling

DeepSeek V4 Flash ↗

source model id
deepseek/deepseek-v4-flash
hosting
vercel-gateway
platforms
  • Vercel AI Gateway
context length
1000000
max output tokens
384000
architecture
input_modalities
  • text
output_modalities
  • text
capabilities
  • promptCaching
  • reasoning
  • structuredOutputs
  • toolCalling
regions
  • us

deepseek-ai/DeepSeek-V4-Flash ↗

source model id
HuggingFace/deepseek-ai-deepseek-v4-flash@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
mit
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    deepseek-ai/DeepSeek-V4-Flash ↗

    source model id
    publishers/deepseek-ai/models/deepseek-v4@deepseek-v4-flash
    hosting
    vertex-self-deployed
    platforms
    • Google Cloud Vertex AI
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      Safety assessments

      1–1 / 1

      Foundation Model Transparency Index 2025 ↗

      32 / 100

      source id
      stanfordFMTI
      canonical model id
      deepseek/deepseek-v4-flash-20260423
      taxonomy
      transparency
      hazard category
      transparency
      hazard name
      Organization transparency
      policy area
      DeepSeek
      assessment type
      organization-level disclosure
      metric
      disclosure_score
      result label
      32 / 100
      sample size
      100
      updated at
      2026-11-09T18:08:05.227Z

      Source specification observations

      1–7 / 7

      openRouter ↗

      field
      context_length
      value
      1048576
      normalized value
      1048576
      scope
      source-model
      source id
      openRouter
      confidence
      1

      siliconFlow ↗

      field
      context_length
      value
      1049K
      scope
      source-model
      source id
      siliconFlow
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      context_length
      value
      1000000
      normalized value
      1000000
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      knowledge_cutoff
      reported field
      knowledge_cutoff
      value
      2025-05
      normalized value
      2025-05
      precision
      month
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      openRouter ↗

      field
      max_output_tokens
      value
      393216
      normalized value
      393216
      scope
      source-model
      source id
      openRouter
      confidence
      1

      siliconFlow ↗

      field
      max_output_tokens
      value
      393K
      scope
      source-model
      source id
      siliconFlow
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      max_output_tokens
      value
      384000
      normalized value
      384000
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      Original sources

      1–20 / 21

      SiliconFlow · Model page ↗

      Hugging Face · Model repository ↗

      Google Cloud · Model page ↗

      Microsoft Foundry · Model page ↗

      OpenRouter · Model page ↗

      SiliconFlow · Playground ↗

      Vercel AI Gateway · Model page ↗

      Google Cloud · Model documentation ↗

      Microsoft Foundry · Model documentation ↗

      SiliconFlow · API documentation ↗

      arXiv · Paper · 2606.19348 ↗

      GitHub · Catalog ↗

      Google Cloud · Catalog ↗

      Hugging Face · Catalog ↗

      Hugging Face · Catalog ↗

      Hugging Face · Catalog ↗

      Microsoft Foundry · Catalog ↗

      OpenRouter · Catalog ↗

      OpenRouter · Catalog ↗

      SiliconFlow · Catalog ↗

      Source links

      1–11 / 11

      Hugging Face model card

      1–1 / 1

      Explore more models

      Models

      Loading
      EVIDENCE / COMPARISON

      Benchmarks

      Explore every benchmark

      Loading

      These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

      Install TensorTrace