DeepSeek: DeepSeek V4 Pro 0423

DeepSeek V4 Pro is a large-scale Mixture-of-Experts model from DeepSeek with 1.6T total parameters and 49B activated parameters, supporting a 1M-token context window. It is designed for advanced reas…

deepseek/deepseek-v4-pro-20260423

DeepSeek V4 Pro is a large-scale Mixture-of-Experts model from DeepSeek with 1.6T total parameters and 49B activated parameters, supporting a 1M-token context window. It is designed for advanced reasoning, coding, and long-horizon agent workflows, with strong performance across knowledge, math, and software engineering benchmarks.

Built on the same architecture as DeepSeek V4 Flash, it introduces a hybrid attention system for efficient long-context processing. Reasoning efforts high and xhigh are supported; xhigh maps to max reasoning. It is well suited for complex workloads such as full-codebase analysis, multi-step automation, and large-scale information synthesis, where both capability and efficiency are critical

Specifications & capabilities

Input
text
Output
text
Context window · tokens
1048576
Knowledge cutoff
2025-05
Published model ID
DeepSeek-V4-Pro
Capabilities
audioInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling
Description source ↗

Evaluations

21–40 / 67

OpenCompass LLM

91%

source id
openCompass
leaderboard name
Code
dimension
general
metric
Code
rank
5
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
OverallTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Code
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Pro
Original result ↗

OpenCompass LLM

91%

source id
openCompass
leaderboard name
Average
dimension
general
metric
Average
rank
5
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
CodeTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Average
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Pro
Original result ↗

OpenRouter Benchmarks

90.095%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · GMICloud
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
5
sample size
1782
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
9
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
GMICloud
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-10T07:51:59.421Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1782
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.900953777777778
accuracy_std_dev
0.018721426879248864
cost_per_task_usd
0.07315864141414141
output_tokens_per_task
36755.94332210999
latency_seconds_per_task
540.3473451178451
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
26
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenCompass LLM

79.9%

source id
openCompass
leaderboard name
Math_College
dimension
general
metric
Math_College
rank
5
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MathTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Math_College
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Pro
Original result ↗

OpenRouter Benchmarks

76.571%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Venice
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
5
sample size
350
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Venice
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T19:58:31.913Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
350
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7657144285714286
accuracy_std_dev
0.02990523505942035
cost_per_task_usd
0.14187513999999998
output_tokens_per_task
12316.085714285715
latency_seconds_per_task
291.30958571428573
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
38
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenRouter Benchmarks

75.833%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Relace
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
5
sample size
300
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
6
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Relace
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T19:43:05.932Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
300
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7583333333333333
accuracy_std_dev
0.03125451671181126
cost_per_task_usd
0.06620967333333333
output_tokens_per_task
10316.483333333334
latency_seconds_per_task
161.43149
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
13
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenRouter Benchmarks

74%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Crusoe
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
5
sample size
100
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Crusoe
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T19:58:44.255Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
100
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.74
accuracy_std_dev
0.026666999999999996
cost_per_task_usd
0.14729807
output_tokens_per_task
24280.02
latency_seconds_per_task
386.77527000000003
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
13
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenCompass LLM

90.8%

source id
openCompass
leaderboard name
Knowledge_Engineering
dimension
general
metric
Knowledge_Engineering
rank
6
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
KnowledgeTable
catalog
closed
snapshot
month
26-07
fileName
assets/llm-rank/llm-data-v2.26-07.20260824.json
updateTime
2026-08-24
columnFileName
assets/llm-rank/llm-column-v2.26-07.20260824.json
metric_kind
Knowledge_Engineering
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
1-data.json
source_revision
117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
metric_population
15
benchmark_evaluation
true
source model id
DeepSeek-V4-Pro
Original result ↗

OpenRouter Benchmarks

88.71%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Relace
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
6
sample size
1119
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
6
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Relace
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:50:08.743Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1119
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8871015424486148
accuracy_std_dev
0.007433711649565692
cost_per_task_usd
0.100128890974084
output_tokens_per_task
36832.25379803396
latency_seconds_per_task
379.5634110813226
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
13
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenRouter Benchmarks

87.887%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Baidu
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
6
sample size
1581
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
8
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Baidu
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-10T18:38:17.277Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1581
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8788738633776092
accuracy_std_dev
0.01184394360000081
cost_per_task_usd
0.05087817014547753
output_tokens_per_task
36266.31309297913
latency_seconds_per_task
522.7850480708412
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
12
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenRouter Benchmarks

87.461%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Reka
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
6
sample size
1385
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Reka
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-24T16:18:35.554Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1385
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8746087667870037
accuracy_std_dev
0.007592482877484693
cost_per_task_usd
0.2179415407942238
output_tokens_per_task
48485.83321299639
latency_seconds_per_task
1239.9894288808664
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
13
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenRouter Benchmarks

75.81%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · AtlasCloud
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
6
sample size
350
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
AtlasCloud
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T20:03:31.357Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
350
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7580951428571429
accuracy_std_dev
0.032014759919354034
cost_per_task_usd
0.10769543714285713
output_tokens_per_task
11172.16
latency_seconds_per_task
240.79741714285717
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
29
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenRouter Benchmarks

88.889%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Nebius
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
7
sample size
198
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
1
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Nebius
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-03T21:00:06.247Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
198
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.888889
cost_per_task_usd
0.13065590404040406
output_tokens_per_task
36983.707070707074
latency_seconds_per_task
663.1297929292929
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
25
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenRouter Benchmarks

88.861%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Alibaba
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
7
sample size
2560
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
13
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Alibaba
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:08:08.538Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
2560
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8886065933593749
accuracy_std_dev
0.01380537387006623
cost_per_task_usd
0.10022955078125
output_tokens_per_task
34095.671484375
latency_seconds_per_task
460.84662031249997
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
29
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenRouter Benchmarks

87.831%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · AtlasCloud
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
7
sample size
1386
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
AtlasCloud
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:25:53.821Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1386
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8783067142857143
accuracy_std_dev
0.019872992683641802
cost_per_task_usd
0.12211109668109668
output_tokens_per_task
35901.76046176046
latency_seconds_per_task
631.2895389610389
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
30
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenRouter Benchmarks

74.874%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · DigitalOcean
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
7
sample size
396
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
8
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
DigitalOcean
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T20:25:10.002Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
396
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7487373080808083
accuracy_std_dev
0.03476268720171639
cost_per_task_usd
0.08973175505050504
output_tokens_per_task
9930.64898989899
latency_seconds_per_task
588.2207929292929
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
20
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenRouter Benchmarks

88.384%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Together
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
8
sample size
198
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
1
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Together
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-08-22T16:49:15.579Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
198
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.883838
cost_per_task_usd
0.11300773737373737
output_tokens_per_task
32149.79797979798
latency_seconds_per_task
418.1592121212121
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
25
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenRouter Benchmarks

87.963%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · StreamLake
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
8
sample size
1584
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
8
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
StreamLake
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:46:00.416Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1584
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8796295000000002
accuracy_std_dev
0.017716787991901916
cost_per_task_usd
0.02372089204545455
output_tokens_per_task
35952.905303030304
latency_seconds_per_task
758.5891104797979
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
30
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenRouter Benchmarks

77.146%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · DeepInfra
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
8
sample size
299
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
6
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
DeepInfra
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T19:22:52.905Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
299
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7714602976588629
accuracy_std_dev
0.028416062527791094
cost_per_task_usd
0.08344332775919731
output_tokens_per_task
12314.311036789297
latency_seconds_per_task
249.5202474916388
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
63
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

OpenRouter Benchmarks

75.619%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Azure
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
8
sample size
350
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Azure
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T19:18:33.522Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
350
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7561904285714286
accuracy_std_dev
0.020735037227271297
cost_per_task_usd
0.1716927257142857
output_tokens_per_task
11177.605714285713
latency_seconds_per_task
187.05457428571427
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
40
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-v4-pro-20260423
source model id
deepseek/deepseek-v4-pro-20260423
Original result ↗

Published prices

1–20 / 36

deepseek/deepseek-v4-pro ↗

$0.15

Inference provider
cloudflareWorkersAI
Platform
Fireworks AI
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
Billing label
Cached input tokens (per 1M)
Pricing via
Cloudflare AI Gateway

deepseek/deepseek-v4-pro ↗

$1.74

Inference provider
cloudflareWorkersAI
Platform
Fireworks AI
Unit
input_tokens_per_million
Currency
USD
Billing conditions
Billing label
Input tokens (per 1M)
Pricing via
Cloudflare AI Gateway

deepseek/deepseek-v4-pro ↗

$3.48

Inference provider
cloudflareWorkersAI
Platform
Fireworks AI
Unit
output_tokens_per_million
Currency
USD
Billing conditions
Billing label
Output tokens (per 1M)
Pricing via
Cloudflare AI Gateway

deepseek/deepseek-v4-pro ↗

$0.25

Inference provider
openRouter
Platform
OpenRouter
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions

deepseek-ai/DeepSeek-V4-Pro ↗

$0.14

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
Billing label
Cached input tokens (per 1M)

deepseek-ai/DeepSeek-V4-Pro ↗

$1.50

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
input_tokens_per_million
Currency
USD
Billing conditions
Billing label
Input tokens (per 1M)

deepseek-ai/DeepSeek-V4-Pro ↗

$3.14

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
output_tokens_per_million
Currency
USD
Billing conditions
Billing label
Output tokens (per 1M)

deepseek/deepseek-v4-pro ↗

$0.20

Inference provider
vercelAIGatewayCatalog
Platform
alibaba
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
alibaba | deepseek/deepseek-v4-pro
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-pro ↗

$2.40

Inference provider
vercelAIGatewayCatalog
Platform
alibaba
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
alibaba | deepseek/deepseek-v4-pro
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-pro ↗

$4.80

Inference provider
vercelAIGatewayCatalog
Platform
alibaba
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
alibaba | deepseek/deepseek-v4-pro
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-pro ↗

$0.15

Inference provider
vercelAIGatewayCatalog
Platform
azure
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
azure | deepseek/deepseek-v4-pro
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-pro ↗

$1.74

Inference provider
vercelAIGatewayCatalog
Platform
azure
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
azure | deepseek/deepseek-v4-pro
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-pro ↗

$3.48

Inference provider
vercelAIGatewayCatalog
Platform
azure
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
azure | deepseek/deepseek-v4-pro
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-pro ↗

$0.13

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
baseten | deepseek/deepseek-v4-pro
model_type
language
quantization
fp4
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-pro ↗

$0.13

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
region
scope
zone
geo_region
us
endpoint
baseten | deepseek/deepseek-v4-pro
model_type
language
quantization
fp4
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-pro ↗

$1.32

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
baseten | deepseek/deepseek-v4-pro
model_type
language
quantization
fp4
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-pro ↗

$1.32

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
input_tokens_per_million
Currency
USD
Billing conditions
region
scope
zone
geo_region
us
endpoint
baseten | deepseek/deepseek-v4-pro
model_type
language
quantization
fp4
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v4-pro ↗

$3.96

Inference provider
vercelAIGatewayCatalog
Platform
baseten
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
baseten | deepseek/deepseek-v4-pro
model_type
language
quantization
fp4
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

Provider specifications & access

1–4 / 4

DeepSeek-V4-Pro ↗

source model id
deepseek-ai/DeepSeek-V4-Pro
hosting
siliconflow-hosted
platforms
  • SiliconFlow
max output tokens
393216
architecture
input_modalities
  • text
output_modalities
  • text
capabilities
  • promptCaching
  • reasoning
  • structuredOutputs
  • toolCalling

DeepSeek V4 Pro ↗

source model id
deepseek/deepseek-v4-pro
hosting
third-party
platforms
  • Fireworks AI
context length
131072
architecture
input_modalities
  • text
  • audio
output_modalities
  • text
capabilities

    DeepSeek V4 Pro ↗

    source model id
    deepseek/deepseek-v4-pro
    hosting
    vercel-gateway
    platforms
    • Vercel AI Gateway
    context length
    1048600
    max output tokens
    1048600
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities
    • promptCaching
    • reasoning
    • structuredOutputs
    • toolCalling
    regions
    • us

    deepseek-ai/DeepSeek-V4-Pro ↗

    source model id
    publishers/deepseek-ai/models/deepseek-v4@deepseek-v4-pro
    hosting
    vertex-self-deployed
    platforms
    • Google Cloud Vertex AI
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      Safety assessments

      1–1 / 1

      Foundation Model Transparency Index 2025 ↗

      32 / 100

      source id
      stanfordFMTI
      canonical model id
      deepseek/deepseek-v4-pro-20260423
      taxonomy
      transparency
      hazard category
      transparency
      hazard name
      Organization transparency
      policy area
      DeepSeek
      assessment type
      organization-level disclosure
      metric
      disclosure_score
      result label
      32 / 100
      sample size
      100
      updated at
      2026-11-09T18:08:05.227Z

      Source specification observations

      1–8 / 8

      cloudflareWorkersAI ↗

      field
      context_length
      value
      131072
      normalized value
      131072
      scope
      source-model
      source id
      cloudflareWorkersAI
      confidence
      1

      openRouter ↗

      field
      context_length
      value
      1048576
      normalized value
      1048576
      scope
      source-model
      source id
      openRouter
      confidence
      1

      siliconFlow ↗

      field
      context_length
      value
      1049K
      scope
      source-model
      source id
      siliconFlow
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      context_length
      value
      1048600
      normalized value
      1048600
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      knowledge_cutoff
      reported field
      knowledge_cutoff
      value
      2025-05
      normalized value
      2025-05
      precision
      month
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      openRouter ↗

      field
      max_output_tokens
      value
      393216
      normalized value
      393216
      scope
      source-model
      source id
      openRouter
      confidence
      1

      siliconFlow ↗

      field
      max_output_tokens
      value
      393K
      scope
      source-model
      source id
      siliconFlow
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      max_output_tokens
      value
      1048600
      normalized value
      1048600
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      Original sources

      1–19 / 19

      SiliconFlow · Model page ↗

      Hugging Face · Model repository ↗

      Google Cloud · Model page ↗

      OpenRouter · Model page ↗

      SiliconFlow · Playground ↗

      Vercel AI Gateway · Model page ↗

      Google Cloud · Model documentation ↗

      SiliconFlow · API documentation ↗

      GitHub · Source snapshot ↗

      Cloudflare AI · Catalog ↗

      GitHub · Catalog ↗

      Google Cloud · Catalog ↗

      Hugging Face · Catalog ↗

      Hugging Face · Catalog ↗

      Kaggle · Catalog ↗

      OpenRouter · Catalog ↗

      OpenRouter · Catalog ↗

      SiliconFlow · Catalog ↗

      Vercel AI Gateway · Catalog ↗

      Source links

      1–12 / 12

      Explore more models

      Models

      Loading
      EVIDENCE / COMPARISON

      Benchmarks

      Explore every benchmark

      Loading

      These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

      Install TensorTrace