deepseek-v3.1

Explore deepseek-v3.1: model specifications, capabilities, benchmark results, platform pricing and original sources.

cheaperInference/deepseek-v3.1

Specifications & capabilities

Input
text
Output
text
Context window · tokens
128000
Max output · tokens
128000
Knowledge cutoff
2025-03-31
Published model ID
DeepSeek-V3.1
Capabilities
promptCaching, reasoning, structuredOutputs, toolCalling

Evaluations

1–20 / 27

LLM Stats · GitHub archive

0.749

source id
llmStatsArchive
leaderboard name
GPQA · Normalized (reported)
dimension
general
metric
GPQA · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
GPQA
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
created_at
2025-07-19T19:56:11.588605+00:00
paper_link
https://arxiv.org/abs/2311.12022
updated_at
2025-07-19T19:56:11.588605+00:00
description
A challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry. Questions are Google-proof and extremely difficult, with PhD experts reaching 65% accuracy.
benchmark_id
gpqa
multilingual
false
analysis_method
Pass@1, Non-Thinking mode
is_self_reported
true
verification_notes
Non-thinking: 74.9%, Thinking: 80.1%
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
GPQA · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-v3.1/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/deepseek-ai/DeepSeek-V3.1
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-v3.1
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-v3.1
Original result ↗

LLM Stats · GitHub archive

0.749

source id
llmStatsArchive
leaderboard name
GPQA · Raw
dimension
general
metric
GPQA · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
GPQA
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
created_at
2025-07-19T19:56:11.588605+00:00
paper_link
https://arxiv.org/abs/2311.12022
updated_at
2025-07-19T19:56:11.588605+00:00
description
A challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry. Questions are Google-proof and extremely difficult, with PhD experts reaching 65% accuracy.
benchmark_id
gpqa
multilingual
false
analysis_method
Pass@1, Non-Thinking mode
is_self_reported
true
verification_notes
Non-thinking: 74.9%, Thinking: 80.1%
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
GPQA · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-v3.1/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/deepseek-ai/DeepSeek-V3.1
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-v3.1
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-v3.1
Original result ↗

LLM Stats · GitHub archive

0.663

source id
llmStatsArchive
leaderboard name
AIME 2024 · Raw
dimension
general
metric
AIME 2024 · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
AIME 2024
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-07-19T19:56:11.941652+00:00
paper_link
https://arxiv.org/html/2503.21380v2
updated_at
2025-09-30T00:00:00.000000+00:00
description
American Invitational Mathematics Examination 2024, consisting of 30 challenging mathematical reasoning problems from AIME I and AIME II competitions. Each problem requires an integer answer between 0-999 and tests advanced mathematical reasoning across algebra, geometry, combinatorics, and number theory. Used as a benchmark for evaluating mathematical reasoning capabilities in large language models at Olympiad-level difficulty.
benchmark_id
aime-2024
multilingual
false
analysis_method
Pass@1, Non-Thinking mode
is_self_reported
true
verification_notes
Non-thinking: 66.3%, Thinking: 93.1%
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
AIME 2024 · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-v3.1/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/deepseek-ai/DeepSeek-V3.1
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-v3.1
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-v3.1
Original result ↗

LLM Stats · GitHub archive

0.663

source id
llmStatsArchive
leaderboard name
AIME 2024 · Normalized (reported)
dimension
general
metric
AIME 2024 · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
AIME 2024
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-07-19T19:56:11.941652+00:00
paper_link
https://arxiv.org/html/2503.21380v2
updated_at
2025-09-30T00:00:00.000000+00:00
description
American Invitational Mathematics Examination 2024, consisting of 30 challenging mathematical reasoning problems from AIME I and AIME II competitions. Each problem requires an integer answer between 0-999 and tests advanced mathematical reasoning across algebra, geometry, combinatorics, and number theory. Used as a benchmark for evaluating mathematical reasoning capabilities in large language models at Olympiad-level difficulty.
benchmark_id
aime-2024
multilingual
false
analysis_method
Pass@1, Non-Thinking mode
is_self_reported
true
verification_notes
Non-thinking: 66.3%, Thinking: 93.1%
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
AIME 2024 · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-v3.1/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/deepseek-ai/DeepSeek-V3.1
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-v3.1
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-v3.1
Original result ↗

LLM Stats · GitHub archive

0.564

source id
llmStatsArchive
leaderboard name
LiveCodeBench · Raw
dimension
general
metric
LiveCodeBench · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
LiveCodeBench
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
  • code
created_at
2025-07-19T19:56:13.292229+00:00
paper_link
https://arxiv.org/abs/2403.07974
updated_at
2025-07-19T19:56:13.292229+00:00
description
LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.
benchmark_id
livecodebench
multilingual
false
analysis_method
Pass@1, 2408-2505, Non-Thinking mode
is_self_reported
true
verification_notes
Non-thinking: 56.4%, Thinking: 74.8%
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
LiveCodeBench · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-v3.1/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/deepseek-ai/DeepSeek-V3.1
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-v3.1
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-v3.1
Original result ↗

LLM Stats · GitHub archive

0.564

source id
llmStatsArchive
leaderboard name
LiveCodeBench · Normalized (reported)
dimension
general
metric
LiveCodeBench · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
LiveCodeBench
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
  • code
created_at
2025-07-19T19:56:13.292229+00:00
paper_link
https://arxiv.org/abs/2403.07974
updated_at
2025-07-19T19:56:13.292229+00:00
description
LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.
benchmark_id
livecodebench
multilingual
false
analysis_method
Pass@1, 2408-2505, Non-Thinking mode
is_self_reported
true
verification_notes
Non-thinking: 56.4%, Thinking: 74.8%
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
LiveCodeBench · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-v3.1/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/deepseek-ai/DeepSeek-V3.1
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-v3.1
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-v3.1
Original result ↗

LLM Stats · GitHub archive

0.498

source id
llmStatsArchive
leaderboard name
AIME 2025 · Raw
dimension
general
metric
AIME 2025 · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
AIME 2025
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2503.21380
updated_at
2025-09-05T00:00:00.000000+00:00
description
All 30 problems from the 2025 American Invitational Mathematics Examination (AIME I and AIME II), testing olympiad-level mathematical reasoning with integer answers from 000-999. Used as an AI benchmark to evaluate large language models' ability to solve complex mathematical problems requiring multi-step logical deductions and structured symbolic reasoning.
benchmark_id
aime-2025
multilingual
false
analysis_method
Pass@1, Non-Thinking mode
is_self_reported
true
verification_notes
Non-thinking: 49.8%, Thinking: 88.4%
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
AIME 2025 · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-v3.1/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/deepseek-ai/DeepSeek-V3.1
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-v3.1
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-v3.1
Original result ↗

LLM Stats · GitHub archive

0.498

source id
llmStatsArchive
leaderboard name
AIME 2025 · Normalized (reported)
dimension
general
metric
AIME 2025 · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
AIME 2025
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
https://arxiv.org/abs/2503.21380
updated_at
2025-09-05T00:00:00.000000+00:00
description
All 30 problems from the 2025 American Invitational Mathematics Examination (AIME I and AIME II), testing olympiad-level mathematical reasoning with integer answers from 000-999. Used as an AI benchmark to evaluate large language models' ability to solve complex mathematical problems requiring multi-step logical deductions and structured symbolic reasoning.
benchmark_id
aime-2025
multilingual
false
analysis_method
Pass@1, Non-Thinking mode
is_self_reported
true
verification_notes
Non-thinking: 49.8%, Thinking: 88.4%
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
AIME 2025 · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-v3.1/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/deepseek-ai/DeepSeek-V3.1
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-v3.1
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-v3.1
Original result ↗

LLM Stats · GitHub archive

0.335

source id
llmStatsArchive
leaderboard name
HMMT 2025 · Raw
dimension
general
metric
HMMT 2025 · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HMMT 2025
language
en
modality
text
verified
false
max_score
1
categories
  • math
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
http://web.mit.edu/HMMT/www/
updated_at
2025-09-05T00:00:00.000000+00:00
description
Harvard-MIT Mathematics Tournament 2025 - A prestigious student-organized mathematics competition for high school students featuring two tournaments (November 2025 at MIT and February 2026 at Harvard) with individual tests, team rounds, and guts rounds
benchmark_id
hmmt-2025
multilingual
false
analysis_method
Pass@1, Non-Thinking mode
is_self_reported
true
verification_notes
Non-thinking: 33.5%, Thinking: 84.2%
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HMMT 2025 · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-v3.1/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/deepseek-ai/DeepSeek-V3.1
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-v3.1
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-v3.1
Original result ↗

LLM Stats · GitHub archive

0.335

source id
llmStatsArchive
leaderboard name
HMMT 2025 · Normalized (reported)
dimension
general
metric
HMMT 2025 · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HMMT 2025
language
en
modality
text
verified
false
max_score
1
categories
  • math
created_at
2025-09-05T00:00:00.000000+00:00
paper_link
http://web.mit.edu/HMMT/www/
updated_at
2025-09-05T00:00:00.000000+00:00
description
Harvard-MIT Mathematics Tournament 2025 - A prestigious student-organized mathematics competition for high school students featuring two tournaments (November 2025 at MIT and February 2026 at Harvard) with individual tests, team rounds, and guts rounds
benchmark_id
hmmt-2025
multilingual
false
analysis_method
Pass@1, Non-Thinking mode
is_self_reported
true
verification_notes
Non-thinking: 33.5%, Thinking: 84.2%
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HMMT 2025 · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-v3.1/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/deepseek-ai/DeepSeek-V3.1
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-v3.1
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-v3.1
Original result ↗

LLM Stats · GitHub archive

0.159

source id
llmStatsArchive
leaderboard name
Humanity's Last Exam · Normalized (reported)
dimension
general
metric
Humanity's Last Exam · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Humanity's Last Exam
language
en
modality
multimodal
verified
false
max_score
1
categories
  • general
created_at
2025-07-19T19:56:12.507693+00:00
paper_link
https://arxiv.org/abs/2501.14249
updated_at
2025-07-19T19:56:12.507693+00:00
description
A multi-modal benchmark at the frontier of human knowledge with 2,500 questions across dozens of subjects including mathematics, humanities, and natural sciences, created by nearly 1000 subject expert contributors from over 500 institutions
benchmark_id
humanity's-last-exam
multilingual
false
analysis_method
Pass@1, Thinking mode, text-only subset
is_self_reported
true
verification_notes
Thinking mode only, text-only subset
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Humanity's Last Exam · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-v3.1/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/deepseek-ai/DeepSeek-V3.1
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-v3.1
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-v3.1
Original result ↗

LLM Stats · GitHub archive

0.159

source id
llmStatsArchive
leaderboard name
Humanity's Last Exam · Raw
dimension
general
metric
Humanity's Last Exam · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Humanity's Last Exam
language
en
modality
multimodal
verified
false
max_score
1
categories
  • general
created_at
2025-07-19T19:56:12.507693+00:00
paper_link
https://arxiv.org/abs/2501.14249
updated_at
2025-07-19T19:56:12.507693+00:00
description
A multi-modal benchmark at the frontier of human knowledge with 2,500 questions across dozens of subjects including mathematics, humanities, and natural sciences, created by nearly 1000 subject expert contributors from over 500 institutions
benchmark_id
humanity's-last-exam
multilingual
false
analysis_method
Pass@1, Thinking mode, text-only subset
is_self_reported
true
verification_notes
Thinking mode only, text-only subset
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Humanity's Last Exam · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-v3.1/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/deepseek-ai/DeepSeek-V3.1
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-v3.1
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-v3.1
Original result ↗

OpenRouter Benchmarks

72.941%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Mara
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
4
sample size
866
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
6
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Mara
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:30:53.500Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
866
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.7294072124711316
accuracy_std_dev
0.019970689066868837
cost_per_task_usd
0.016059699769053117
output_tokens_per_task
9232.347575057736
latency_seconds_per_task
62.64789953810624
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
5
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-chat-v3.1
source model id
deepseek/deepseek-chat-v3.1
Original result ↗

OpenRouter Benchmarks

68.218%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · SambaNova
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
6
sample size
677
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
6
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
SambaNova
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:13:09.867Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
677
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.6821764194977844
accuracy_std_dev
0.028397019030270698
cost_per_task_usd
0.008931531757754801
output_tokens_per_task
5789.069423929099
latency_seconds_per_task
55.086472673559825
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
8
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-chat-v3.1
source model id
deepseek/deepseek-chat-v3.1
Original result ↗

OpenRouter Benchmarks

78.884%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · CoreWeave
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
19
sample size
1386
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
CoreWeave
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T16:10:36.260Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1386
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.7888407142857142
accuracy_std_dev
0.009727651246601654
cost_per_task_usd
0.0210191240981241
output_tokens_per_task
12493.777056277057
latency_seconds_per_task
240.1967041847042
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
27
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-chat-v3.1
source model id
deepseek/deepseek-chat-v3.1
Original result ↗

OpenRouter Benchmarks

34.014%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · CoreWeave
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
20
sample size
196
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
4
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
CoreWeave
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-10T18:31:45.008Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
196
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.34013619387755106
accuracy_std_dev
0.08215978685882466
cost_per_task_usd
0.5213178979591837
output_tokens_per_task
21094.061224489797
latency_seconds_per_task
540.5083367346939
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
22
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-chat-v3.1
source model id
deepseek/deepseek-chat-v3.1
Original result ↗

OpenRouter Benchmarks

73%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Novita
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
23
sample size
100
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Novita
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-08-30T00:01:09.483Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
100
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.73
accuracy_std_dev
0.016666999999999987
cost_per_task_usd
0.06303523999999999
output_tokens_per_task
14652.21
latency_seconds_per_task
517.27701
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
52
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-chat-v3.1
source model id
deepseek/deepseek-chat-v3.1
Original result ↗

OpenRouter Benchmarks

53.333%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · SiliconFlow
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
23
sample size
350
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
7
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
SiliconFlow
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T19:28:47.220Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
350
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.5333334285714285
accuracy_std_dev
0.019518099050128128
cost_per_task_usd
0.06718807142857143
output_tokens_per_task
4054.082857142857
latency_seconds_per_task
288.83563714285714
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
28
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-chat-v3.1
source model id
deepseek/deepseek-chat-v3.1
Original result ↗

OpenRouter Benchmarks

79.798%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · AtlasCloud
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
24
sample size
594
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
3
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
AtlasCloud
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-04T00:00:36.942Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
594
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.7979796666666666
accuracy_std_dev
0.004956316261992276
cost_per_task_usd
0.014001683501683501
output_tokens_per_task
14266.20707070707
latency_seconds_per_task
340.3738703703704
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
30
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-chat-v3.1
source model id
deepseek/deepseek-chat-v3.1
Original result ↗

OpenRouter Benchmarks

74.916%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Google
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
29
sample size
198
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
1
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Google
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-08-22T17:12:08.919Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
198
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.749158
cost_per_task_usd
0.021431318181818183
output_tokens_per_task
12443.959595959595
latency_seconds_per_task
113.9076616161616
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
40
benchmark_evaluation
true
openrouter_permaslug
deepseek/deepseek-chat-v3.1
source model id
deepseek/deepseek-chat-v3.1
Original result ↗

Published prices

1–14 / 14

deepseek-v3.1 ↗

$0.08

Inference provider
cheaperInference
Platform
Cheaper Inference
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
zdr
false
protocol
chat_completions
service_tier
standard
Billing label
Cached input tokens (per 1M)

deepseek-v3.1 ↗

$0.16

Inference provider
cheaperInference
Platform
Cheaper Inference
Unit
input_tokens_per_million
Currency
USD
Billing conditions
zdr
false
protocol
chat_completions
service_tier
standard
Billing label
Input tokens (per 1M)

deepseek-v3.1 ↗

$0.62

Inference provider
cheaperInference
Platform
Cheaper Inference
Unit
output_tokens_per_million
Currency
USD
Billing conditions
zdr
false
protocol
chat_completions
service_tier
standard
Billing label
Output tokens (per 1M)

deepseek-ai/DeepSeek-V3.1 ↗

$0.27

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
input_tokens_per_million
Currency
USD
Billing conditions
Billing label
Input tokens (per 1M)

deepseek-ai/DeepSeek-V3.1 ↗

$1.00

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
output_tokens_per_million
Currency
USD
Billing conditions
Billing label
Output tokens (per 1M)

deepseek/deepseek-v3.1 ↗

$0.13

Inference provider
vercelAIGatewayCatalog
Platform
deepinfra
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
deepinfra | deepseek/deepseek-v3.1
model_type
language
quantization
fp4
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v3.1 ↗

$0.25

Inference provider
vercelAIGatewayCatalog
Platform
deepinfra
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
deepinfra | deepseek/deepseek-v3.1
model_type
language
quantization
fp4
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v3.1 ↗

$0.95

Inference provider
vercelAIGatewayCatalog
Platform
deepinfra
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
deepinfra | deepseek/deepseek-v3.1
model_type
language
quantization
fp4
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v3.1 ↗

$0.13

Inference provider
vercelAIGatewayCatalog
Platform
Vercel AI Gateway
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
model_type
language
quote_scope
gateway_catalog
billing_scope
Vercel public catalog; endpoint prices may differ
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v3.1 ↗

$0.25

Inference provider
vercelAIGatewayCatalog
Platform
Vercel AI Gateway
Unit
input_tokens_per_million
Currency
USD
Billing conditions
model_type
language
quote_scope
gateway_catalog
billing_scope
Vercel public catalog; endpoint prices may differ
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-v3.1 ↗

$0.95

Inference provider
vercelAIGatewayCatalog
Platform
Vercel AI Gateway
Unit
output_tokens_per_million
Currency
USD
Billing conditions
model_type
language
quote_scope
gateway_catalog
billing_scope
Vercel public catalog; endpoint prices may differ
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

Provider specifications & access

1–5 / 5

DeepSeek-V3.1 ↗

source model id
deepseek-ai/DeepSeek-V3.1
hosting
siliconflow-hosted
platforms
  • SiliconFlow
max output tokens
163840
architecture
input_modalities
  • text
output_modalities
  • text
capabilities
  • reasoning
  • structuredOutputs
  • toolCalling

DeepSeek V3.1 ↗

source model id
deepseek/deepseek-v3.1
hosting
vercel-gateway
platforms
  • Vercel AI Gateway
context length
163840
max output tokens
128000
architecture
input_modalities
  • text
output_modalities
  • text
capabilities
  • promptCaching
  • reasoning
  • structuredOutputs
  • toolCalling

deepseek-v3.1 ↗

source model id
deepseek-v3.1
hosting
gateway
platforms
  • Cheaper Inference
context length
128000
max output tokens
128000
architecture
input_modalities
  • text
output_modalities
  • text
capabilities
  • structuredOutputs
  • toolCalling

deepseek-ai/DeepSeek-V3.1 ↗

source model id
publishers/deepseek-ai/models/deepseek-v3-1@deepseek-v3-1
hosting
vertex-self-deployed
platforms
  • Google Cloud Vertex AI
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    deepseek-ai/DeepSeek-V3.1 ↗

    source model id
    publishers/hf-deepseek-ai/models/deepseek-v3.1@001
    hosting
    vertex-self-deployed
    platforms
    • Google Cloud Vertex AI
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      Safety assessments

      1–1 / 1

      Foundation Model Transparency Index 2025 ↗

      32 / 100

      source id
      stanfordFMTI
      canonical model id
      cheaperInference/deepseek-v3.1
      taxonomy
      transparency
      hazard category
      transparency
      hazard name
      Organization transparency
      policy area
      DeepSeek
      assessment type
      organization-level disclosure
      metric
      disclosure_score
      result label
      32 / 100
      sample size
      100
      updated at
      2026-11-09T18:08:05.227Z

      Source specification observations

      1–7 / 7

      openRouter ↗

      field
      context_length
      value
      163840
      normalized value
      163840
      scope
      source-model
      source id
      openRouter
      confidence
      1

      siliconFlow ↗

      field
      context_length
      value
      164K
      scope
      source-model
      source id
      siliconFlow
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      context_length
      value
      163840
      normalized value
      163840
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      openRouter ↗

      field
      knowledge_cutoff
      reported field
      knowledge_cutoff
      value
      2025-03-31
      normalized value
      2025-03-31
      precision
      day
      scope
      source-model
      source id
      openRouter
      confidence
      1

      openRouter ↗

      field
      max_output_tokens
      value
      147456
      normalized value
      147456
      scope
      source-model
      source id
      openRouter
      confidence
      1

      siliconFlow ↗

      field
      max_output_tokens
      value
      164K
      scope
      source-model
      source id
      siliconFlow
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      max_output_tokens
      value
      128000
      normalized value
      128000
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      Original sources

      1–16 / 16

      SiliconFlow · Model page ↗

      Hugging Face · Model repository ↗

      Google Cloud · Model page ↗

      Google Cloud · Model page ↗

      OpenRouter · Model page ↗

      SiliconFlow · Playground ↗

      Vercel AI Gateway · Model page ↗

      SiliconFlow · API documentation ↗

      api.cheaperinference.com · Source snapshot ↗

      GitHub · Catalog ↗

      GitHub · Catalog ↗

      Google Cloud · Catalog ↗

      OpenRouter · Catalog ↗

      OpenRouter · Catalog ↗

      SiliconFlow · Catalog ↗

      Vercel AI Gateway · Catalog ↗

      Source links

      1–9 / 9

      Explore more models

      Models

      Loading
      EVIDENCE / COMPARISON

      Benchmarks

      Explore every benchmark

      Loading

      These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

      Install TensorTrace