DeepSeek: R1

DeepSeek R1 is here: Performance on par with [OpenAI o1](/openai/o1), but open-sourced and with fully open reasoning tokens. It's 671B parameters in size, with 37B active in an inference pass....

deepseek/deepseek-r1

DeepSeek R1 is here: Performance on par with [OpenAI o1](/openai/o1), but open-sourced and with fully open reasoning tokens. It's 671B parameters in size, with 37B active in an inference pass....

Specifications & capabilities

Input
text
Output
text
Context window · tokens
64000
Knowledge cutoff
2024-07
Published model ID
DeepSeek-R1
Capabilities
reasoning, structuredOutputs, toolCalling

Evaluations

1–9 / 9

LLM Stats · GitHub archive

0.959

source id
llmStatsArchive
leaderboard name
MATH-500 · Raw
dimension
general
metric
MATH-500 · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MATH-500
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-07-19T19:56:12.027850+00:00
paper_link
https://arxiv.org/abs/2103.03874
updated_at
2025-07-19T19:56:12.027850+00:00
description
MATH-500 is a subset of the MATH dataset containing 500 challenging competition mathematics problems from AMC 10, AMC 12, AIME, and other mathematics competitions. Each problem includes full step-by-step solutions and spans multiple difficulty levels across seven mathematical subjects including Prealgebra, Algebra, Number Theory, Counting and Probability, Geometry, Intermediate Algebra, and Precalculus.
benchmark_id
math-500
multilingual
false
analysis_method
Pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MATH-500 · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-r1-zero/benchmarks.json
archive_kind
llmStats
evidence_url
https://arxiv.org/abs/2501.12948
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-r1-zero
metric_population
8
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-r1-zero
Original result ↗

LLM Stats · GitHub archive

0.959

source id
llmStatsArchive
leaderboard name
MATH-500 · Normalized (reported)
dimension
general
metric
MATH-500 · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
MATH-500
language
en
modality
text
verified
false
max_score
1
categories
  • math
  • reasoning
created_at
2025-07-19T19:56:12.027850+00:00
paper_link
https://arxiv.org/abs/2103.03874
updated_at
2025-07-19T19:56:12.027850+00:00
description
MATH-500 is a subset of the MATH dataset containing 500 challenging competition mathematics problems from AMC 10, AMC 12, AIME, and other mathematics competitions. Each problem includes full step-by-step solutions and spans multiple difficulty levels across seven mathematical subjects including Prealgebra, Algebra, Number Theory, Counting and Probability, Geometry, Intermediate Algebra, and Precalculus.
benchmark_id
math-500
multilingual
false
analysis_method
Pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
MATH-500 · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-r1-zero/benchmarks.json
archive_kind
llmStats
evidence_url
https://arxiv.org/abs/2501.12948
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-r1-zero
metric_population
8
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-r1-zero
Original result ↗

LLM Stats · GitHub archive

0.733

source id
llmStatsArchive
leaderboard name
GPQA · Normalized (reported)
dimension
general
metric
GPQA · Normalized (reported)
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
GPQA
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
created_at
2025-07-19T19:56:11.588605+00:00
paper_link
https://arxiv.org/abs/2311.12022
updated_at
2025-07-19T19:56:11.588605+00:00
description
A challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry. Questions are Google-proof and extremely difficult, with PhD experts reaching 65% accuracy.
benchmark_id
gpqa
multilingual
false
analysis_method
Pass@1 Diamond
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
GPQA · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-r1-zero/benchmarks.json
archive_kind
llmStats
evidence_url
https://arxiv.org/abs/2501.12948
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-r1-zero
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-r1-zero
Original result ↗

LLM Stats · GitHub archive

0.733

source id
llmStatsArchive
leaderboard name
GPQA · Raw
dimension
general
metric
GPQA · Raw
rank
1
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
GPQA
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
created_at
2025-07-19T19:56:11.588605+00:00
paper_link
https://arxiv.org/abs/2311.12022
updated_at
2025-07-19T19:56:11.588605+00:00
description
A challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry. Questions are Google-proof and extremely difficult, with PhD experts reaching 65% accuracy.
benchmark_id
gpqa
multilingual
false
analysis_method
Pass@1 Diamond
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
GPQA · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-r1-zero/benchmarks.json
archive_kind
llmStats
evidence_url
https://arxiv.org/abs/2501.12948
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-r1-zero
metric_population
1
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-r1-zero
Original result ↗

LLM Stats · GitHub archive

0.5

source id
llmStatsArchive
leaderboard name
LiveCodeBench · Normalized (reported)
dimension
general
metric
LiveCodeBench · Normalized (reported)
rank
4
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
LiveCodeBench
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
  • code
created_at
2025-07-19T19:56:13.292229+00:00
paper_link
https://arxiv.org/abs/2403.07974
updated_at
2025-07-19T19:56:13.292229+00:00
description
LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.
benchmark_id
livecodebench
multilingual
false
analysis_method
Pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
LiveCodeBench · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-r1-zero/benchmarks.json
archive_kind
llmStats
evidence_url
https://arxiv.org/abs/2501.12948
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-r1-zero
metric_population
9
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-r1-zero
Original result ↗

LLM Stats · GitHub archive

0.5

source id
llmStatsArchive
leaderboard name
LiveCodeBench · Raw
dimension
general
metric
LiveCodeBench · Raw
rank
4
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
LiveCodeBench
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • general
  • code
created_at
2025-07-19T19:56:13.292229+00:00
paper_link
https://arxiv.org/abs/2403.07974
updated_at
2025-07-19T19:56:13.292229+00:00
description
LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.
benchmark_id
livecodebench
multilingual
false
analysis_method
Pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
LiveCodeBench · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/deepseek/models/deepseek-r1-zero/benchmarks.json
archive_kind
llmStats
evidence_url
https://arxiv.org/abs/2501.12948
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
deepseek/deepseek-r1-zero
metric_population
9
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
deepseek-r1-zero
Original result ↗

Published prices

1–8 / 8

deepseek-ai/DeepSeek-R1 ↗

$0.50

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
input_tokens_per_million
Currency
USD
Billing conditions
Billing label
Input tokens (per 1M)

deepseek-ai/DeepSeek-R1 ↗

$2.18

Inference provider
siliconFlow
Platform
SiliconFlow
Unit
output_tokens_per_million
Currency
USD
Billing conditions
Billing label
Output tokens (per 1M)

deepseek/deepseek-r1 ↗

$1.35

Inference provider
vercelAIGatewayCatalog
Platform
bedrock
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
bedrock | deepseek/deepseek-r1
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-r1 ↗

$5.40

Inference provider
vercelAIGatewayCatalog
Platform
bedrock
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
bedrock | deepseek/deepseek-r1
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-r1 ↗

$1.35

Inference provider
vercelAIGatewayCatalog
Platform
Vercel AI Gateway
Unit
input_tokens_per_million
Currency
USD
Billing conditions
model_type
language
quote_scope
gateway_catalog
billing_scope
Vercel public catalog; endpoint prices may differ
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

deepseek/deepseek-r1 ↗

$5.40

Inference provider
vercelAIGatewayCatalog
Platform
Vercel AI Gateway
Unit
output_tokens_per_million
Currency
USD
Billing conditions
model_type
language
quote_scope
gateway_catalog
billing_scope
Vercel public catalog; endpoint prices may differ
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

Provider specifications & access

1–4 / 4

DeepSeek-R1 ↗

source model id
deepseek-ai/DeepSeek-R1
hosting
siliconflow-hosted
platforms
  • SiliconFlow
max output tokens
163840
architecture
input_modalities
  • text
output_modalities
  • text
capabilities
  • structuredOutputs
  • toolCalling

DeepSeek-R1 ↗

source model id
deepseek/deepseek-r1
hosting
vercel-gateway
platforms
  • Vercel AI Gateway
context length
128000
max output tokens
8192
architecture
input_modalities
  • text
output_modalities
  • text
capabilities
  • reasoning
  • toolCalling

deepseek-ai/DeepSeek-R1 ↗

source model id
publishers/deepseek-ai/models/deepseek-r1@deepseek-r1
hosting
vertex-self-deployed
platforms
  • Google Cloud Vertex AI
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    deepseek-ai/DeepSeek-R1 ↗

    source model id
    publishers/hf-deepseek-ai/models/deepseek-r1@001
    hosting
    vertex-self-deployed
    platforms
    • Google Cloud Vertex AI
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      Safety assessments

      1–1 / 1

      Foundation Model Transparency Index 2025 ↗

      32 / 100

      source id
      stanfordFMTI
      canonical model id
      deepseek/deepseek-r1
      taxonomy
      transparency
      hazard category
      transparency
      hazard name
      Organization transparency
      policy area
      DeepSeek
      assessment type
      organization-level disclosure
      metric
      disclosure_score
      result label
      32 / 100
      sample size
      100
      updated at
      2026-11-09T18:08:05.227Z

      Source specification observations

      1–5 / 5

      siliconFlow ↗

      field
      context_length
      value
      164K
      scope
      source-model
      source id
      siliconFlow
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      context_length
      value
      128000
      normalized value
      128000
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      knowledge_cutoff
      reported field
      knowledge_cutoff
      value
      2024-07
      normalized value
      2024-07
      precision
      month
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      siliconFlow ↗

      field
      max_output_tokens
      value
      164K
      scope
      source-model
      source id
      siliconFlow
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      max_output_tokens
      value
      8192
      normalized value
      8192
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      Original sources

      1–18 / 18

      SiliconFlow · Model page ↗

      Hugging Face · Model repository ↗

      DeepInfra · Model page ↗

      Google Cloud · Model page ↗

      Google Cloud · Model page ↗

      SiliconFlow · Playground ↗

      Vercel AI Gateway · Model page ↗

      Google Cloud · Model documentation ↗

      SiliconFlow · API documentation ↗

      arXiv · Paper · 2501.12948 ↗

      DeepInfra · Catalog ↗

      GitHub · Catalog ↗

      GitHub · Catalog ↗

      Google Cloud · Catalog ↗

      Hugging Face · Catalog ↗

      Hugging Face · Catalog ↗

      SiliconFlow · Catalog ↗

      Vercel AI Gateway · Catalog ↗

      Source links

      1–9 / 9

      Hugging Face model card

      1–1 / 1

      Explore more models

      Models

      Loading
      EVIDENCE / COMPARISON

      Benchmarks

      Explore every benchmark

      Loading

      These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

      Install TensorTrace