Google: Gemini 2.5 Pro

Gemini 2.5 Pro is Google’s state-of-the-art AI model designed for advanced reasoning, coding, mathematics, and scientific tasks. It employs “thinking” capabilities, enabling it to reason through resp…

google/gemini-2.5-pro

Gemini 2.5 Pro is Google’s state-of-the-art AI model designed for advanced reasoning, coding, mathematics, and scientific tasks. It employs “thinking” capabilities, enabling it to reason through responses with enhanced accuracy and nuanced context handling. Gemini 2.5 Pro achieves top-tier performance on multiple benchmarks, including first-place positioning on the LMArena leaderboard, reflecting superior human-preference alignment and complex problem-solving abilities.

Specifications & capabilities

Input
text, image, file, audio, video
Output
text
Context window · tokens
1048576
Knowledge cutoff
2025-01
Published model ID
gemini-2.5-pro@default
Capabilities
audioInput, batch, fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput, webSearch
Description source ↗

Evaluations

1–20 / 1,319

Kaggle Benchmarks

81.081

source id
kaggleBenchmarks
leaderboard name
ICML 2025 Experts · Unnamed task
dimension
reasoning
metric
ICML 2025 Experts · Unnamed task
rank
1
aggregation scope
kaggle
true
status
published
license
Apache-2.0
direction
higherIsBetter
conditions
task
id
224
name
Unnamed task
version
1
sort_order
DESCENDING
display_type
rawValues
benchmark
id
134
name
ICML 2025 Experts
type
INDIVIDUAL
owner
kaggle
version
1
categories
  • general knowledge and reasoning
version_id
120
maintainer_tier
Kaggle-published
candidate
candidate_class
modelVersion
record_kind
aggregate
attribution
Kaggle · kaggle · ICML 2025 Experts
license_url
https://www.apache.org/licenses/LICENSE-2.0
metric_kind
ICML 2025 Experts · Unnamed task
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
120/leaderboard.json
source_page
https://www.kaggle.com/benchmarks/kaggle/icml-2025-experts/versions/1
measurements
  • name
    Unnamed task
    unit
    score
    scale
    1
    metric
    ICML 2025 Experts · Unnamed task
    result
    resultCase
    numericResult
    booleanResult
    false
    numericResult
    value
    81.08108108108108
    standardDeviation
    0
    confidenceInterval
    0
    hasStandardDeviation
    false
    hasConfidenceInterval
    false
    hasUnevenConfidenceInterval
    false
    taskVersionId
    0
    evaluationDate
    2025-07-22T03:26:43.646678Z
    hasBooleanResult
    false
    hasNumericResult
    true
    hasTaskVersionId
    false
    hasEvaluationDate
    true
    numericResultNullable
    value
    81.08108108108108
    standardDeviation
    0
    confidenceInterval
    0
    hasStandardDeviation
    false
    hasConfidenceInterval
    false
    hasUnevenConfidenceInterval
    false
    hasNumericResultPublic
    false
    customAdditionalResults
      hasNumericResultPrivate
      false
      task_id
      224
      sort_order
      DESCENDING
      display_type
      rawValues
      task_version
      1
      task_display_type
      RAW_VALUES
      normalization_status
      normalized
    published_at
    2025-07-21T23:06:01.776159Z
    candidate_class
    modelVersion
    source_revision
    b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
    publisher_anchor
    google/gemini-2.5-pro
    metric_population
    6
    benchmark_evaluation
    true
    task_metadata_source
    benchmarkVersion
    candidate_metadata_source
    benchmarkVersionMappings
    evaluated at
    2025-07-22T03:26:43.646Z
    source model id
    Gemini 2.5 Pro
    Original result ↗

    Kaggle Benchmarks

    77.142

    source id
    kaggleBenchmarks
    leaderboard name
    IndicGenBench · Average
    dimension
    general
    metric
    IndicGenBench · Average
    rank
    1
    aggregation scope
    kaggle
    true
    status
    published
    license
    Apache-2.0
    direction
    higherIsBetter
    conditions
    task
    id
    897
    name
    Average
    version
    1
    sort_order
    DESCENDING
    display_type
    counts
    benchmark
    id
    212
    name
    IndicGenBench
    type
    SUITE
    owner
    deepmind
    version
    1
    categories
    • multilingual and cross-lingual capabilities
    version_id
    191
    maintainer_tier
    Kaggle-maintained
    maintenance_level
    KAGGLE_MAINTAINED
    candidate
    candidate_class
    modelVersion
    record_kind
    aggregate
    attribution
    Kaggle · deepmind · IndicGenBench
    license_url
    https://www.apache.org/licenses/LICENSE-2.0
    metric_kind
    IndicGenBench · Average
    rank_method
    competition rank among reported evaluations in identical conditions, including unlinked observations
    source_file
    191/leaderboard.json
    source_page
    https://www.kaggle.com/benchmarks/deepmind/indic-gen-bench/versions/1
    measurements
    • name
      Average
      unit
      score
      scale
      1
      metric
      IndicGenBench · Average
      result
      resultCase
      numericResult
      booleanResult
      false
      numericResult
      value
      77.14182270156253
      standardDeviation
      0
      confidenceInterval
      0
      hasStandardDeviation
      false
      hasConfidenceInterval
      false
      hasUnevenConfidenceInterval
      false
      taskVersionId
      0
      evaluationDate
      2025-10-29T00:38:04.288378Z
      hasBooleanResult
      false
      hasNumericResult
      true
      hasTaskVersionId
      false
      hasEvaluationDate
      true
      numericResultNullable
      value
      77.14182270156253
      standardDeviation
      0
      confidenceInterval
      0
      hasStandardDeviation
      false
      hasConfidenceInterval
      false
      hasUnevenConfidenceInterval
      false
      hasNumericResultPublic
      false
      customAdditionalResults
        hasNumericResultPrivate
        false
        task_id
        897
        sort_order
        DESCENDING
        source_name
        Average
        display_type
        counts
        task_version
        1
        task_display_type
        COUNTS
        normalization_status
        normalized
      published_at
      2025-12-04T15:09:28.942941700Z
      candidate_class
      modelVersion
      source_revision
      b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      14
      benchmark_evaluation
      true
      task_metadata_source
      benchmarkVersion
      candidate_metadata_source
      benchmarkVersionMappings
      evaluated at
      2025-10-29T00:38:04.288Z
      source model id
      Gemini 2.5 Pro
      Original result ↗

      LLM Stats · GitHub archive

      0.92

      source id
      llmStatsArchive
      leaderboard name
      AIME 2024 · Raw
      dimension
      general
      metric
      AIME 2024 · Raw
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      AIME 2024
      language
      en
      modality
      text
      verified
      false
      max_score
      1
      categories
      • math
      • reasoning
      created_at
      2025-07-19T19:56:11.941652+00:00
      paper_link
      https://arxiv.org/html/2503.21380v2
      updated_at
      2025-09-30T00:00:00.000000+00:00
      description
      American Invitational Mathematics Examination 2024, consisting of 30 challenging mathematical reasoning problems from AIME I and AIME II competitions. Each problem requires an integer answer between 0-999 and tests advanced mathematical reasoning across algebra, geometry, combinatorics, and number theory. Used as a benchmark for evaluating mathematical reasoning capabilities in large language models at Olympiad-level difficulty.
      benchmark_id
      aime-2024
      multilingual
      false
      analysis_method
      Pass@1
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      AIME 2024 · Raw
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      5
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.92

      source id
      llmStatsArchive
      leaderboard name
      AIME 2024 · Normalized (reported)
      dimension
      general
      metric
      AIME 2024 · Normalized (reported)
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      AIME 2024
      language
      en
      modality
      text
      verified
      false
      max_score
      1
      categories
      • math
      • reasoning
      created_at
      2025-07-19T19:56:11.941652+00:00
      paper_link
      https://arxiv.org/html/2503.21380v2
      updated_at
      2025-09-30T00:00:00.000000+00:00
      description
      American Invitational Mathematics Examination 2024, consisting of 30 challenging mathematical reasoning problems from AIME I and AIME II competitions. Each problem requires an integer answer between 0-999 and tests advanced mathematical reasoning across algebra, geometry, combinatorics, and number theory. Used as a benchmark for evaluating mathematical reasoning capabilities in large language models at Olympiad-level difficulty.
      benchmark_id
      aime-2024
      multilingual
      false
      analysis_method
      Pass@1
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      AIME 2024 · Normalized (reported)
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      5
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.886

      source id
      llmStatsArchive
      leaderboard name
      Global-MMLU-Lite · Normalized (reported)
      dimension
      general
      metric
      Global-MMLU-Lite · Normalized (reported)
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      Global-MMLU-Lite
      language
      en
      modality
      text
      verified
      false
      max_score
      1
      categories
      • general
      • language
      • reasoning
      created_at
      2025-07-19T19:56:13.534515+00:00
      paper_link
      https://arxiv.org/abs/2412.03304
      updated_at
      2025-07-19T19:56:13.534515+00:00
      description
      A lightweight version of Global MMLU benchmark that evaluates language models across multiple languages while addressing cultural and linguistic biases in multilingual evaluation.
      benchmark_id
      global-mmlu-lite
      multilingual
      true
      analysis_method
      Accuracy
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      Global-MMLU-Lite · Normalized (reported)
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      2
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.886

      source id
      llmStatsArchive
      leaderboard name
      Global-MMLU-Lite · Raw
      dimension
      general
      metric
      Global-MMLU-Lite · Raw
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      Global-MMLU-Lite
      language
      en
      modality
      text
      verified
      false
      max_score
      1
      categories
      • general
      • language
      • reasoning
      created_at
      2025-07-19T19:56:13.534515+00:00
      paper_link
      https://arxiv.org/abs/2412.03304
      updated_at
      2025-07-19T19:56:13.534515+00:00
      description
      A lightweight version of Global MMLU benchmark that evaluates language models across multiple languages while addressing cultural and linguistic biases in multilingual evaluation.
      benchmark_id
      global-mmlu-lite
      multilingual
      true
      analysis_method
      Accuracy
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      Global-MMLU-Lite · Raw
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      2
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.848

      source id
      llmStatsArchive
      leaderboard name
      Video-MME · Normalized (reported)
      dimension
      general
      metric
      Video-MME · Normalized (reported)
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      Video-MME
      language
      en
      modality
      multimodal
      verified
      false
      max_score
      1
      categories
      • multimodal
      • vision
      • reasoning
      created_at
      2025-07-19T19:56:13.901883+00:00
      paper_link
      https://arxiv.org/abs/2405.21075
      updated_at
      2025-07-19T19:56:13.901883+00:00
      description
      Video-MME is the first-ever comprehensive evaluation benchmark of Multi-modal Large Language Models (MLLMs) in video analysis. It features 900 videos totaling 254 hours with 2,700 human-annotated question-answer pairs across 6 primary visual domains (Knowledge, Film & Television, Sports Competition, Life Record, Multilingual, and others) and 30 subfields. The benchmark evaluates models across diverse temporal dimensions (11 seconds to 1 hour), integrates multi-modal inputs including video frames, subtitles, and audio, and uses rigorous manual labeling by expert annotators for precise assessment.
      benchmark_id
      video-mme
      multilingual
      true
      analysis_method
      Accuracy
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      Video-MME · Normalized (reported)
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      3
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.848

      source id
      llmStatsArchive
      leaderboard name
      Video-MME · Raw
      dimension
      general
      metric
      Video-MME · Raw
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      Video-MME
      language
      en
      modality
      multimodal
      verified
      false
      max_score
      1
      categories
      • multimodal
      • vision
      • reasoning
      created_at
      2025-07-19T19:56:13.901883+00:00
      paper_link
      https://arxiv.org/abs/2405.21075
      updated_at
      2025-07-19T19:56:13.901883+00:00
      description
      Video-MME is the first-ever comprehensive evaluation benchmark of Multi-modal Large Language Models (MLLMs) in video analysis. It features 900 videos totaling 254 hours with 2,700 human-annotated question-answer pairs across 6 primary visual domains (Knowledge, Film & Television, Sports Competition, Life Record, Multilingual, and others) and 30 subfields. The benchmark evaluates models across diverse temporal dimensions (11 seconds to 1 hour), integrates multi-modal inputs including video frames, subtitles, and audio, and uses rigorous manual labeling by expert annotators for precise assessment.
      benchmark_id
      video-mme
      multilingual
      true
      analysis_method
      Accuracy
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      Video-MME · Raw
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      3
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.83

      source id
      llmStatsArchive
      leaderboard name
      AIME 2025 · Raw
      dimension
      general
      metric
      AIME 2025 · Raw
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      AIME 2025
      language
      en
      modality
      text
      verified
      false
      max_score
      1
      categories
      • math
      • reasoning
      created_at
      2025-09-05T00:00:00.000000+00:00
      paper_link
      https://arxiv.org/abs/2503.21380
      updated_at
      2025-09-05T00:00:00.000000+00:00
      description
      All 30 problems from the 2025 American Invitational Mathematics Examination (AIME I and AIME II), testing olympiad-level mathematical reasoning with integer answers from 000-999. Used as an AI benchmark to evaluate large language models' ability to solve complex mathematical problems requiring multi-step logical deductions and structured symbolic reasoning.
      benchmark_id
      aime-2025
      multilingual
      false
      analysis_method
      Pass@1
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      AIME 2025 · Raw
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      2
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.83

      source id
      llmStatsArchive
      leaderboard name
      GPQA · Raw
      dimension
      general
      metric
      GPQA · Raw
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      GPQA
      language
      en
      modality
      text
      verified
      false
      max_score
      1
      categories
      • reasoning
      • general
      created_at
      2025-07-19T19:56:11.588605+00:00
      paper_link
      https://arxiv.org/abs/2311.12022
      updated_at
      2025-07-19T19:56:11.588605+00:00
      description
      A challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry. Questions are Google-proof and extremely difficult, with PhD experts reaching 65% accuracy.
      benchmark_id
      gpqa
      multilingual
      false
      analysis_method
      Pass@1
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      GPQA · Raw
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      5
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.83

      source id
      llmStatsArchive
      leaderboard name
      AIME 2025 · Normalized (reported)
      dimension
      general
      metric
      AIME 2025 · Normalized (reported)
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      AIME 2025
      language
      en
      modality
      text
      verified
      false
      max_score
      1
      categories
      • math
      • reasoning
      created_at
      2025-09-05T00:00:00.000000+00:00
      paper_link
      https://arxiv.org/abs/2503.21380
      updated_at
      2025-09-05T00:00:00.000000+00:00
      description
      All 30 problems from the 2025 American Invitational Mathematics Examination (AIME I and AIME II), testing olympiad-level mathematical reasoning with integer answers from 000-999. Used as an AI benchmark to evaluate large language models' ability to solve complex mathematical problems requiring multi-step logical deductions and structured symbolic reasoning.
      benchmark_id
      aime-2025
      multilingual
      false
      analysis_method
      Pass@1
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      AIME 2025 · Normalized (reported)
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      2
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.83

      source id
      llmStatsArchive
      leaderboard name
      GPQA · Normalized (reported)
      dimension
      general
      metric
      GPQA · Normalized (reported)
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      GPQA
      language
      en
      modality
      text
      verified
      false
      max_score
      1
      categories
      • reasoning
      • general
      created_at
      2025-07-19T19:56:11.588605+00:00
      paper_link
      https://arxiv.org/abs/2311.12022
      updated_at
      2025-07-19T19:56:11.588605+00:00
      description
      A challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry. Questions are Google-proof and extremely difficult, with PhD experts reaching 65% accuracy.
      benchmark_id
      gpqa
      multilingual
      false
      analysis_method
      Pass@1
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      GPQA · Normalized (reported)
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      5
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.756

      source id
      llmStatsArchive
      leaderboard name
      LiveCodeBench v5 · Normalized (reported)
      dimension
      general
      metric
      LiveCodeBench v5 · Normalized (reported)
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      LiveCodeBench v5
      language
      en
      modality
      text
      verified
      false
      max_score
      1
      categories
      • reasoning
      • general
      created_at
      2025-07-19T19:56:13.759330+00:00
      paper_link
      https://arxiv.org/abs/2403.07974
      updated_at
      2025-07-19T19:56:13.759330+00:00
      description
      LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.
      benchmark_id
      livecodebench-v5
      multilingual
      false
      analysis_method
      Pass@1
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      LiveCodeBench v5 · Normalized (reported)
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      3
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.756

      source id
      llmStatsArchive
      leaderboard name
      LiveCodeBench v5 · Raw
      dimension
      general
      metric
      LiveCodeBench v5 · Raw
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      LiveCodeBench v5
      language
      en
      modality
      text
      verified
      false
      max_score
      1
      categories
      • reasoning
      • general
      created_at
      2025-07-19T19:56:13.759330+00:00
      paper_link
      https://arxiv.org/abs/2403.07974
      updated_at
      2025-07-19T19:56:13.759330+00:00
      description
      LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.
      benchmark_id
      livecodebench-v5
      multilingual
      false
      analysis_method
      Pass@1
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      LiveCodeBench v5 · Raw
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      3
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.656

      source id
      llmStatsArchive
      leaderboard name
      Vibe-Eval · Normalized (reported)
      dimension
      general
      metric
      Vibe-Eval · Normalized (reported)
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      Vibe-Eval
      language
      en
      modality
      multimodal
      verified
      false
      max_score
      1
      categories
      • multimodal
      • vision
      • general
      created_at
      2025-07-19T19:56:13.871369+00:00
      paper_link
      https://arxiv.org/abs/2405.02287
      updated_at
      2025-07-19T19:56:13.871369+00:00
      description
      VIBE-Eval is a hard evaluation suite for measuring progress of multimodal language models, consisting of 269 visual understanding prompts with gold-standard responses authored by experts. The benchmark has dual objectives: vibe checking multimodal chat models for day-to-day tasks and rigorously testing frontier models, with the hard set containing >50% questions that all frontier models answer incorrectly.
      benchmark_id
      vibe-eval
      multilingual
      false
      analysis_method
      Accuracy
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      Vibe-Eval · Normalized (reported)
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      4
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.656

      source id
      llmStatsArchive
      leaderboard name
      Vibe-Eval · Raw
      dimension
      general
      metric
      Vibe-Eval · Raw
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      Vibe-Eval
      language
      en
      modality
      multimodal
      verified
      false
      max_score
      1
      categories
      • multimodal
      • vision
      • general
      created_at
      2025-07-19T19:56:13.871369+00:00
      paper_link
      https://arxiv.org/abs/2405.02287
      updated_at
      2025-07-19T19:56:13.871369+00:00
      description
      VIBE-Eval is a hard evaluation suite for measuring progress of multimodal language models, consisting of 269 visual understanding prompts with gold-standard responses authored by experts. The benchmark has dual objectives: vibe checking multimodal chat models for day-to-day tasks and rigorously testing frontier models, with the hard set containing >50% questions that all frontier models answer incorrectly.
      benchmark_id
      vibe-eval
      multilingual
      false
      analysis_method
      Accuracy
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      Vibe-Eval · Raw
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      4
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.632

      source id
      llmStatsArchive
      leaderboard name
      SWE-Bench Verified · Raw
      dimension
      general
      metric
      SWE-Bench Verified · Raw
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      SWE-Bench Verified
      language
      en
      modality
      text
      verified
      false
      max_score
      1
      categories
      • reasoning
      • frontend_development
      • code
      created_at
      2025-07-19T19:56:13.812805+00:00
      paper_link
      https://arxiv.org/abs/2310.06770
      updated_at
      2025-07-19T19:56:13.812805+00:00
      description
      A verified subset of 500 software engineering problems from real GitHub issues, validated by human annotators for evaluating language models' ability to resolve real-world coding issues by generating patches for Python codebases.
      benchmark_id
      swe-bench-verified
      multilingual
      false
      analysis_method
      Accuracy
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      SWE-Bench Verified · Raw
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      3
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.632

      source id
      llmStatsArchive
      leaderboard name
      SWE-Bench Verified · Normalized (reported)
      dimension
      general
      metric
      SWE-Bench Verified · Normalized (reported)
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      SWE-Bench Verified
      language
      en
      modality
      text
      verified
      false
      max_score
      1
      categories
      • reasoning
      • frontend_development
      • code
      created_at
      2025-07-19T19:56:13.812805+00:00
      paper_link
      https://arxiv.org/abs/2310.06770
      updated_at
      2025-07-19T19:56:13.812805+00:00
      description
      A verified subset of 500 software engineering problems from real GitHub issues, validated by human annotators for evaluating language models' ability to resolve real-world coding issues by generating patches for Python codebases.
      benchmark_id
      swe-bench-verified
      multilingual
      false
      analysis_method
      Accuracy
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      SWE-Bench Verified · Normalized (reported)
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      3
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.178

      source id
      llmStatsArchive
      leaderboard name
      Humanity's Last Exam · Normalized (reported)
      dimension
      general
      metric
      Humanity's Last Exam · Normalized (reported)
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      Humanity's Last Exam
      language
      en
      modality
      multimodal
      verified
      false
      max_score
      1
      categories
      • general
      created_at
      2025-07-19T19:56:12.507693+00:00
      paper_link
      https://arxiv.org/abs/2501.14249
      updated_at
      2025-07-19T19:56:12.507693+00:00
      description
      A multi-modal benchmark at the frontier of human knowledge with 2,500 questions across dozens of subjects including mathematics, humanities, and natural sciences, created by nearly 1000 subject expert contributors from over 500 institutions
      benchmark_id
      humanity's-last-exam
      multilingual
      false
      analysis_method
      Accuracy
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      Humanity's Last Exam · Normalized (reported)
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      2
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      LLM Stats · GitHub archive

      0.178

      source id
      llmStatsArchive
      leaderboard name
      Humanity's Last Exam · Raw
      dimension
      general
      metric
      Humanity's Last Exam · Raw
      rank
      1
      aggregation scope
      status
      archived
      license
      CC-BY-4.0
      direction
      higherIsBetter
      conditions
      language
      en
      benchmark
      name
      Humanity's Last Exam
      language
      en
      modality
      multimodal
      verified
      false
      max_score
      1
      categories
      • general
      created_at
      2025-07-19T19:56:12.507693+00:00
      paper_link
      https://arxiv.org/abs/2501.14249
      updated_at
      2025-07-19T19:56:12.507693+00:00
      description
      A multi-modal benchmark at the frontier of human knowledge with 2,500 questions across dozens of subjects including mathematics, humanities, and natural sciences, created by nearly 1000 subject expert contributors from over 500 institutions
      benchmark_id
      humanity's-last-exam
      multilingual
      false
      analysis_method
      Accuracy
      is_self_reported
      true
      verified_by_llmstats
      false
      attribution
      Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
      license_url
      https://creativecommons.org/licenses/by/4.0/
      metric_kind
      Humanity's Last Exam · Raw
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      data/organizations/google/models/gemini-2.5-pro/benchmarks.json
      archive_kind
      llmStats
      evidence_url
      https://deepmind.google/models/gemini/pro/
      git_revision
      872b75f63b8d853c46ed17856424029a0c47b1d2
      published_at
      2025-10-24T17:47:59Z
      snapshot_date
      2025-10-24T17:47:59Z
      source_revision
      6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
      publisher_anchor
      google/gemini-2.5-pro
      metric_population
      2
      current_catalog_url
      https://llm-stats.com/
      benchmark_evaluation
      true
      source model id
      gemini-2.5-pro
      Original result ↗

      Published prices

      41–60 / 60

      google/gemini-2.5-pro ↗

      $0.13

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      cache_read_tokens_per_million
      Currency
      USD
      Billing conditions
      region
      scope
      specific
      geo_region
      eu
      provider_region
      europe-central2
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      max_exclusive
      200001
      min_inclusive
      0
      Billing label
      Cached input / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $0.25

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      cache_read_tokens_per_million
      Currency
      USD
      Billing conditions
      region
      scope
      specific
      geo_region
      us
      provider_region
      us-east5
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      min_inclusive
      200001
      Billing label
      Cached input / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $0.13

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      cache_read_tokens_per_million
      Currency
      USD
      Billing conditions
      region
      scope
      specific
      geo_region
      us
      provider_region
      us-east5
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      max_exclusive
      200001
      min_inclusive
      0
      Billing label
      Cached input / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $2.50

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      input_tokens_per_million
      Currency
      USD
      Billing conditions
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      min_inclusive
      200001
      Billing label
      Input tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $1.25

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      input_tokens_per_million
      Currency
      USD
      Billing conditions
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      max_exclusive
      200001
      min_inclusive
      0
      Billing label
      Input tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $0.63

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      input_tokens_per_million
      Currency
      USD
      Billing conditions
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      service_tier
      flex
      billing_scope
      via Vercel AI Gateway
      Billing label
      Input tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $2.25

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      input_tokens_per_million
      Currency
      USD
      Billing conditions
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      service_tier
      priority
      billing_scope
      via Vercel AI Gateway
      Billing label
      Input tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $2.50

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      input_tokens_per_million
      Currency
      USD
      Billing conditions
      region
      scope
      specific
      geo_region
      eu
      provider_region
      europe-central2
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      min_inclusive
      200001
      Billing label
      Input tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $1.25

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      input_tokens_per_million
      Currency
      USD
      Billing conditions
      region
      scope
      specific
      geo_region
      eu
      provider_region
      europe-central2
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      max_exclusive
      200001
      min_inclusive
      0
      Billing label
      Input tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $2.50

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      input_tokens_per_million
      Currency
      USD
      Billing conditions
      region
      scope
      specific
      geo_region
      us
      provider_region
      us-east5
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      min_inclusive
      200001
      Billing label
      Input tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $1.25

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      input_tokens_per_million
      Currency
      USD
      Billing conditions
      region
      scope
      specific
      geo_region
      us
      provider_region
      us-east5
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      max_exclusive
      200001
      min_inclusive
      0
      Billing label
      Input tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $15.00

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      output_tokens_per_million
      Currency
      USD
      Billing conditions
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      min_inclusive
      200001
      Billing label
      Output tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $10.00

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      output_tokens_per_million
      Currency
      USD
      Billing conditions
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      max_exclusive
      200001
      min_inclusive
      0
      Billing label
      Output tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $5.00

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      output_tokens_per_million
      Currency
      USD
      Billing conditions
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      service_tier
      flex
      billing_scope
      via Vercel AI Gateway
      Billing label
      Output tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $18.00

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      output_tokens_per_million
      Currency
      USD
      Billing conditions
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      service_tier
      priority
      billing_scope
      via Vercel AI Gateway
      Billing label
      Output tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $15.00

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      output_tokens_per_million
      Currency
      USD
      Billing conditions
      region
      scope
      specific
      geo_region
      eu
      provider_region
      europe-central2
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      min_inclusive
      200001
      Billing label
      Output tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $10.00

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      output_tokens_per_million
      Currency
      USD
      Billing conditions
      region
      scope
      specific
      geo_region
      eu
      provider_region
      europe-central2
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      max_exclusive
      200001
      min_inclusive
      0
      Billing label
      Output tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $15.00

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      output_tokens_per_million
      Currency
      USD
      Billing conditions
      region
      scope
      specific
      geo_region
      us
      provider_region
      us-east5
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      min_inclusive
      200001
      Billing label
      Output tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $10.00

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      output_tokens_per_million
      Currency
      USD
      Billing conditions
      region
      scope
      specific
      geo_region
      us
      provider_region
      us-east5
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      context_tokens
      max_exclusive
      200001
      min_inclusive
      0
      Billing label
      Output tokens / 1M
      Pricing via
      Vercel AI Gateway

      google/gemini-2.5-pro ↗

      $0.04

      Inference provider
      vercelAIGatewayCatalog
      Platform
      vertex
      Unit
      request
      Currency
      USD
      Billing conditions
      charge
      web_search
      endpoint
      vertex | google/gemini-2.5-pro
      model_type
      language
      billing_scope
      via Vercel AI Gateway
      Billing label
      Web search
      Pricing via
      Vercel AI Gateway

      Provider specifications & access

      1–4 / 4

      gemini-2.5-pro ↗

      source model id
      gemini-2.5-pro
      hosting
      gateway
      platforms
      • Cheaper Inference
      context length
      1048576
      max output tokens
      65535
      architecture
      input_modalities
      • text
      • image
      output_modalities
      • text
      capabilities
      • reasoning
      • structuredOutputs
      • toolCalling
      • visionInput
      • webSearch

      Gemini 2.5 Pro ↗

      source model id
      google/gemini-2.5-pro
      hosting
      third-party
      platforms
      • Google Vertex AI
      context length
      1000000
      max output tokens
      65536
      architecture
      input_modalities
      • text
      output_modalities
      • text
      capabilities
      • reasoning

      Gemini 2.5 Pro ↗

      source model id
      google/gemini-2.5-pro
      hosting
      vercel-gateway
      platforms
      • Vercel AI Gateway
      context length
      1048576
      max output tokens
      65535
      architecture
      input_modalities
      • text
      • image
      • pdf
      output_modalities
      • text
      capabilities
      • promptCaching
      • reasoning
      • structuredOutputs
      • toolCalling
      • visionInput
      • webSearch
      regions
      • eu
      • us

      Gemini 2.5 Pro ↗

      source model id
      publishers/google/models/gemini-2.5-pro@default
      hosting
      vertex-managed
      platforms
      • Google Cloud Vertex AI
      context length
      1048576
      max output tokens
      65536
      architecture
      input_modalities
      • audio
      • image
      • text
      • video
      output_modalities
      • text
      capabilities
      • batch
      • multimodal
      • promptCaching
      • reasoning
      • structuredOutputs
      • toolCalling
      • visionInput

      Safety assessments

      1–1 / 1

      Foundation Model Transparency Index 2025 ↗

      41 / 100

      source id
      stanfordFMTI
      canonical model id
      google/gemini-2.5-pro
      taxonomy
      transparency
      hazard category
      transparency
      hazard name
      Organization transparency
      policy area
      Google
      assessment type
      organization-level disclosure
      metric
      disclosure_score
      result label
      41 / 100
      sample size
      100
      updated at
      2026-11-09T18:08:05.227Z

      Source specification observations

      1–10 / 10

      cloudflareWorkersAI ↗

      field
      context_length
      value
      1000000
      normalized value
      1000000
      scope
      source-model
      source id
      cloudflareWorkersAI
      confidence
      1

      openRouter ↗

      field
      context_length
      value
      1048576
      normalized value
      1048576
      scope
      source-model
      source id
      openRouter
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      context_length
      value
      1048576
      normalized value
      1048576
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      vertexAI ↗

      field
      context_length
      value
      1048576
      normalized value
      1048576
      scope
      source-model
      source id
      vertexAI
      confidence
      1

      openRouter ↗

      field
      knowledge_cutoff
      reported field
      knowledge_cutoff
      value
      2025-01-31
      normalized value
      2025-01-31
      precision
      day
      scope
      source-model
      source id
      openRouter
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      knowledge_cutoff
      reported field
      knowledge_cutoff
      value
      2025-01
      normalized value
      2025-01
      precision
      month
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      cloudflareWorkersAI ↗

      field
      max_output_tokens
      value
      65536
      normalized value
      65536
      scope
      source-model
      source id
      cloudflareWorkersAI
      confidence
      1

      openRouter ↗

      field
      max_output_tokens
      value
      65536
      normalized value
      65536
      scope
      source-model
      source id
      openRouter
      confidence
      1

      vercelAIGatewayCatalog ↗

      field
      max_output_tokens
      value
      65535
      normalized value
      65535
      scope
      source-model
      source id
      vercelAIGatewayCatalog
      confidence
      1

      vertexAI ↗

      field
      max_output_tokens
      value
      65536
      normalized value
      65536
      scope
      source-model
      source id
      vertexAI
      confidence
      1

      Original sources

      1–20 / 20

      Google · Model reference ↗

      DeepInfra · Model page ↗

      Google Cloud · Model page ↗

      OpenRouter · Model page ↗

      Vercel AI Gateway · Model page ↗

      Google Cloud · Documentation ↗

      GitHub · Source snapshot ↗

      api.cheaperinference.com · Source snapshot ↗

      Cloudflare AI · Catalog ↗

      DeepInfra · Catalog ↗

      Epoch AI · Catalog ↗

      GitHub · Catalog ↗

      GitHub · Catalog ↗

      Google Cloud · Catalog ↗

      Kaggle · Catalog ↗

      LMArena · Catalog ↗

      OpenRouter · Catalog ↗

      OpenRouter · Catalog ↗

      Vercel AI Gateway · Catalog ↗

      www.swebench.com · Catalog ↗

      Source links

      1–14 / 14

      Explore more models

      Models

      Loading
      EVIDENCE / COMPARISON

      Benchmarks

      Explore every benchmark

      Loading

      These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

      Install TensorTrace