Google: Gemini 2.5 Flash

Gemini 2.5 Flash is Google's state-of-the-art workhorse model, specifically designed for advanced reasoning, coding, mathematics, and scientific tasks. It includes built-in "thinking" capabilities, e…

google/gemini-2.5-flash

Gemini 2.5 Flash is Google's state-of-the-art workhorse model, specifically designed for advanced reasoning, coding, mathematics, and scientific tasks. It includes built-in "thinking" capabilities, enabling it to provide responses with greater accuracy and nuanced context handling.

Additionally, Gemini 2.5 Flash is configurable through the "max tokens for reasoning" parameter, as described in the documentation (https://openrouter.ai/docs/use-cases/reasoning-tokens#max-tokens-for-reasoning).

Specifications & capabilities

Input
file, image, text, audio, video
Output
text
Context window · tokens
1048576
Knowledge cutoff
2025-01
Published model ID
gemini-2.5-flash@default
Capabilities
audioInput, batch, fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput, webSearch
Description source ↗

Evaluations

21–40 / 2,449

LLM Stats · GitHub archive

0.11

source id
llmStatsArchive
leaderboard name
Humanity's Last Exam · Normalized (reported)
dimension
general
metric
Humanity's Last Exam · Normalized (reported)
rank
2
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Humanity's Last Exam
language
en
modality
multimodal
verified
false
max_score
1
categories
  • general
created_at
2025-07-19T19:56:12.507693+00:00
paper_link
https://arxiv.org/abs/2501.14249
updated_at
2025-07-19T19:56:12.507693+00:00
description
A multi-modal benchmark at the frontier of human knowledge with 2,500 questions across dozens of subjects including mathematics, humanities, and natural sciences, created by nearly 1000 subject expert contributors from over 500 institutions
benchmark_id
humanity's-last-exam
multilingual
false
analysis_method
Accuracy
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Humanity's Last Exam · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/google/models/gemini-2.5-flash/benchmarks.json
archive_kind
llmStats
evidence_url
https://developers.googleblog.com/en/start-building-with-gemini-25-flash/
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
google/gemini-2.5-flash
metric_population
2
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
gemini-2.5-flash
Original result ↗

Kaggle Benchmarks

70.865

source id
kaggleBenchmarks
leaderboard name
IndicGenBench · XorQA-In
dimension
general
metric
IndicGenBench · XorQA-In
rank
3
aggregation scope
kaggle
true
status
published
license
Apache-2.0
direction
higherIsBetter
conditions
task
id
817
name
XorQA-In
version
1
sort_order
DESCENDING
display_type
counts
benchmark
id
212
name
IndicGenBench
type
SUITE
owner
deepmind
version
1
categories
  • multilingual and cross-lingual capabilities
version_id
191
maintainer_tier
Kaggle-maintained
maintenance_level
KAGGLE_MAINTAINED
candidate
candidate_class
modelVersion
record_kind
aggregate
attribution
Kaggle · deepmind · IndicGenBench
license_url
https://www.apache.org/licenses/LICENSE-2.0
metric_kind
IndicGenBench · XorQA-In
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
191/leaderboard.json
source_page
https://www.kaggle.com/benchmarks/deepmind/indic-gen-bench/versions/1
measurements
  • name
    XorQA-In
    unit
    score
    scale
    1
    metric
    IndicGenBench · XorQA-In
    result
    resultCase
    numericResult
    booleanResult
    false
    numericResult
    value
    70.86482797644737
    standardDeviation
    0
    confidenceInterval
    0
    hasStandardDeviation
    false
    hasConfidenceInterval
    false
    hasUnevenConfidenceInterval
    false
    taskVersionId
    0
    evaluationDate
    2025-10-28T22:12:53.314439Z
    hasBooleanResult
    false
    hasNumericResult
    true
    hasTaskVersionId
    false
    hasEvaluationDate
    true
    numericResultNullable
    value
    70.86482797644737
    standardDeviation
    0
    confidenceInterval
    0
    hasStandardDeviation
    false
    hasConfidenceInterval
    false
    hasUnevenConfidenceInterval
    false
    hasNumericResultPublic
    false
    customAdditionalResults
      hasNumericResultPrivate
      false
      task_id
      817
      task_url
      /benchmarks/tasks/aminmohamedmohami/xorqa-in-task
      sort_order
      DESCENDING
      source_name
      XorQA-In
      display_type
      counts
      task_version
      1
      task_display_type
      RAW_VALUES
      normalization_status
      normalized
    published_at
    2025-12-04T15:09:28.942941700Z
    candidate_class
    modelVersion
    source_revision
    b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
    publisher_anchor
    google/gemini-2.5-flash
    metric_population
    13
    benchmark_evaluation
    true
    task_metadata_source
    benchmarkVersion
    candidate_metadata_source
    benchmarkVersionMappings
    evaluated at
    2025-10-28T22:12:53.314Z
    source model id
    Gemini 2.5 Flash
    Original result ↗

    LLM Stats · GitHub archive

    0.269

    source id
    llmStatsArchive
    leaderboard name
    SimpleQA · Normalized (reported)
    dimension
    general
    metric
    SimpleQA · Normalized (reported)
    rank
    3
    aggregation scope
    status
    archived
    license
    CC-BY-4.0
    direction
    higherIsBetter
    conditions
    language
    en
    benchmark
    name
    SimpleQA
    language
    en
    modality
    text
    verified
    false
    max_score
    1
    categories
    • general
    • reasoning
    created_at
    2025-09-05T00:00:00.000000+00:00
    paper_link
    https://arxiv.org/abs/2411.04368
    updated_at
    2025-09-05T00:00:00.000000+00:00
    description
    SimpleQA is a factuality benchmark developed by OpenAI that measures the short-form factual accuracy of large language models. The benchmark contains 4,326 short, fact-seeking questions that are adversarially collected and designed to have single, indisputable answers. Questions cover diverse topics from science and technology to entertainment, and the benchmark also measures model calibration by evaluating whether models know what they know.
    benchmark_id
    simpleqa
    multilingual
    false
    analysis_method
    Accuracy
    is_self_reported
    true
    verified_by_llmstats
    false
    attribution
    Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
    license_url
    https://creativecommons.org/licenses/by/4.0/
    metric_kind
    SimpleQA · Normalized (reported)
    rank_method
    competition rank among reported evaluations in identical conditions, including unlinked observations
    source_file
    data/organizations/google/models/gemini-2.5-flash/benchmarks.json
    archive_kind
    llmStats
    evidence_url
    https://developers.googleblog.com/en/start-building-with-gemini-25-flash/
    git_revision
    872b75f63b8d853c46ed17856424029a0c47b1d2
    published_at
    2025-10-24T17:47:59Z
    snapshot_date
    2025-10-24T17:47:59Z
    source_revision
    6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
    publisher_anchor
    google/gemini-2.5-flash
    metric_population
    3
    current_catalog_url
    https://llm-stats.com/
    benchmark_evaluation
    true
    source model id
    gemini-2.5-flash
    Original result ↗

    LLM Stats · GitHub archive

    0.269

    source id
    llmStatsArchive
    leaderboard name
    SimpleQA · Raw
    dimension
    general
    metric
    SimpleQA · Raw
    rank
    3
    aggregation scope
    status
    archived
    license
    CC-BY-4.0
    direction
    higherIsBetter
    conditions
    language
    en
    benchmark
    name
    SimpleQA
    language
    en
    modality
    text
    verified
    false
    max_score
    1
    categories
    • general
    • reasoning
    created_at
    2025-09-05T00:00:00.000000+00:00
    paper_link
    https://arxiv.org/abs/2411.04368
    updated_at
    2025-09-05T00:00:00.000000+00:00
    description
    SimpleQA is a factuality benchmark developed by OpenAI that measures the short-form factual accuracy of large language models. The benchmark contains 4,326 short, fact-seeking questions that are adversarially collected and designed to have single, indisputable answers. Questions cover diverse topics from science and technology to entertainment, and the benchmark also measures model calibration by evaluating whether models know what they know.
    benchmark_id
    simpleqa
    multilingual
    false
    analysis_method
    Accuracy
    is_self_reported
    true
    verified_by_llmstats
    false
    attribution
    Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
    license_url
    https://creativecommons.org/licenses/by/4.0/
    metric_kind
    SimpleQA · Raw
    rank_method
    competition rank among reported evaluations in identical conditions, including unlinked observations
    source_file
    data/organizations/google/models/gemini-2.5-flash/benchmarks.json
    archive_kind
    llmStats
    evidence_url
    https://developers.googleblog.com/en/start-building-with-gemini-25-flash/
    git_revision
    872b75f63b8d853c46ed17856424029a0c47b1d2
    published_at
    2025-10-24T17:47:59Z
    snapshot_date
    2025-10-24T17:47:59Z
    source_revision
    6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
    publisher_anchor
    google/gemini-2.5-flash
    metric_population
    3
    current_catalog_url
    https://llm-stats.com/
    benchmark_evaluation
    true
    source model id
    gemini-2.5-flash
    Original result ↗

    Kaggle Benchmarks

    76.801

    source id
    kaggleBenchmarks
    leaderboard name
    IndicGenBench · XQuAD-In
    dimension
    general
    metric
    IndicGenBench · XQuAD-In
    rank
    4
    aggregation scope
    kaggle
    true
    status
    published
    license
    Apache-2.0
    direction
    higherIsBetter
    conditions
    task
    id
    820
    name
    XQuAD-In
    version
    3
    sort_order
    DESCENDING
    display_type
    counts
    benchmark
    id
    212
    name
    IndicGenBench
    type
    SUITE
    owner
    deepmind
    version
    1
    categories
    • multilingual and cross-lingual capabilities
    version_id
    191
    maintainer_tier
    Kaggle-maintained
    maintenance_level
    KAGGLE_MAINTAINED
    candidate
    candidate_class
    modelVersion
    record_kind
    aggregate
    attribution
    Kaggle · deepmind · IndicGenBench
    license_url
    https://www.apache.org/licenses/LICENSE-2.0
    metric_kind
    IndicGenBench · XQuAD-In
    rank_method
    competition rank among reported evaluations in identical conditions, including unlinked observations
    source_file
    191/leaderboard.json
    source_page
    https://www.kaggle.com/benchmarks/deepmind/indic-gen-bench/versions/1
    measurements
    • name
      XQuAD-In
      unit
      score
      scale
      1
      metric
      IndicGenBench · XQuAD-In
      result
      resultCase
      numericResult
      booleanResult
      false
      numericResult
      value
      76.8012821738746
      standardDeviation
      0
      confidenceInterval
      0
      hasStandardDeviation
      false
      hasConfidenceInterval
      false
      hasUnevenConfidenceInterval
      false
      taskVersionId
      0
      evaluationDate
      2025-10-29T00:38:53.667467Z
      hasBooleanResult
      false
      hasNumericResult
      true
      hasTaskVersionId
      false
      hasEvaluationDate
      true
      numericResultNullable
      value
      76.8012821738746
      standardDeviation
      0
      confidenceInterval
      0
      hasStandardDeviation
      false
      hasConfidenceInterval
      false
      hasUnevenConfidenceInterval
      false
      hasNumericResultPublic
      false
      customAdditionalResults
        hasNumericResultPrivate
        false
        task_id
        820
        task_url
        /benchmarks/tasks/aminmohamedmohami/xquad-in-task
        sort_order
        DESCENDING
        source_name
        XQuAD-In
        display_type
        counts
        task_version
        3
        task_display_type
        RAW_VALUES
        normalization_status
        normalized
      published_at
      2025-12-04T15:09:28.942941700Z
      candidate_class
      modelVersion
      source_revision
      b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
      publisher_anchor
      google/gemini-2.5-flash
      metric_population
      14
      benchmark_evaluation
      true
      task_metadata_source
      benchmarkVersion
      candidate_metadata_source
      benchmarkVersionMappings
      evaluated at
      2025-10-29T00:38:53.667Z
      source model id
      Gemini 2.5 Flash
      Original result ↗

      Kaggle Benchmarks

      56.917

      source id
      kaggleBenchmarks
      leaderboard name
      IndicGenBench · Average
      dimension
      general
      metric
      IndicGenBench · Average
      rank
      4
      aggregation scope
      kaggle
      true
      status
      published
      license
      Apache-2.0
      direction
      higherIsBetter
      conditions
      task
      id
      897
      name
      Average
      version
      1
      sort_order
      DESCENDING
      display_type
      counts
      benchmark
      id
      212
      name
      IndicGenBench
      type
      SUITE
      owner
      deepmind
      version
      1
      categories
      • multilingual and cross-lingual capabilities
      version_id
      191
      maintainer_tier
      Kaggle-maintained
      maintenance_level
      KAGGLE_MAINTAINED
      candidate
      candidate_class
      modelVersion
      record_kind
      aggregate
      attribution
      Kaggle · deepmind · IndicGenBench
      license_url
      https://www.apache.org/licenses/LICENSE-2.0
      metric_kind
      IndicGenBench · Average
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      191/leaderboard.json
      source_page
      https://www.kaggle.com/benchmarks/deepmind/indic-gen-bench/versions/1
      measurements
      • name
        Average
        unit
        score
        scale
        1
        metric
        IndicGenBench · Average
        result
        resultCase
        numericResult
        booleanResult
        false
        numericResult
        value
        56.91735746945958
        standardDeviation
        0
        confidenceInterval
        0
        hasStandardDeviation
        false
        hasConfidenceInterval
        false
        hasUnevenConfidenceInterval
        false
        taskVersionId
        0
        evaluationDate
        2025-10-29T00:38:53.667467Z
        hasBooleanResult
        false
        hasNumericResult
        true
        hasTaskVersionId
        false
        hasEvaluationDate
        true
        numericResultNullable
        value
        56.91735746945958
        standardDeviation
        0
        confidenceInterval
        0
        hasStandardDeviation
        false
        hasConfidenceInterval
        false
        hasUnevenConfidenceInterval
        false
        hasNumericResultPublic
        false
        customAdditionalResults
          hasNumericResultPrivate
          false
          task_id
          897
          sort_order
          DESCENDING
          source_name
          Average
          display_type
          counts
          task_version
          1
          task_display_type
          COUNTS
          normalization_status
          normalized
        published_at
        2025-12-04T15:09:28.942941700Z
        candidate_class
        modelVersion
        source_revision
        b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
        publisher_anchor
        google/gemini-2.5-flash
        metric_population
        14
        benchmark_evaluation
        true
        task_metadata_source
        benchmarkVersion
        candidate_metadata_source
        benchmarkVersionMappings
        evaluated at
        2025-10-29T00:38:53.667Z
        source model id
        Gemini 2.5 Flash
        Original result ↗

        Kaggle Benchmarks

        54.671

        source id
        kaggleBenchmarks
        leaderboard name
        IndicGenBench · Flores-In
        dimension
        general
        metric
        IndicGenBench · Flores-In
        rank
        4
        aggregation scope
        kaggle
        true
        status
        published
        license
        Apache-2.0
        direction
        higherIsBetter
        conditions
        task
        id
        816
        name
        Flores-In
        version
        1
        sort_order
        DESCENDING
        display_type
        counts
        benchmark
        id
        212
        name
        IndicGenBench
        type
        SUITE
        owner
        deepmind
        version
        1
        categories
        • multilingual and cross-lingual capabilities
        version_id
        191
        maintainer_tier
        Kaggle-maintained
        maintenance_level
        KAGGLE_MAINTAINED
        candidate
        candidate_class
        modelVersion
        record_kind
        aggregate
        attribution
        Kaggle · deepmind · IndicGenBench
        license_url
        https://www.apache.org/licenses/LICENSE-2.0
        metric_kind
        IndicGenBench · Flores-In
        rank_method
        competition rank among reported evaluations in identical conditions, including unlinked observations
        source_file
        191/leaderboard.json
        source_page
        https://www.kaggle.com/benchmarks/deepmind/indic-gen-bench/versions/1
        measurements
        • name
          Flores-In
          unit
          score
          scale
          1
          metric
          IndicGenBench · Flores-In
          result
          resultCase
          numericResult
          booleanResult
          false
          numericResult
          value
          54.6708427306447
          standardDeviation
          0
          confidenceInterval
          0
          hasStandardDeviation
          false
          hasConfidenceInterval
          false
          hasUnevenConfidenceInterval
          false
          taskVersionId
          0
          evaluationDate
          2025-10-28T22:11:53.46331Z
          hasBooleanResult
          false
          hasNumericResult
          true
          hasTaskVersionId
          false
          hasEvaluationDate
          true
          numericResultNullable
          value
          54.6708427306447
          standardDeviation
          0
          confidenceInterval
          0
          hasStandardDeviation
          false
          hasConfidenceInterval
          false
          hasUnevenConfidenceInterval
          false
          hasNumericResultPublic
          false
          customAdditionalResults
            hasNumericResultPrivate
            false
            task_id
            816
            task_url
            /benchmarks/tasks/aminmohamedmohami/flores-in-task
            sort_order
            DESCENDING
            source_name
            Flores-In
            display_type
            counts
            task_version
            1
            task_display_type
            RAW_VALUES
            normalization_status
            normalized
          published_at
          2025-12-04T15:09:28.942941700Z
          candidate_class
          modelVersion
          source_revision
          b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
          publisher_anchor
          google/gemini-2.5-flash
          metric_population
          13
          benchmark_evaluation
          true
          task_metadata_source
          benchmarkVersion
          candidate_metadata_source
          benchmarkVersionMappings
          evaluated at
          2025-10-28T22:11:53.463Z
          source model id
          Gemini 2.5 Flash
          Original result ↗

          Kaggle Benchmarks

          25.332

          source id
          kaggleBenchmarks
          leaderboard name
          IndicGenBench · CrossSum-In
          dimension
          general
          metric
          IndicGenBench · CrossSum-In
          rank
          4
          aggregation scope
          kaggle
          true
          status
          published
          license
          Apache-2.0
          direction
          higherIsBetter
          conditions
          task
          id
          815
          name
          CrossSum-In
          version
          1
          sort_order
          DESCENDING
          display_type
          counts
          benchmark
          id
          212
          name
          IndicGenBench
          type
          SUITE
          owner
          deepmind
          version
          1
          categories
          • multilingual and cross-lingual capabilities
          version_id
          191
          maintainer_tier
          Kaggle-maintained
          maintenance_level
          KAGGLE_MAINTAINED
          candidate
          candidate_class
          modelVersion
          record_kind
          aggregate
          attribution
          Kaggle · deepmind · IndicGenBench
          license_url
          https://www.apache.org/licenses/LICENSE-2.0
          metric_kind
          IndicGenBench · CrossSum-In
          rank_method
          competition rank among reported evaluations in identical conditions, including unlinked observations
          source_file
          191/leaderboard.json
          source_page
          https://www.kaggle.com/benchmarks/deepmind/indic-gen-bench/versions/1
          measurements
          • name
            CrossSum-In
            unit
            score
            scale
            1
            metric
            IndicGenBench · CrossSum-In
            result
            resultCase
            numericResult
            booleanResult
            false
            numericResult
            value
            25.332476996871655
            standardDeviation
            0
            confidenceInterval
            0
            hasStandardDeviation
            false
            hasConfidenceInterval
            false
            hasUnevenConfidenceInterval
            false
            taskVersionId
            0
            evaluationDate
            2025-10-28T22:12:49.843933Z
            hasBooleanResult
            false
            hasNumericResult
            true
            hasTaskVersionId
            false
            hasEvaluationDate
            true
            numericResultNullable
            value
            25.332476996871655
            standardDeviation
            0
            confidenceInterval
            0
            hasStandardDeviation
            false
            hasConfidenceInterval
            false
            hasUnevenConfidenceInterval
            false
            hasNumericResultPublic
            false
            customAdditionalResults
              hasNumericResultPrivate
              false
              task_id
              815
              task_url
              /benchmarks/tasks/aminmohamedmohami/crosssum-in-task
              sort_order
              DESCENDING
              source_name
              CrossSum-In
              display_type
              counts
              task_version
              1
              task_display_type
              RAW_VALUES
              normalization_status
              normalized
            published_at
            2025-12-04T15:09:28.942941700Z
            candidate_class
            modelVersion
            source_revision
            b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
            publisher_anchor
            google/gemini-2.5-flash
            metric_population
            13
            benchmark_evaluation
            true
            task_metadata_source
            benchmarkVersion
            candidate_metadata_source
            benchmarkVersionMappings
            evaluated at
            2025-10-28T22:12:49.843Z
            source model id
            Gemini 2.5 Flash
            Original result ↗

            Kaggle Benchmarks

            51.667%

            source id
            kaggleBenchmarks
            leaderboard name
            ITBench · Average Score
            dimension
            reasoning
            metric
            ITBench · Average Score
            rank
            5
            aggregation scope
            kaggle
            true
            status
            published
            license
            Apache-2.0
            direction
            higherIsBetter
            conditions
            task
            id
            1064
            name
            Average Score
            version
            1
            sort_order
            DESCENDING
            display_type
            rawPercentages
            benchmark
            id
            246
            name
            ITBench
            type
            INDIVIDUAL
            owner
            ibm-research
            version
            1
            categories
            • evaluation
            • general knowledge and reasoning
            version_id
            225
            maintainer_tier
            Kaggle-maintained
            maintenance_level
            KAGGLE_MAINTAINED
            candidate
            candidate_class
            modelVersion
            record_kind
            aggregate
            attribution
            Kaggle · ibm-research · ITBench
            license_url
            https://www.apache.org/licenses/LICENSE-2.0
            metric_kind
            ITBench · Average Score
            rank_method
            competition rank among reported evaluations in identical conditions, including unlinked observations
            source_file
            225/leaderboard.json
            source_page
            https://www.kaggle.com/benchmarks/ibm-research/itbench/versions/1
            measurements
            • name
              Average Score
              unit
              percent
              scale
              100
              metric
              ITBench · Average Score
              result
              resultCase
              numericResult
              booleanResult
              false
              numericResult
              value
              51.66666666666667
              standardDeviation
              0
              confidenceInterval
              0
              hasStandardDeviation
              false
              hasConfidenceInterval
              false
              hasUnevenConfidenceInterval
              false
              taskVersionId
              0
              evaluationDate
              2025-12-01T22:28:02.522152Z
              hasBooleanResult
              false
              hasNumericResult
              true
              hasTaskVersionId
              false
              hasEvaluationDate
              true
              numericResultNullable
              value
              51.66666666666667
              standardDeviation
              0
              confidenceInterval
              0
              hasStandardDeviation
              false
              hasConfidenceInterval
              false
              hasUnevenConfidenceInterval
              false
              hasNumericResultPublic
              false
              customAdditionalResults
                hasNumericResultPrivate
                false
                task_id
                1064
                sort_order
                DESCENDING
                source_name
                Average Score
                display_type
                rawPercentages
                task_version
                1
                task_display_type
                RAW_PERCENTAGES
                normalization_status
                normalized
              published_at
              2025-12-02T12:36:17.407125500Z
              candidate_class
              modelVersion
              source_revision
              b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
              publisher_anchor
              google/gemini-2.5-flash
              metric_population
              13
              benchmark_evaluation
              true
              task_metadata_source
              benchmarkVersion
              candidate_metadata_source
              benchmarkVersionMappings
              evaluated at
              2025-12-01T22:28:02.522Z
              source model id
              Gemini 2.5 Flash
              Original result ↗

              Kaggle Benchmarks

              66.667

              source id
              kaggleBenchmarks
              leaderboard name
              NeurIPS 2025 Experts · (Overall)
              dimension
              reasoning
              metric
              NeurIPS 2025 Experts · (Overall)
              rank
              6
              aggregation scope
              kaggle
              true
              status
              published
              license
              Apache-2.0
              direction
              higherIsBetter
              conditions
              task
              id
              1202
              name
              (Overall)
              version
              1
              sort_order
              DESCENDING
              display_type
              rawValues
              benchmark
              id
              271
              name
              NeurIPS 2025 Experts
              type
              INDIVIDUAL
              owner
              kaggle
              version
              1
              categories
              • general knowledge and reasoning
              version_id
              250
              maintainer_tier
              Kaggle-published
              candidate
              candidate_class
              modelVersion
              record_kind
              aggregate
              attribution
              Kaggle · kaggle · NeurIPS 2025 Experts
              license_url
              https://www.apache.org/licenses/LICENSE-2.0
              metric_kind
              NeurIPS 2025 Experts · (Overall)
              rank_method
              competition rank among reported evaluations in identical conditions, including unlinked observations
              source_file
              250/leaderboard.json
              source_page
              https://www.kaggle.com/benchmarks/kaggle/neurips-2025/versions/1
              measurements
              • name
                (Overall)
                unit
                score
                scale
                1
                metric
                NeurIPS 2025 Experts · (Overall)
                result
                resultCase
                numericResult
                booleanResult
                false
                numericResult
                value
                66.66666666666667
                standardDeviation
                0
                confidenceInterval
                0
                hasStandardDeviation
                false
                hasConfidenceInterval
                false
                hasUnevenConfidenceInterval
                false
                taskVersionId
                0
                evaluationDate
                2026-03-19T15:17:16.692772Z
                hasBooleanResult
                false
                hasNumericResult
                true
                hasTaskVersionId
                false
                hasEvaluationDate
                true
                numericResultNullable
                value
                66.66666666666667
                standardDeviation
                0
                confidenceInterval
                0
                hasStandardDeviation
                false
                hasConfidenceInterval
                false
                hasUnevenConfidenceInterval
                false
                hasNumericResultPublic
                false
                customAdditionalResults
                  hasNumericResultPrivate
                  false
                  task_id
                  1202
                  sort_order
                  DESCENDING
                  source_name
                  (Overall)
                  display_type
                  rawValues
                  task_version
                  1
                  task_display_type
                  RAW_VALUES
                  normalization_status
                  normalized
                published_at
                2025-12-18T22:33:06.503394300Z
                candidate_class
                modelVersion
                source_revision
                b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
                publisher_anchor
                google/gemini-2.5-flash
                metric_population
                10
                benchmark_evaluation
                true
                task_metadata_source
                benchmarkVersion
                candidate_metadata_source
                benchmarkVersionMappings
                evaluated at
                2026-03-19T15:17:16.692Z
                source model id
                Gemini 2.5 Flash
                Original result ↗

                BFCL

                93.67%

                source id
                bfcl
                leaderboard name
                BFCL Irrelevance Detection
                dimension
                toolUse
                metric
                Irrelevance detection
                rank
                6
                Original result ↗

                LMArena

                1,275.721

                source id
                lmarena
                leaderboard name
                LMArena Vision Captioning
                dimension
                multimodal
                metric
                Arena rating
                rank
                7
                sample size
                578
                evaluated at
                2026-11-09T00:00:00.000Z
                source model id
                Gemini 2.5 Flash
                confidence lower
                1251.042055630837
                confidence upper
                1300.3990641377113
                Original result ↗

                Kaggle Benchmarks

                53.333%

                source id
                kaggleBenchmarks
                leaderboard name
                ITBench · FinOps Score
                dimension
                reasoning
                metric
                ITBench · FinOps Score
                rank
                7
                aggregation scope
                kaggle
                true
                status
                published
                license
                Apache-2.0
                direction
                higherIsBetter
                conditions
                task
                id
                1167
                name
                FinOps Score
                version
                8
                sort_order
                DESCENDING
                display_type
                rawPercentages
                benchmark
                id
                246
                name
                ITBench
                type
                INDIVIDUAL
                owner
                ibm-research
                version
                1
                categories
                • evaluation
                • general knowledge and reasoning
                version_id
                225
                maintainer_tier
                Kaggle-maintained
                maintenance_level
                KAGGLE_MAINTAINED
                candidate
                candidate_class
                modelVersion
                record_kind
                aggregate
                attribution
                Kaggle · ibm-research · ITBench
                license_url
                https://www.apache.org/licenses/LICENSE-2.0
                metric_kind
                ITBench · FinOps Score
                rank_method
                competition rank among reported evaluations in identical conditions, including unlinked observations
                source_file
                225/leaderboard.json
                source_page
                https://www.kaggle.com/benchmarks/ibm-research/itbench/versions/1
                measurements
                • name
                  FinOps Score
                  unit
                  percent
                  scale
                  100
                  metric
                  ITBench · FinOps Score
                  result
                  resultCase
                  numericResult
                  booleanResult
                  false
                  numericResult
                  value
                  53.333333333333336
                  standardDeviation
                  0
                  confidenceInterval
                  0
                  hasStandardDeviation
                  false
                  hasConfidenceInterval
                  false
                  hasUnevenConfidenceInterval
                  false
                  taskVersionId
                  0
                  evaluationDate
                  2025-12-01T19:44:29.464177Z
                  hasBooleanResult
                  false
                  hasNumericResult
                  true
                  hasTaskVersionId
                  false
                  hasEvaluationDate
                  true
                  numericResultNullable
                  value
                  53.333333333333336
                  standardDeviation
                  0
                  confidenceInterval
                  0
                  hasStandardDeviation
                  false
                  hasConfidenceInterval
                  false
                  hasUnevenConfidenceInterval
                  false
                  hasNumericResultPublic
                  false
                  customAdditionalResults
                    hasNumericResultPrivate
                    false
                    task_id
                    1167
                    task_url
                    /benchmarks/tasks/benchmarkler/itbench-finops-main-1
                    sort_order
                    DESCENDING
                    source_name
                    FinOps Score
                    display_type
                    rawPercentages
                    task_version
                    8
                    task_display_type
                    RAW_VALUES
                    normalization_status
                    normalized
                  published_at
                  2025-12-02T12:36:17.407125500Z
                  candidate_class
                  modelVersion
                  source_revision
                  b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
                  publisher_anchor
                  google/gemini-2.5-flash
                  metric_population
                  13
                  benchmark_evaluation
                  true
                  task_metadata_source
                  benchmarkVersion
                  candidate_metadata_source
                  benchmarkVersionMappings
                  evaluated at
                  2025-12-01T19:44:29.464Z
                  source model id
                  Gemini 2.5 Flash
                  Original result ↗

                  Kaggle Benchmarks

                  68.262%

                  source id
                  kaggleBenchmarks
                  leaderboard name
                  AssetOpsBench · Elimination Accuracy
                  dimension
                  reasoning
                  metric
                  AssetOpsBench · Elimination Accuracy
                  rank
                  9
                  aggregation scope
                  kaggle
                  true
                  status
                  published
                  license
                  Apache-2.0
                  direction
                  higherIsBetter
                  conditions
                  task
                  id
                  1041
                  name
                  Elimination Accuracy
                  version
                  1
                  sort_order
                  DESCENDING
                  display_type
                  percentages
                  benchmark
                  id
                  243
                  name
                  AssetOpsBench
                  type
                  INDIVIDUAL
                  owner
                  ibm-research
                  version
                  1
                  categories
                  • evaluation
                  • general knowledge and reasoning
                  version_id
                  222
                  maintainer_tier
                  Kaggle-maintained
                  maintenance_level
                  KAGGLE_MAINTAINED
                  candidate
                  candidate_class
                  modelVersion
                  record_kind
                  aggregate
                  attribution
                  Kaggle · ibm-research · AssetOpsBench
                  license_url
                  https://www.apache.org/licenses/LICENSE-2.0
                  metric_kind
                  AssetOpsBench · Elimination Accuracy
                  rank_method
                  competition rank among reported evaluations in identical conditions, including unlinked observations
                  source_file
                  222/leaderboard.json
                  source_page
                  https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
                  measurements
                  • name
                    Elimination Accuracy
                    unit
                    percent
                    scale
                    1
                    metric
                    AssetOpsBench · Elimination Accuracy
                    result
                    resultCase
                    numericResult
                    booleanResult
                    false
                    numericResult
                    value
                    0.6826186830015314
                    standardDeviation
                    0
                    confidenceInterval
                    0
                    hasStandardDeviation
                    false
                    hasConfidenceInterval
                    false
                    hasUnevenConfidenceInterval
                    false
                    taskVersionId
                    0
                    evaluationDate
                    2025-11-22T14:59:21.37379Z
                    hasBooleanResult
                    false
                    hasNumericResult
                    true
                    hasTaskVersionId
                    false
                    hasEvaluationDate
                    true
                    numericResultNullable
                    value
                    0.6826186830015314
                    standardDeviation
                    0
                    confidenceInterval
                    0
                    hasStandardDeviation
                    false
                    hasConfidenceInterval
                    false
                    hasUnevenConfidenceInterval
                    false
                    hasNumericResultPublic
                    false
                    customAdditionalResults
                      hasNumericResultPrivate
                      false
                      task_id
                      1041
                      task_url
                      /benchmarks/tasks/benchmarkler/failuresensoriq-eliminationaccuracy-benchmark-task
                      sort_order
                      DESCENDING
                      source_name
                      Elimination Accuracy
                      display_type
                      percentages
                      task_version
                      1
                      task_display_type
                      RAW_VALUES
                      normalization_status
                      normalized
                    published_at
                    2025-12-01T22:15:26.261663300Z
                    candidate_class
                    modelVersion
                    source_revision
                    b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
                    publisher_anchor
                    google/gemini-2.5-flash
                    metric_population
                    25
                    benchmark_evaluation
                    true
                    task_metadata_source
                    benchmarkVersion
                    candidate_metadata_source
                    benchmarkVersionMappings
                    evaluated at
                    2025-11-22T14:59:21.373Z
                    source model id
                    Gemini 2.5 Flash
                    Original result ↗

                    Kaggle Benchmarks

                    65.83%

                    source id
                    kaggleBenchmarks
                    leaderboard name
                    AssetOpsBench · F-Score
                    dimension
                    reasoning
                    metric
                    AssetOpsBench · F-Score
                    rank
                    9
                    aggregation scope
                    kaggle
                    true
                    status
                    published
                    license
                    Apache-2.0
                    direction
                    higherIsBetter
                    conditions
                    task
                    id
                    1040
                    name
                    F-Score
                    version
                    1
                    sort_order
                    DESCENDING
                    display_type
                    percentages
                    benchmark
                    id
                    243
                    name
                    AssetOpsBench
                    type
                    INDIVIDUAL
                    owner
                    ibm-research
                    version
                    1
                    categories
                    • evaluation
                    • general knowledge and reasoning
                    version_id
                    222
                    maintainer_tier
                    Kaggle-maintained
                    maintenance_level
                    KAGGLE_MAINTAINED
                    candidate
                    candidate_class
                    modelVersion
                    record_kind
                    aggregate
                    attribution
                    Kaggle · ibm-research · AssetOpsBench
                    license_url
                    https://www.apache.org/licenses/LICENSE-2.0
                    metric_kind
                    AssetOpsBench · F-Score
                    rank_method
                    competition rank among reported evaluations in identical conditions, including unlinked observations
                    source_file
                    222/leaderboard.json
                    source_page
                    https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
                    measurements
                    • name
                      F-Score
                      unit
                      percent
                      scale
                      1
                      metric
                      AssetOpsBench · F-Score
                      result
                      resultCase
                      numericResult
                      booleanResult
                      false
                      numericResult
                      value
                      0.6582957957957959
                      standardDeviation
                      0
                      confidenceInterval
                      0
                      hasStandardDeviation
                      false
                      hasConfidenceInterval
                      false
                      hasUnevenConfidenceInterval
                      false
                      taskVersionId
                      0
                      evaluationDate
                      2025-11-22T14:27:48.483362Z
                      hasBooleanResult
                      false
                      hasNumericResult
                      true
                      hasTaskVersionId
                      false
                      hasEvaluationDate
                      true
                      numericResultNullable
                      value
                      0.6582957957957959
                      standardDeviation
                      0
                      confidenceInterval
                      0
                      hasStandardDeviation
                      false
                      hasConfidenceInterval
                      false
                      hasUnevenConfidenceInterval
                      false
                      hasNumericResultPublic
                      false
                      customAdditionalResults
                        hasNumericResultPrivate
                        false
                        task_id
                        1040
                        task_url
                        /benchmarks/tasks/benchmarkler/failuresensoriq-fscore-benchmark-task
                        sort_order
                        DESCENDING
                        source_name
                        F-Score
                        display_type
                        percentages
                        task_version
                        1
                        task_display_type
                        RAW_VALUES
                        normalization_status
                        normalized
                      published_at
                      2025-12-01T22:15:26.261663300Z
                      candidate_class
                      modelVersion
                      source_revision
                      b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
                      publisher_anchor
                      google/gemini-2.5-flash
                      metric_population
                      25
                      benchmark_evaluation
                      true
                      task_metadata_source
                      benchmarkVersion
                      candidate_metadata_source
                      benchmarkVersionMappings
                      evaluated at
                      2025-11-22T14:27:48.483Z
                      source model id
                      Gemini 2.5 Flash
                      Original result ↗

                      Kaggle Benchmarks

                      65.529%

                      source id
                      kaggleBenchmarks
                      leaderboard name
                      AssetOpsBench · Score
                      dimension
                      reasoning
                      metric
                      AssetOpsBench · Score
                      rank
                      9
                      aggregation scope
                      kaggle
                      true
                      status
                      published
                      license
                      Apache-2.0
                      direction
                      higherIsBetter
                      conditions
                      task
                      id
                      487619
                      name
                      Score
                      version
                      5
                      sort_order
                      DESCENDING
                      display_type
                      percentages
                      benchmark
                      id
                      243
                      name
                      AssetOpsBench
                      type
                      INDIVIDUAL
                      owner
                      ibm-research
                      version
                      1
                      categories
                      • evaluation
                      • general knowledge and reasoning
                      version_id
                      222
                      maintainer_tier
                      Kaggle-maintained
                      maintenance_level
                      KAGGLE_MAINTAINED
                      candidate
                      candidate_class
                      modelVersion
                      record_kind
                      aggregate
                      attribution
                      Kaggle · ibm-research · AssetOpsBench
                      license_url
                      https://www.apache.org/licenses/LICENSE-2.0
                      metric_kind
                      AssetOpsBench · Score
                      rank_method
                      competition rank among reported evaluations in identical conditions, including unlinked observations
                      source_file
                      222/leaderboard.json
                      source_page
                      https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
                      measurements
                      • name
                        Score
                        unit
                        percent
                        scale
                        1
                        metric
                        AssetOpsBench · Score
                        result
                        resultCase
                        numericResult
                        booleanResult
                        false
                        numericResult
                        value
                        0.6552930883639545
                        standardDeviation
                        0
                        confidenceInterval
                        0
                        hasStandardDeviation
                        false
                        hasConfidenceInterval
                        false
                        hasUnevenConfidenceInterval
                        false
                        taskVersionId
                        0
                        evaluationDate
                        2025-11-22T05:00:11.36553Z
                        hasBooleanResult
                        false
                        hasNumericResult
                        true
                        hasTaskVersionId
                        false
                        hasEvaluationDate
                        true
                        numericResultNullable
                        value
                        0.6552930883639545
                        standardDeviation
                        0
                        confidenceInterval
                        0
                        hasStandardDeviation
                        false
                        hasConfidenceInterval
                        false
                        hasUnevenConfidenceInterval
                        false
                        hasNumericResultPublic
                        false
                        customAdditionalResults
                          hasNumericResultPrivate
                          false
                          task_id
                          487619
                          task_url
                          /benchmarks/tasks/benchmarkler/failuresensoriq-main-benchmark-task
                          sort_order
                          DESCENDING
                          source_name
                          Score
                          display_type
                          percentages
                          task_version
                          5
                          task_display_type
                          PERCENTAGES
                          normalization_status
                          normalized
                        published_at
                        2025-12-01T22:15:26.261663300Z
                        candidate_class
                        modelVersion
                        source_revision
                        b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
                        publisher_anchor
                        google/gemini-2.5-flash
                        metric_population
                        25
                        benchmark_evaluation
                        true
                        task_metadata_source
                        benchmarkVersion
                        candidate_metadata_source
                        benchmarkVersionMappings
                        evaluated at
                        2025-11-22T05:00:11.365Z
                        source model id
                        Gemini 2.5 Flash
                        Original result ↗

                        OpenRouter Benchmarks

                        54.667%

                        source id
                        openRouterBenchmarks
                        leaderboard name
                        tau2-bench Verified Airline · Accuracy · Google AI Studio
                        dimension
                        agentic
                        metric
                        tau2-bench Verified Airline · Accuracy
                        rank
                        9
                        sample size
                        100
                        aggregation scope
                        status
                        published
                        harness
                        url
                        https://github.com/OpenRouterTeam/benchmark-harness
                        name
                        OpenRouter benchmark harness
                        direction
                        higherIsBetter
                        run_count
                        2
                        conditions
                        window
                        newest 90 days; successful visible nonzero runs
                        dataset
                        benchmark-leaderboard
                        benchmark
                        id
                        tau_bench_verified_airline
                        name
                        tau2-bench Verified Airline
                        record_kind
                        aggregate
                        provider_name
                        Google AI Studio
                        attribution
                        Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
                        last_run_at
                        2026-10-01T19:04:42.483Z
                        license_url
                        https://creativecommons.org/licenses/by/4.0/
                        methodology
                        Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
                        metric_kind
                        tau2-bench Verified Airline · Accuracy
                        rank_method
                        competition rank among reported evaluations in identical conditions, including unlinked observations
                        sample_size
                        100
                        source_file
                        benchmark-leaderboard.json
                        source_page
                        https://openrouter.ai/benchmarks/tau2-bench-airline
                        measurements
                        accuracy
                        0.546667
                        accuracy_std_dev
                        0
                        cost_per_task_usd
                        0.03543453
                        output_tokens_per_task
                        6656.99
                        latency_seconds_per_task
                        61.13382
                        published_at
                        2026-11-16T01:46:02.653Z
                        snapshot_date
                        2026-11-16
                        source_revision
                        7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
                        transformations
                        TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
                        metric_population
                        10
                        benchmark_evaluation
                        true
                        openrouter_permaslug
                        google/gemini-2.5-flash
                        source model id
                        google/gemini-2.5-flash
                        Original result ↗

                        LMArena

                        1,253.055

                        source id
                        lmarena
                        leaderboard name
                        LMArena Vision Creative Writing
                        dimension
                        multimodal
                        metric
                        Arena rating
                        rank
                        10
                        sample size
                        1745
                        evaluated at
                        2026-01-09T00:00:00.000Z
                        source model id
                        gemini-2.5-flash
                        confidence lower
                        1238.269469149889
                        confidence upper
                        1267.84020941767
                        Original result ↗

                        OpenRouter Benchmarks

                        76.684%

                        source id
                        openRouterBenchmarks
                        leaderboard name
                        GPQA Diamond · Accuracy · Google AI Studio
                        dimension
                        knowledge
                        metric
                        GPQA Diamond · Accuracy
                        rank
                        10
                        sample size
                        396
                        aggregation scope
                        status
                        published
                        harness
                        url
                        https://github.com/OpenRouterTeam/benchmark-harness
                        name
                        OpenRouter benchmark harness
                        direction
                        higherIsBetter
                        run_count
                        2
                        conditions
                        window
                        newest 90 days; successful visible nonzero runs
                        dataset
                        benchmark-leaderboard
                        benchmark
                        id
                        gpqa_diamond
                        name
                        GPQA Diamond
                        record_kind
                        aggregate
                        provider_name
                        Google AI Studio
                        attribution
                        Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
                        last_run_at
                        2026-10-01T19:11:42.323Z
                        license_url
                        https://creativecommons.org/licenses/by/4.0/
                        methodology
                        Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
                        metric_kind
                        GPQA Diamond · Accuracy
                        rank_method
                        competition rank among reported evaluations in identical conditions, including unlinked observations
                        sample_size
                        396
                        source_file
                        benchmark-leaderboard.json
                        source_page
                        https://openrouter.ai/benchmarks/gpqa-diamond
                        measurements
                        accuracy
                        0.7668349999999999
                        accuracy_std_dev
                        0.004208999999999963
                        cost_per_task_usd
                        0.057140755050505046
                        output_tokens_per_task
                        22766.989898989897
                        latency_seconds_per_task
                        101.02492676767676
                        published_at
                        2026-11-16T01:46:02.653Z
                        snapshot_date
                        2026-11-16
                        source_revision
                        7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
                        transformations
                        TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
                        metric_population
                        12
                        benchmark_evaluation
                        true
                        openrouter_permaslug
                        google/gemini-2.5-flash
                        source model id
                        google/gemini-2.5-flash
                        Original result ↗

                        BFCL

                        91.09%

                        source id
                        bfcl
                        leaderboard name
                        BFCL Irrelevance Detection
                        dimension
                        toolUse
                        metric
                        Irrelevance detection
                        rank
                        11
                        Original result ↗

                        Published prices

                        1–20 / 45

                        gemini-2.5-flash ↗

                        $0.02

                        Inference provider
                        cheaperInference
                        Platform
                        Cheaper Inference
                        Unit
                        cache_read_tokens_per_million
                        Currency
                        USD
                        Billing conditions
                        zdr
                        false
                        protocol
                        chat_completions
                        service_tier
                        standard
                        Billing label
                        Cached input tokens (per 1M)

                        gemini-2.5-flash ↗

                        $0.20

                        Inference provider
                        cheaperInference
                        Platform
                        Cheaper Inference
                        Unit
                        input_tokens_per_million
                        Currency
                        USD
                        Billing conditions
                        zdr
                        false
                        protocol
                        chat_completions
                        service_tier
                        standard
                        Billing label
                        Input tokens (per 1M)

                        gemini-2.5-flash ↗

                        $1.63

                        Inference provider
                        cheaperInference
                        Platform
                        Cheaper Inference
                        Unit
                        output_tokens_per_million
                        Currency
                        USD
                        Billing conditions
                        zdr
                        false
                        protocol
                        chat_completions
                        service_tier
                        standard
                        Billing label
                        Output tokens (per 1M)

                        google/gemini-2.5-flash ↗

                        $0.03

                        Inference provider
                        cloudflareWorkersAI
                        Platform
                        Google Vertex AI
                        Unit
                        cache_read_tokens_per_million
                        Currency
                        USD
                        Billing conditions
                        Billing label
                        Cached input tokens (per 1M)
                        Pricing via
                        Cloudflare AI Gateway

                        google/gemini-2.5-flash ↗

                        $0.30

                        Inference provider
                        cloudflareWorkersAI
                        Platform
                        Google Vertex AI
                        Unit
                        input_tokens_per_million
                        Currency
                        USD
                        Billing conditions
                        Billing label
                        Input tokens (per 1M)
                        Pricing via
                        Cloudflare AI Gateway

                        google/gemini-2.5-flash ↗

                        $2.50

                        Inference provider
                        cloudflareWorkersAI
                        Platform
                        Google Vertex AI
                        Unit
                        output_tokens_per_million
                        Currency
                        USD
                        Billing conditions
                        Billing label
                        Output tokens (per 1M)
                        Pricing via
                        Cloudflare AI Gateway

                        google/gemini-2.5-flash ↗

                        $0.03

                        Inference provider
                        openRouter
                        Platform
                        OpenRouter
                        Unit
                        cache_read_tokens_per_million
                        Currency
                        USD
                        Billing conditions

                        google/gemini-2.5-flash ↗

                        $0.08

                        Inference provider
                        openRouter
                        Platform
                        OpenRouter
                        Unit
                        cache_write_tokens_per_million
                        Currency
                        USD
                        Billing conditions

                        google/gemini-2.5-flash ↗

                        $0.30

                        Inference provider
                        openRouter
                        Platform
                        OpenRouter
                        Unit
                        input_tokens_per_million
                        Currency
                        USD
                        Billing conditions

                        google/gemini-2.5-flash ↗

                        $2.50

                        Inference provider
                        openRouter
                        Platform
                        OpenRouter
                        Unit
                        output_tokens_per_million
                        Currency
                        USD
                        Billing conditions

                        google/gemini-2.5-flash ↗

                        $0.03

                        Inference provider
                        vercelAIGatewayCatalog
                        Platform
                        Vercel AI Gateway
                        Unit
                        cache_read_tokens_per_million
                        Currency
                        USD
                        Billing conditions
                        model_type
                        language
                        quote_scope
                        gateway_catalog
                        billing_scope
                        Vercel public catalog; endpoint prices may differ
                        Billing label
                        Cached input / 1M
                        Pricing via
                        Vercel AI Gateway

                        google/gemini-2.5-flash ↗

                        $0.05

                        Inference provider
                        vercelAIGatewayCatalog
                        Platform
                        Vercel AI Gateway
                        Unit
                        cache_read_tokens_per_million
                        Currency
                        USD
                        Billing conditions
                        model_type
                        language
                        quote_scope
                        gateway_catalog
                        service_tier
                        priority
                        billing_scope
                        Vercel public catalog; endpoint prices may differ
                        Billing label
                        Cached input / 1M
                        Pricing via
                        Vercel AI Gateway

                        google/gemini-2.5-flash ↗

                        $0.03

                        Inference provider
                        vercelAIGatewayCatalog
                        Platform
                        Vercel AI Gateway
                        Unit
                        cache_read_tokens_per_million
                        Currency
                        USD
                        Billing conditions
                        region
                        eu
                        model_type
                        language
                        quote_scope
                        gateway_catalog
                        billing_scope
                        Vercel public catalog; endpoint prices may differ
                        Billing label
                        Cached input / 1M
                        Pricing via
                        Vercel AI Gateway

                        google/gemini-2.5-flash ↗

                        $0.03

                        Inference provider
                        vercelAIGatewayCatalog
                        Platform
                        Vercel AI Gateway
                        Unit
                        cache_read_tokens_per_million
                        Currency
                        USD
                        Billing conditions
                        region
                        us
                        model_type
                        language
                        quote_scope
                        gateway_catalog
                        billing_scope
                        Vercel public catalog; endpoint prices may differ
                        Billing label
                        Cached input / 1M
                        Pricing via
                        Vercel AI Gateway

                        google/gemini-2.5-flash ↗

                        $0.30

                        Inference provider
                        vercelAIGatewayCatalog
                        Platform
                        Vercel AI Gateway
                        Unit
                        input_tokens_per_million
                        Currency
                        USD
                        Billing conditions
                        model_type
                        language
                        quote_scope
                        gateway_catalog
                        billing_scope
                        Vercel public catalog; endpoint prices may differ
                        Billing label
                        Input tokens / 1M
                        Pricing via
                        Vercel AI Gateway

                        google/gemini-2.5-flash ↗

                        $0.15

                        Inference provider
                        vercelAIGatewayCatalog
                        Platform
                        Vercel AI Gateway
                        Unit
                        input_tokens_per_million
                        Currency
                        USD
                        Billing conditions
                        model_type
                        language
                        quote_scope
                        gateway_catalog
                        service_tier
                        flex
                        billing_scope
                        Vercel public catalog; endpoint prices may differ
                        Billing label
                        Input tokens / 1M
                        Pricing via
                        Vercel AI Gateway

                        Provider specifications & access

                        1–4 / 4

                        gemini-2.5-flash ↗

                        source model id
                        gemini-2.5-flash
                        hosting
                        gateway
                        platforms
                        • Cheaper Inference
                        context length
                        1048576
                        max output tokens
                        65535
                        architecture
                        input_modalities
                        • text
                        • image
                        output_modalities
                        • text
                        capabilities
                        • structuredOutputs
                        • toolCalling
                        • visionInput
                        • webSearch

                        Gemini 2.5 Flash ↗

                        source model id
                        google/gemini-2.5-flash
                        hosting
                        third-party
                        platforms
                        • Google Vertex AI
                        context length
                        1000000
                        max output tokens
                        8192
                        architecture
                        input_modalities
                        • text
                        output_modalities
                        • text
                        capabilities
                        • reasoning

                        Gemini 2.5 Flash ↗

                        source model id
                        google/gemini-2.5-flash
                        hosting
                        vercel-gateway
                        platforms
                        • Vercel AI Gateway
                        context length
                        1000000
                        max output tokens
                        65535
                        architecture
                        input_modalities
                        • text
                        • image
                        • pdf
                        output_modalities
                        • text
                        capabilities
                        • promptCaching
                        • reasoning
                        • structuredOutputs
                        • toolCalling
                        • visionInput
                        • webSearch
                        regions
                        • eu
                        • us

                        Gemini 2.5 Flash ↗

                        source model id
                        publishers/google/models/gemini-2.5-flash@default
                        hosting
                        vertex-managed
                        platforms
                        • Google Cloud Vertex AI
                        context length
                        1048576
                        max output tokens
                        65536
                        architecture
                        input_modalities
                        • audio
                        • image
                        • text
                        • video
                        output_modalities
                        • text
                        capabilities
                        • batch
                        • multimodal
                        • promptCaching
                        • reasoning
                        • structuredOutputs
                        • toolCalling
                        • visionInput

                        Safety assessments

                        1–1 / 1

                        Foundation Model Transparency Index 2025 ↗

                        41 / 100

                        source id
                        stanfordFMTI
                        canonical model id
                        google/gemini-2.5-flash
                        taxonomy
                        transparency
                        hazard category
                        transparency
                        hazard name
                        Organization transparency
                        policy area
                        Google
                        assessment type
                        organization-level disclosure
                        metric
                        disclosure_score
                        result label
                        41 / 100
                        sample size
                        100
                        updated at
                        2026-11-09T18:08:05.227Z

                        Source specification observations

                        1–10 / 10

                        cloudflareWorkersAI ↗

                        field
                        context_length
                        value
                        1000000
                        normalized value
                        1000000
                        scope
                        source-model
                        source id
                        cloudflareWorkersAI
                        confidence
                        1

                        openRouter ↗

                        field
                        context_length
                        value
                        1048576
                        normalized value
                        1048576
                        scope
                        source-model
                        source id
                        openRouter
                        confidence
                        1

                        vercelAIGatewayCatalog ↗

                        field
                        context_length
                        value
                        1000000
                        normalized value
                        1000000
                        scope
                        source-model
                        source id
                        vercelAIGatewayCatalog
                        confidence
                        1

                        vertexAI ↗

                        field
                        context_length
                        value
                        1048576
                        normalized value
                        1048576
                        scope
                        source-model
                        source id
                        vertexAI
                        confidence
                        1

                        openRouter ↗

                        field
                        knowledge_cutoff
                        reported field
                        knowledge_cutoff
                        value
                        2025-01-31
                        normalized value
                        2025-01-31
                        precision
                        day
                        scope
                        source-model
                        source id
                        openRouter
                        confidence
                        1

                        vercelAIGatewayCatalog ↗

                        field
                        knowledge_cutoff
                        reported field
                        knowledge_cutoff
                        value
                        2025-01
                        normalized value
                        2025-01
                        precision
                        month
                        scope
                        source-model
                        source id
                        vercelAIGatewayCatalog
                        confidence
                        1

                        cloudflareWorkersAI ↗

                        field
                        max_output_tokens
                        value
                        8192
                        normalized value
                        8192
                        scope
                        source-model
                        source id
                        cloudflareWorkersAI
                        confidence
                        1

                        openRouter ↗

                        field
                        max_output_tokens
                        value
                        65535
                        normalized value
                        65535
                        scope
                        source-model
                        source id
                        openRouter
                        confidence
                        1

                        vercelAIGatewayCatalog ↗

                        field
                        max_output_tokens
                        value
                        65535
                        normalized value
                        65535
                        scope
                        source-model
                        source id
                        vercelAIGatewayCatalog
                        confidence
                        1

                        vertexAI ↗

                        field
                        max_output_tokens
                        value
                        65536
                        normalized value
                        65536
                        scope
                        source-model
                        source id
                        vertexAI
                        confidence
                        1

                        Original sources

                        1–20 / 22

                        Google DeepMind · Model reference ↗

                        Google DeepMind · Model reference ↗

                        DeepInfra · Model page ↗

                        Google Cloud · Model page ↗

                        OpenRouter · Model page ↗

                        Vercel AI Gateway · Model page ↗

                        Google Cloud · Documentation ↗

                        GitHub · Source snapshot ↗

                        api.cheaperinference.com · Source snapshot ↗

                        Cloudflare AI · Catalog ↗

                        DeepInfra · Catalog ↗

                        Epoch AI · Catalog ↗

                        GitHub · Catalog ↗

                        GitHub · Catalog ↗

                        Google Cloud · Catalog ↗

                        Kaggle · Catalog ↗

                        LMArena · Catalog ↗

                        OpenRouter · Catalog ↗

                        OpenRouter · Catalog ↗

                        Vercel AI Gateway · Catalog ↗

                        Source links

                        1–15 / 15

                        Explore more models

                        Models

                        Loading
                        EVIDENCE / COMPARISON

                        Benchmarks

                        Explore every benchmark

                        Loading

                        These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

                        Install TensorTrace