Google: Gemini 2.5 Flash
Gemini 2.5 Flash is Google's state-of-the-art workhorse model, specifically designed for advanced reasoning, coding, mathematics, and scientific tasks. It includes built-in "thinking" capabilities, e…
google/gemini-2.5-flash
Gemini 2.5 Flash is Google's state-of-the-art workhorse model, specifically designed for advanced reasoning, coding, mathematics, and scientific tasks. It includes built-in "thinking" capabilities, enabling it to provide responses with greater accuracy and nuanced context handling.
Additionally, Gemini 2.5 Flash is configurable through the "max tokens for reasoning" parameter, as described in the documentation (https://openrouter.ai/docs/use-cases/reasoning-tokens#max-tokens-for-reasoning).
Specifications & capabilities
- Input
- file, image, text, audio, video
- Output
- text
- Context window · tokens
- 1048576
- Knowledge cutoff
- 2025-01
- Published model ID
- gemini-2.5-flash@default
- Capabilities
- audioInput, batch, fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput, webSearch
Description source ↗Evaluations
21–40 / 2,449
0.11
- source id
- llmStatsArchive
- leaderboard name
- Humanity's Last Exam · Normalized (reported)
- dimension
- general
- metric
- Humanity's Last Exam · Normalized (reported)
- rank
- 2
- aggregation scope
- status
- archived
- license
- CC-BY-4.0
- direction
- higherIsBetter
- conditions
- language
- en
- benchmark
- name
- Humanity's Last Exam
- language
- en
- modality
- multimodal
- verified
- false
- max_score
- 1
- created_at
- 2025-07-19T19:56:12.507693+00:00
- paper_link
- https://arxiv.org/abs/2501.14249
- updated_at
- 2025-07-19T19:56:12.507693+00:00
- description
- A multi-modal benchmark at the frontier of human knowledge with 2,500 questions across dozens of subjects including mathematics, humanities, and natural sciences, created by nearly 1000 subject expert contributors from over 500 institutions
- benchmark_id
- humanity's-last-exam
- multilingual
- false
- analysis_method
- Accuracy
- is_self_reported
- true
- verified_by_llmstats
- false
- attribution
- Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
- license_url
- https://creativecommons.org/licenses/by/4.0/
- metric_kind
- Humanity's Last Exam · Normalized (reported)
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- data/organizations/google/models/gemini-2.5-flash/benchmarks.json
- archive_kind
- llmStats
- evidence_url
- https://developers.googleblog.com/en/start-building-with-gemini-25-flash/
- git_revision
- 872b75f63b8d853c46ed17856424029a0c47b1d2
- published_at
- 2025-10-24T17:47:59Z
- snapshot_date
- 2025-10-24T17:47:59Z
- source_revision
- 6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 2
- current_catalog_url
- https://llm-stats.com/
- benchmark_evaluation
- true
- source model id
- gemini-2.5-flash
Original result ↗70.865
- source id
- kaggleBenchmarks
- leaderboard name
- IndicGenBench · XorQA-In
- dimension
- general
- metric
- IndicGenBench · XorQA-In
- rank
- 3
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 817
- name
- XorQA-In
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 212
- name
- IndicGenBench
- type
- SUITE
- owner
- deepmind
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- version_id
- 191
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · deepmind · IndicGenBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- IndicGenBench · XorQA-In
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 191/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/deepmind/indic-gen-bench/versions/1
- measurements
- name
- XorQA-In
- unit
- score
- scale
- 1
- metric
- IndicGenBench · XorQA-In
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 70.86482797644737
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-10-28T22:12:53.314439Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 70.86482797644737
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 817
- task_url
- /benchmarks/tasks/aminmohamedmohami/xorqa-in-task
- sort_order
- DESCENDING
- source_name
- XorQA-In
- display_type
- counts
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-04T15:09:28.942941700Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 13
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-10-28T22:12:53.314Z
- source model id
- Gemini 2.5 Flash
Original result ↗0.269
- source id
- llmStatsArchive
- leaderboard name
- SimpleQA · Normalized (reported)
- dimension
- general
- metric
- SimpleQA · Normalized (reported)
- rank
- 3
- aggregation scope
- status
- archived
- license
- CC-BY-4.0
- direction
- higherIsBetter
- conditions
- language
- en
- benchmark
- name
- SimpleQA
- language
- en
- modality
- text
- verified
- false
- max_score
- 1
- created_at
- 2025-09-05T00:00:00.000000+00:00
- paper_link
- https://arxiv.org/abs/2411.04368
- updated_at
- 2025-09-05T00:00:00.000000+00:00
- description
- SimpleQA is a factuality benchmark developed by OpenAI that measures the short-form factual accuracy of large language models. The benchmark contains 4,326 short, fact-seeking questions that are adversarially collected and designed to have single, indisputable answers. Questions cover diverse topics from science and technology to entertainment, and the benchmark also measures model calibration by evaluating whether models know what they know.
- benchmark_id
- simpleqa
- multilingual
- false
- analysis_method
- Accuracy
- is_self_reported
- true
- verified_by_llmstats
- false
- attribution
- Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
- license_url
- https://creativecommons.org/licenses/by/4.0/
- metric_kind
- SimpleQA · Normalized (reported)
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- data/organizations/google/models/gemini-2.5-flash/benchmarks.json
- archive_kind
- llmStats
- evidence_url
- https://developers.googleblog.com/en/start-building-with-gemini-25-flash/
- git_revision
- 872b75f63b8d853c46ed17856424029a0c47b1d2
- published_at
- 2025-10-24T17:47:59Z
- snapshot_date
- 2025-10-24T17:47:59Z
- source_revision
- 6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 3
- current_catalog_url
- https://llm-stats.com/
- benchmark_evaluation
- true
- source model id
- gemini-2.5-flash
Original result ↗0.269
- source id
- llmStatsArchive
- leaderboard name
- SimpleQA · Raw
- dimension
- general
- metric
- SimpleQA · Raw
- rank
- 3
- aggregation scope
- status
- archived
- license
- CC-BY-4.0
- direction
- higherIsBetter
- conditions
- language
- en
- benchmark
- name
- SimpleQA
- language
- en
- modality
- text
- verified
- false
- max_score
- 1
- created_at
- 2025-09-05T00:00:00.000000+00:00
- paper_link
- https://arxiv.org/abs/2411.04368
- updated_at
- 2025-09-05T00:00:00.000000+00:00
- description
- SimpleQA is a factuality benchmark developed by OpenAI that measures the short-form factual accuracy of large language models. The benchmark contains 4,326 short, fact-seeking questions that are adversarially collected and designed to have single, indisputable answers. Questions cover diverse topics from science and technology to entertainment, and the benchmark also measures model calibration by evaluating whether models know what they know.
- benchmark_id
- simpleqa
- multilingual
- false
- analysis_method
- Accuracy
- is_self_reported
- true
- verified_by_llmstats
- false
- attribution
- Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
- license_url
- https://creativecommons.org/licenses/by/4.0/
- metric_kind
- SimpleQA · Raw
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- data/organizations/google/models/gemini-2.5-flash/benchmarks.json
- archive_kind
- llmStats
- evidence_url
- https://developers.googleblog.com/en/start-building-with-gemini-25-flash/
- git_revision
- 872b75f63b8d853c46ed17856424029a0c47b1d2
- published_at
- 2025-10-24T17:47:59Z
- snapshot_date
- 2025-10-24T17:47:59Z
- source_revision
- 6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 3
- current_catalog_url
- https://llm-stats.com/
- benchmark_evaluation
- true
- source model id
- gemini-2.5-flash
Original result ↗76.801
- source id
- kaggleBenchmarks
- leaderboard name
- IndicGenBench · XQuAD-In
- dimension
- general
- metric
- IndicGenBench · XQuAD-In
- rank
- 4
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 820
- name
- XQuAD-In
- version
- 3
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 212
- name
- IndicGenBench
- type
- SUITE
- owner
- deepmind
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- version_id
- 191
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · deepmind · IndicGenBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- IndicGenBench · XQuAD-In
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 191/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/deepmind/indic-gen-bench/versions/1
- measurements
- name
- XQuAD-In
- unit
- score
- scale
- 1
- metric
- IndicGenBench · XQuAD-In
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 76.8012821738746
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-10-29T00:38:53.667467Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 76.8012821738746
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 820
- task_url
- /benchmarks/tasks/aminmohamedmohami/xquad-in-task
- sort_order
- DESCENDING
- source_name
- XQuAD-In
- display_type
- counts
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-04T15:09:28.942941700Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 14
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-10-29T00:38:53.667Z
- source model id
- Gemini 2.5 Flash
Original result ↗56.917
- source id
- kaggleBenchmarks
- leaderboard name
- IndicGenBench · Average
- dimension
- general
- metric
- IndicGenBench · Average
- rank
- 4
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 897
- name
- Average
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 212
- name
- IndicGenBench
- type
- SUITE
- owner
- deepmind
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- version_id
- 191
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · deepmind · IndicGenBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- IndicGenBench · Average
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 191/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/deepmind/indic-gen-bench/versions/1
- measurements
- name
- Average
- unit
- score
- scale
- 1
- metric
- IndicGenBench · Average
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 56.91735746945958
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-10-29T00:38:53.667467Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 56.91735746945958
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 897
- sort_order
- DESCENDING
- source_name
- Average
- display_type
- counts
- task_version
- 1
- task_display_type
- COUNTS
- normalization_status
- normalized
- published_at
- 2025-12-04T15:09:28.942941700Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 14
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-10-29T00:38:53.667Z
- source model id
- Gemini 2.5 Flash
Original result ↗54.671
- source id
- kaggleBenchmarks
- leaderboard name
- IndicGenBench · Flores-In
- dimension
- general
- metric
- IndicGenBench · Flores-In
- rank
- 4
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 816
- name
- Flores-In
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 212
- name
- IndicGenBench
- type
- SUITE
- owner
- deepmind
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- version_id
- 191
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · deepmind · IndicGenBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- IndicGenBench · Flores-In
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 191/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/deepmind/indic-gen-bench/versions/1
- measurements
- name
- Flores-In
- unit
- score
- scale
- 1
- metric
- IndicGenBench · Flores-In
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 54.6708427306447
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-10-28T22:11:53.46331Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 54.6708427306447
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 816
- task_url
- /benchmarks/tasks/aminmohamedmohami/flores-in-task
- sort_order
- DESCENDING
- source_name
- Flores-In
- display_type
- counts
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-04T15:09:28.942941700Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 13
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-10-28T22:11:53.463Z
- source model id
- Gemini 2.5 Flash
Original result ↗25.332
- source id
- kaggleBenchmarks
- leaderboard name
- IndicGenBench · CrossSum-In
- dimension
- general
- metric
- IndicGenBench · CrossSum-In
- rank
- 4
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 815
- name
- CrossSum-In
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 212
- name
- IndicGenBench
- type
- SUITE
- owner
- deepmind
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- version_id
- 191
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · deepmind · IndicGenBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- IndicGenBench · CrossSum-In
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 191/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/deepmind/indic-gen-bench/versions/1
- measurements
- name
- CrossSum-In
- unit
- score
- scale
- 1
- metric
- IndicGenBench · CrossSum-In
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 25.332476996871655
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-10-28T22:12:49.843933Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 25.332476996871655
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 815
- task_url
- /benchmarks/tasks/aminmohamedmohami/crosssum-in-task
- sort_order
- DESCENDING
- source_name
- CrossSum-In
- display_type
- counts
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-04T15:09:28.942941700Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 13
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-10-28T22:12:49.843Z
- source model id
- Gemini 2.5 Flash
Original result ↗51.667%
- source id
- kaggleBenchmarks
- leaderboard name
- ITBench · Average Score
- dimension
- reasoning
- metric
- ITBench · Average Score
- rank
- 5
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1064
- name
- Average Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- rawPercentages
- benchmark
- id
- 246
- name
- ITBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 225
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · ITBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- ITBench · Average Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 225/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/itbench/versions/1
- measurements
- name
- Average Score
- unit
- percent
- scale
- 100
- metric
- ITBench · Average Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 51.66666666666667
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-12-01T22:28:02.522152Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 51.66666666666667
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1064
- sort_order
- DESCENDING
- source_name
- Average Score
- display_type
- rawPercentages
- task_version
- 1
- task_display_type
- RAW_PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-12-02T12:36:17.407125500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 13
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-12-01T22:28:02.522Z
- source model id
- Gemini 2.5 Flash
Original result ↗66.667
- source id
- kaggleBenchmarks
- leaderboard name
- NeurIPS 2025 Experts · (Overall)
- dimension
- reasoning
- metric
- NeurIPS 2025 Experts · (Overall)
- rank
- 6
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1202
- name
- (Overall)
- version
- 1
- sort_order
- DESCENDING
- display_type
- rawValues
- benchmark
- id
- 271
- name
- NeurIPS 2025 Experts
- type
- INDIVIDUAL
- owner
- kaggle
- version
- 1
- categories
- general knowledge and reasoning
- version_id
- 250
- maintainer_tier
- Kaggle-published
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · kaggle · NeurIPS 2025 Experts
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- NeurIPS 2025 Experts · (Overall)
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 250/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/kaggle/neurips-2025/versions/1
- measurements
- name
- (Overall)
- unit
- score
- scale
- 1
- metric
- NeurIPS 2025 Experts · (Overall)
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 66.66666666666667
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-03-19T15:17:16.692772Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 66.66666666666667
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1202
- sort_order
- DESCENDING
- source_name
- (Overall)
- display_type
- rawValues
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-18T22:33:06.503394300Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 10
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-03-19T15:17:16.692Z
- source model id
- Gemini 2.5 Flash
Original result ↗93.67%
- source id
- bfcl
- leaderboard name
- BFCL Irrelevance Detection
- dimension
- toolUse
- metric
- Irrelevance detection
- rank
- 6
Original result ↗1,275.721
- source id
- lmarena
- leaderboard name
- LMArena Vision Captioning
- dimension
- multimodal
- metric
- Arena rating
- rank
- 7
- sample size
- 578
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- Gemini 2.5 Flash
- confidence lower
- 1251.042055630837
- confidence upper
- 1300.3990641377113
Original result ↗53.333%
- source id
- kaggleBenchmarks
- leaderboard name
- ITBench · FinOps Score
- dimension
- reasoning
- metric
- ITBench · FinOps Score
- rank
- 7
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1167
- name
- FinOps Score
- version
- 8
- sort_order
- DESCENDING
- display_type
- rawPercentages
- benchmark
- id
- 246
- name
- ITBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 225
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · ITBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- ITBench · FinOps Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 225/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/itbench/versions/1
- measurements
- name
- FinOps Score
- unit
- percent
- scale
- 100
- metric
- ITBench · FinOps Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 53.333333333333336
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-12-01T19:44:29.464177Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 53.333333333333336
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1167
- task_url
- /benchmarks/tasks/benchmarkler/itbench-finops-main-1
- sort_order
- DESCENDING
- source_name
- FinOps Score
- display_type
- rawPercentages
- task_version
- 8
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-02T12:36:17.407125500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 13
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-12-01T19:44:29.464Z
- source model id
- Gemini 2.5 Flash
Original result ↗68.262%
- source id
- kaggleBenchmarks
- leaderboard name
- AssetOpsBench · Elimination Accuracy
- dimension
- reasoning
- metric
- AssetOpsBench · Elimination Accuracy
- rank
- 9
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1041
- name
- Elimination Accuracy
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 243
- name
- AssetOpsBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 222
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · AssetOpsBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AssetOpsBench · Elimination Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 222/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
- measurements
- name
- Elimination Accuracy
- unit
- percent
- scale
- 1
- metric
- AssetOpsBench · Elimination Accuracy
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.6826186830015314
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-11-22T14:59:21.37379Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.6826186830015314
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1041
- task_url
- /benchmarks/tasks/benchmarkler/failuresensoriq-eliminationaccuracy-benchmark-task
- sort_order
- DESCENDING
- source_name
- Elimination Accuracy
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-01T22:15:26.261663300Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 25
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-11-22T14:59:21.373Z
- source model id
- Gemini 2.5 Flash
Original result ↗65.83%
- source id
- kaggleBenchmarks
- leaderboard name
- AssetOpsBench · F-Score
- dimension
- reasoning
- metric
- AssetOpsBench · F-Score
- rank
- 9
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1040
- name
- F-Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 243
- name
- AssetOpsBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 222
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · AssetOpsBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AssetOpsBench · F-Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 222/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
- measurements
- name
- F-Score
- unit
- percent
- scale
- 1
- metric
- AssetOpsBench · F-Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.6582957957957959
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-11-22T14:27:48.483362Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.6582957957957959
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1040
- task_url
- /benchmarks/tasks/benchmarkler/failuresensoriq-fscore-benchmark-task
- sort_order
- DESCENDING
- source_name
- F-Score
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-01T22:15:26.261663300Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 25
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-11-22T14:27:48.483Z
- source model id
- Gemini 2.5 Flash
Original result ↗65.529%
- source id
- kaggleBenchmarks
- leaderboard name
- AssetOpsBench · Score
- dimension
- reasoning
- metric
- AssetOpsBench · Score
- rank
- 9
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 487619
- name
- Score
- version
- 5
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 243
- name
- AssetOpsBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 222
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · AssetOpsBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AssetOpsBench · Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 222/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
- measurements
- name
- Score
- unit
- percent
- scale
- 1
- metric
- AssetOpsBench · Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.6552930883639545
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-11-22T05:00:11.36553Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.6552930883639545
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 487619
- task_url
- /benchmarks/tasks/benchmarkler/failuresensoriq-main-benchmark-task
- sort_order
- DESCENDING
- source_name
- Score
- display_type
- percentages
- task_version
- 5
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-12-01T22:15:26.261663300Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-flash
- metric_population
- 25
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-11-22T05:00:11.365Z
- source model id
- Gemini 2.5 Flash
Original result ↗54.667%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · Google AI Studio
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 9
- sample size
- 100
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 2
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- Google AI Studio
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-01T19:04:42.483Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 100
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.546667
- accuracy_std_dev
- 0
- cost_per_task_usd
- 0.03543453
- output_tokens_per_task
- 6656.99
- latency_seconds_per_task
- 61.13382
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 10
- benchmark_evaluation
- true
- openrouter_permaslug
- google/gemini-2.5-flash
- source model id
- google/gemini-2.5-flash
Original result ↗1,253.055
- source id
- lmarena
- leaderboard name
- LMArena Vision Creative Writing
- dimension
- multimodal
- metric
- Arena rating
- rank
- 10
- sample size
- 1745
- evaluated at
- 2026-01-09T00:00:00.000Z
- source model id
- gemini-2.5-flash
- confidence lower
- 1238.269469149889
- confidence upper
- 1267.84020941767
Original result ↗76.684%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · Google AI Studio
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 10
- sample size
- 396
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 2
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- Google AI Studio
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-01T19:11:42.323Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 396
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.7668349999999999
- accuracy_std_dev
- 0.004208999999999963
- cost_per_task_usd
- 0.057140755050505046
- output_tokens_per_task
- 22766.989898989897
- latency_seconds_per_task
- 101.02492676767676
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 12
- benchmark_evaluation
- true
- openrouter_permaslug
- google/gemini-2.5-flash
- source model id
- google/gemini-2.5-flash
Original result ↗91.09%
- source id
- bfcl
- leaderboard name
- BFCL Irrelevance Detection
- dimension
- toolUse
- metric
- Irrelevance detection
- rank
- 11
Original result ↗Published prices
1–20 / 45
$0.02
- Inference provider
- cheaperInference
- Platform
- Cheaper Inference
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- zdr
- false
- protocol
- chat_completions
- service_tier
- standard
- Billing label
- Cached input tokens (per 1M)
$0.20
- Inference provider
- cheaperInference
- Platform
- Cheaper Inference
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- zdr
- false
- protocol
- chat_completions
- service_tier
- standard
- Billing label
- Input tokens (per 1M)
$1.63
- Inference provider
- cheaperInference
- Platform
- Cheaper Inference
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- zdr
- false
- protocol
- chat_completions
- service_tier
- standard
- Billing label
- Output tokens (per 1M)
$0.03
- Inference provider
- cloudflareWorkersAI
- Platform
- Google Vertex AI
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing label
- Cached input tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$0.30
- Inference provider
- cloudflareWorkersAI
- Platform
- Google Vertex AI
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing label
- Input tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$2.50
- Inference provider
- cloudflareWorkersAI
- Platform
- Google Vertex AI
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing label
- Output tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$0.30
- Inference provider
- deepInfra
- Platform
- DeepInfra
- Unit
- input_tokens_per_million
- Currency
- USD
$2.50
- Inference provider
- deepInfra
- Platform
- DeepInfra
- Unit
- output_tokens_per_million
- Currency
- USD
$0.03
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
$0.08
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_write_tokens_per_million
- Currency
- USD
$0.00000030
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- image
- Currency
- USD
$0.30
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
$2.50
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
$0.01
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- web_search
- Currency
- USD
$0.03
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.05
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- service_tier
- priority
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.03
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- eu
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.03
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- us
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.30
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.15
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- service_tier
- flex
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
Provider specifications & access
1–4 / 4
- source model id
- gemini-2.5-flash
- hosting
- gateway
- context length
- 1048576
- max output tokens
- 65535
- capabilities
- structuredOutputs
- toolCalling
- visionInput
- webSearch
- source model id
- google/gemini-2.5-flash
- hosting
- third-party
- context length
- 1000000
- max output tokens
- 8192
- source model id
- google/gemini-2.5-flash
- hosting
- vercel-gateway
- context length
- 1000000
- max output tokens
- 65535
- capabilities
- promptCaching
- reasoning
- structuredOutputs
- toolCalling
- visionInput
- webSearch
- source model id
- publishers/google/models/gemini-2.5-flash@default
- hosting
- vertex-managed
- context length
- 1048576
- max output tokens
- 65536
- capabilities
- batch
- multimodal
- promptCaching
- reasoning
- structuredOutputs
- toolCalling
- visionInput
Safety assessments
1–1 / 1
41 / 100
- source id
- stanfordFMTI
- canonical model id
- google/gemini-2.5-flash
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Google
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 41 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–10 / 10
- field
- context_length
- value
- 1000000
- normalized value
- 1000000
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- context_length
- value
- 1048576
- normalized value
- 1048576
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 1000000
- normalized value
- 1000000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- context_length
- value
- 1048576
- normalized value
- 1048576
- scope
- source-model
- source id
- vertexAI
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2025-01-31
- normalized value
- 2025-01-31
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2025-01
- normalized value
- 2025-01
- precision
- month
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- max_output_tokens
- value
- 8192
- normalized value
- 8192
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- max_output_tokens
- value
- 65535
- normalized value
- 65535
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 65535
- normalized value
- 65535
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- max_output_tokens
- value
- 65536
- normalized value
- 65536
- scope
- source-model
- source id
- vertexAI
- confidence
- 1
Explore more models