Google: Gemini 2.5 Pro Preview 06-05
Gemini 2.5 Pro is Google’s state-of-the-art AI model designed for advanced reasoning, coding, mathematics, and scientific tasks. It employs “thinking” capabilities, enabling it to reason through resp…
google/gemini-2.5-pro-preview-06-05
Gemini 2.5 Pro is Google’s state-of-the-art AI model designed for advanced reasoning, coding, mathematics, and scientific tasks. It employs “thinking” capabilities, enabling it to reason through responses with enhanced accuracy...
Specifications & capabilities
- Input
- file, image, text, audio
- Output
- text
- Context window · tokens
- 1048576
- Knowledge cutoff
- 2025-01-31
- Capabilities
- audioInput, fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput
Evaluations
1–20 / 63
7.82%
- source id
- kaggleBenchmarks
- leaderboard name
- BrowseComp · Score
- dimension
- knowledge
- metric
- BrowseComp · Score
- rank
- 4
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 26
- name
- Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 49
- name
- BrowseComp
- type
- INDIVIDUAL
- owner
- openai
- version
- 1
- categories
- general knowledge and reasoning
- factuality and grounding
- version_id
- 35
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · openai · BrowseComp
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- BrowseComp · Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 35/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/openai/browsecomp/versions/1
- measurements
- name
- Score
- unit
- percent
- scale
- 1
- metric
- BrowseComp · Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.0781990521327014
- standardDeviation
- 0
- confidenceInterval
- 0.0147894000891353
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0147894000891353
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-13T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.0781990521327014
- standardDeviation
- 0
- confidenceInterval
- 0.0147894000891353
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0147894000891353
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 26
- sort_order
- DESCENDING
- source_name
- Score
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T14:25:30.827974100Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 42
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-13T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
- confidence lower
- 0.06340965204356609
- confidence upper
- 0.0929884522218367
Original result ↗0.154
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode Main With Background · SciCode Main with Background
- dimension
- coding
- metric
- SciCode Main With Background · SciCode Main with Background
- rank
- 13
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40201
- name
- SciCode Main with Background
- version
- 3
- sort_order
- DESCENDING
- display_type
- rawValues
- benchmark
- id
- 13
- name
- SciCode Main With Background
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 13
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode Main With Background
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode Main With Background · SciCode Main with Background
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 13/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode-main-with-background/versions/1
- measurements
- name
- SciCode Main with Background
- unit
- score
- scale
- 1
- metric
- SciCode Main With Background · SciCode Main with Background
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.1538461538461538
- standardDeviation
- 0
- confidenceInterval
- 0.087712078148839
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.087712078148839
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-06T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.1538461538461538
- standardDeviation
- 0
- confidenceInterval
- 0.087712078148839
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.087712078148839
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40201
- task_url
- /benchmarks/tasks/benchmarkler/scicode-background-scicode-main-with-background
- sort_order
- DESCENDING
- source_name
- SciCode Main with Background
- display_type
- rawValues
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 57
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-06T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
- confidence lower
- 0.0661340756973148
- confidence upper
- 0.2415582319949928
Original result ↗7.692%
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode Main Standard · SciCode Main Standard
- dimension
- coding
- metric
- SciCode Main Standard · SciCode Main Standard
- rank
- 17
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40105
- name
- SciCode Main Standard
- version
- 3
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 12
- name
- SciCode Main Standard
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 12
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode Main Standard
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode Main Standard · SciCode Main Standard
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 12/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode-main-standard/versions/1
- measurements
- name
- SciCode Main Standard
- unit
- percent
- scale
- 1
- metric
- SciCode Main Standard · SciCode Main Standard
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.0769230769230769
- standardDeviation
- 0
- confidenceInterval
- 0.0647796628574181
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0647796628574181
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-06T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.0769230769230769
- standardDeviation
- 0
- confidenceInterval
- 0.0647796628574181
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0647796628574181
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40105
- task_url
- /benchmarks/tasks/benchmarkler/scicode-standard-scicode-main-standard
- sort_order
- DESCENDING
- source_name
- SciCode Main Standard
- display_type
- percentages
- task_version
- 3
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 57
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-06T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
- confidence lower
- 0.012143414065658803
- confidence upper
- 0.141702739780495
Original result ↗86.686%
- source id
- kaggleBenchmarks
- leaderboard name
- MMLU-Pro · mmlu_pro_task
- dimension
- reasoning
- metric
- MMLU-Pro · mmlu_pro_task
- rank
- 18
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40138
- name
- mmlu_pro_task
- version
- 12
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 44
- name
- MMLU-Pro
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- version_id
- 30
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · MMLU-Pro
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MMLU-Pro · mmlu_pro_task
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 30/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/mmlu-pro/versions/1
- measurements
- name
- mmlu_pro_task
- unit
- percent
- scale
- 1
- metric
- MMLU-Pro · mmlu_pro_task
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.8668550531914894
- standardDeviation
- 0
- confidenceInterval
- 0.006070364455421
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.006070364455421
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-12T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.8668550531914894
- standardDeviation
- 0
- confidenceInterval
- 0.006070364455421
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.006070364455421
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40138
- task_url
- /benchmarks/tasks/benchmarkler/mmlu-pro-task
- sort_order
- DESCENDING
- source_name
- mmlu_pro_task
- display_type
- percentages
- task_version
- 12
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 64
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-12T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
- confidence lower
- 0.8607846887360684
- confidence upper
- 0.8729254176469103
Original result ↗15.385%
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode · SciCode Main With Background
- dimension
- coding
- metric
- SciCode · SciCode Main With Background
- rank
- 18
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40201
- name
- SciCode Main With Background
- version
- 3
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 16
- name
- SciCode
- type
- SUITE
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 16
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode · SciCode Main With Background
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 16/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode/versions/1
- measurements
- name
- SciCode Main With Background
- unit
- percent
- scale
- 1
- metric
- SciCode · SciCode Main With Background
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.1538461538461538
- standardDeviation
- 0
- confidenceInterval
- 0.087712078148839
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.087712078148839
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-06T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.1538461538461538
- standardDeviation
- 0
- confidenceInterval
- 0.087712078148839
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.087712078148839
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40201
- task_url
- /benchmarks/open-benchmarks/scicode-main-with-background/versions/1
- sort_order
- DESCENDING
- source_name
- SciCode Main With Background
- display_type
- percentages
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-10-21T20:29:26.251536900Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 62
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-06T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
- confidence lower
- 0.0661340756973148
- confidence upper
- 0.2415582319949928
Original result ↗92.359%
- source id
- kaggleBenchmarks
- leaderboard name
- MMLU · mmlu_task
- dimension
- reasoning
- metric
- MMLU · mmlu_task
- rank
- 19
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40139
- name
- mmlu_task
- version
- 7
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 42
- name
- MMLU
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- version_id
- 28
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · MMLU
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MMLU · mmlu_task
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 28/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/mmlu/versions/1
- measurements
- name
- mmlu_task
- unit
- percent
- scale
- 1
- metric
- MMLU · mmlu_task
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.9235863837060247
- standardDeviation
- 0
- confidenceInterval
- 0.0043939766436499
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0043939766436499
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-14T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.9235863837060247
- standardDeviation
- 0
- confidenceInterval
- 0.0043939766436499
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0043939766436499
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40139
- task_url
- /benchmarks/tasks/benchmarkler/mmlu-task
- sort_order
- DESCENDING
- source_name
- mmlu_task
- display_type
- percentages
- task_version
- 7
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 61
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-14T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
- confidence lower
- 0.9191924070623748
- confidence upper
- 0.9279803603496747
Original result ↗7.692%
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode · SciCode Main Standard
- dimension
- coding
- metric
- SciCode · SciCode Main Standard
- rank
- 21
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40105
- name
- SciCode Main Standard
- version
- 3
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 16
- name
- SciCode
- type
- SUITE
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 16
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode · SciCode Main Standard
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 16/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode/versions/1
- measurements
- name
- SciCode Main Standard
- unit
- percent
- scale
- 1
- metric
- SciCode · SciCode Main Standard
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.0769230769230769
- standardDeviation
- 0
- confidenceInterval
- 0.0647796628574181
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0647796628574181
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-06T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.0769230769230769
- standardDeviation
- 0
- confidenceInterval
- 0.0647796628574181
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0647796628574181
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40105
- task_url
- /benchmarks/open-benchmarks/scicode-main-standard/versions/1
- sort_order
- DESCENDING
- source_name
- SciCode Main Standard
- display_type
- percentages
- task_version
- 3
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-10-21T20:29:26.251536900Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 62
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-06T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
- confidence lower
- 0.012143414065658803
- confidence upper
- 0.141702739780495
Original result ↗0.412
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode Subproblem With Background · SciCode Subproblem with Background
- dimension
- coding
- metric
- SciCode Subproblem With Background · SciCode Subproblem with Background
- rank
- 22
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40200
- name
- SciCode Subproblem with Background
- version
- 3
- sort_order
- DESCENDING
- display_type
- rawValues
- benchmark
- id
- 15
- name
- SciCode Subproblem With Background
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 15
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode Subproblem With Background
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode Subproblem With Background · SciCode Subproblem with Background
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 15/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode-subproblem-with-background/versions/1
- measurements
- name
- SciCode Subproblem with Background
- unit
- score
- scale
- 1
- metric
- SciCode Subproblem With Background · SciCode Subproblem with Background
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.4123711340206185
- standardDeviation
- 0
- confidenceInterval
- 0.0565584222309132
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0565584222309132
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-06T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.4123711340206185
- standardDeviation
- 0
- confidenceInterval
- 0.0565584222309132
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0565584222309132
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40200
- task_url
- /benchmarks/tasks/benchmarkler/scicode-background-scicode-subproblem-with-background
- sort_order
- DESCENDING
- source_name
- SciCode Subproblem with Background
- display_type
- rawValues
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 57
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-06T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
- confidence lower
- 0.3558127117897053
- confidence upper
- 0.46892955625153165
Original result ↗0.309
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode Subproblem Standard · SciCode Subproblem Standard
- dimension
- coding
- metric
- SciCode Subproblem Standard · SciCode Subproblem Standard
- rank
- 22
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40106
- name
- SciCode Subproblem Standard
- version
- 3
- sort_order
- DESCENDING
- display_type
- rawValues
- benchmark
- id
- 14
- name
- SciCode Subproblem Standard
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 14
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode Subproblem Standard
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode Subproblem Standard · SciCode Subproblem Standard
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 14/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode-subproblem-standard/versions/1
- measurements
- name
- SciCode Subproblem Standard
- unit
- score
- scale
- 1
- metric
- SciCode Subproblem Standard · SciCode Subproblem Standard
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.3092783505154639
- standardDeviation
- 0
- confidenceInterval
- 0.0531040802020165
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0531040802020165
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-06T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.3092783505154639
- standardDeviation
- 0
- confidenceInterval
- 0.0531040802020165
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0531040802020165
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40106
- task_url
- /benchmarks/tasks/benchmarkler/scicode-standard-scicode-subproblem-standard
- sort_order
- DESCENDING
- source_name
- SciCode Subproblem Standard
- display_type
- rawValues
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 57
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-06T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
- confidence lower
- 0.25617427031344736
- confidence upper
- 0.3623824307174804
Original result ↗30.928%
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode · SciCode Subproblem Standard
- dimension
- coding
- metric
- SciCode · SciCode Subproblem Standard
- rank
- 25
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40106
- name
- SciCode Subproblem Standard
- version
- 3
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 16
- name
- SciCode
- type
- SUITE
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 16
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode · SciCode Subproblem Standard
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 16/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode/versions/1
- measurements
- name
- SciCode Subproblem Standard
- unit
- percent
- scale
- 1
- metric
- SciCode · SciCode Subproblem Standard
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.3092783505154639
- standardDeviation
- 0
- confidenceInterval
- 0.0531040802020165
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0531040802020165
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-06T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.3092783505154639
- standardDeviation
- 0
- confidenceInterval
- 0.0531040802020165
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0531040802020165
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40106
- task_url
- /benchmarks/open-benchmarks/scicode-subproblem-standard/versions/1
- sort_order
- DESCENDING
- source_name
- SciCode Subproblem Standard
- display_type
- percentages
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-10-21T20:29:26.251536900Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 62
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-06T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
- confidence lower
- 0.25617427031344736
- confidence upper
- 0.3623824307174804
Original result ↗41.237%
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode · SciCode Subproblem With Background
- dimension
- coding
- metric
- SciCode · SciCode Subproblem With Background
- rank
- 26
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40200
- name
- SciCode Subproblem With Background
- version
- 3
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 16
- name
- SciCode
- type
- SUITE
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 16
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode · SciCode Subproblem With Background
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 16/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode/versions/1
- measurements
- name
- SciCode Subproblem With Background
- unit
- percent
- scale
- 1
- metric
- SciCode · SciCode Subproblem With Background
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.4123711340206185
- standardDeviation
- 0
- confidenceInterval
- 0.0565584222309132
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0565584222309132
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-06T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.4123711340206185
- standardDeviation
- 0
- confidenceInterval
- 0.0565584222309132
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0565584222309132
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40200
- task_url
- /benchmarks/open-benchmarks/scicode-subproblem-with-background/versions/1
- sort_order
- DESCENDING
- source_name
- SciCode Subproblem With Background
- display_type
- percentages
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-10-21T20:29:26.251536900Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 62
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-06T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
- confidence lower
- 0.3558127117897053
- confidence upper
- 0.46892955625153165
Original result ↗78.333%
- source id
- kaggleBenchmarks
- leaderboard name
- AIME 2025 · aime_task
- dimension
- math
- metric
- AIME 2025 · aime_task
- rank
- 31
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40087
- name
- aime_task
- version
- 6
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 125
- name
- AIME 2025
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- math
- version_id
- 111
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · AIME 2025
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AIME 2025 · aime_task
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 111/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/aime-2025/versions/1
- measurements
- name
- aime_task
- unit
- percent
- scale
- 1
- metric
- AIME 2025 · aime_task
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.7833333333333333
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-07-07T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.7833333333333333
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40087
- task_url
- /benchmarks/tasks/benchmarkler/aime-task
- sort_order
- DESCENDING
- source_name
- aime_task
- display_type
- percentages
- task_version
- 6
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 68
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-07-07T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
Original result ↗98.077%
- source id
- kaggleBenchmarks
- leaderboard name
- MathVista testmini · Geometry Problem Solving Score
- dimension
- math
- metric
- MathVista testmini · Geometry Problem Solving Score
- rank
- 3
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 265
- name
- Geometry Problem Solving Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 129
- name
- MathVista testmini
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- math
- multimodal capabilities
- version_id
- 115
- maintainer_tier
- Community-published
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · MathVista testmini
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MathVista testmini · Geometry Problem Solving Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 115/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/mathvista-testmini/versions/1
- measurements
- name
- Geometry Problem Solving Score
- unit
- percent
- scale
- 1
- metric
- MathVista testmini · Geometry Problem Solving Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.9807692307692308
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-07-04T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.9807692307692308
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 265
- sort_order
- DESCENDING
- source_name
- Geometry Problem Solving Score
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 29
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-07-04T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
Original result ↗96.234%
- source id
- kaggleBenchmarks
- leaderboard name
- MathVista testmini · Geometry Score
- dimension
- math
- metric
- MathVista testmini · Geometry Score
- rank
- 3
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 259
- name
- Geometry Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 129
- name
- MathVista testmini
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- math
- multimodal capabilities
- version_id
- 115
- maintainer_tier
- Community-published
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · MathVista testmini
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MathVista testmini · Geometry Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 115/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/mathvista-testmini/versions/1
- measurements
- name
- Geometry Score
- unit
- percent
- scale
- 1
- metric
- MathVista testmini · Geometry Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.9623430962343096
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-07-04T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.9623430962343096
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 259
- sort_order
- DESCENDING
- source_name
- Geometry Score
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 29
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-07-04T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
Original result ↗95.018%
- source id
- kaggleBenchmarks
- leaderboard name
- MathVista testmini · Algebraic Score
- dimension
- math
- metric
- MathVista testmini · Algebraic Score
- rank
- 3
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 257
- name
- Algebraic Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 129
- name
- MathVista testmini
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- math
- multimodal capabilities
- version_id
- 115
- maintainer_tier
- Community-published
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · MathVista testmini
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MathVista testmini · Algebraic Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 115/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/mathvista-testmini/versions/1
- measurements
- name
- Algebraic Score
- unit
- percent
- scale
- 1
- metric
- MathVista testmini · Algebraic Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.9501779359430604
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-07-04T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.9501779359430604
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 257
- sort_order
- DESCENDING
- source_name
- Algebraic Score
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 29
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-07-04T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
Original result ↗94.8%
- source id
- kaggleBenchmarks
- leaderboard name
- MGSM German · Score
- dimension
- math
- metric
- MGSM German · Score
- rank
- 3
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 122
- name
- Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 115
- name
- MGSM German
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- math
- version_id
- 101
- maintainer_tier
- Community-published
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · MGSM German
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MGSM German · Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 101/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/mgsm-german/versions/1
- measurements
- name
- Score
- unit
- percent
- scale
- 1
- metric
- MGSM German · Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.948
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-30T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.948
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 122
- sort_order
- DESCENDING
- source_name
- Score
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 46
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-30T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
Original result ↗94.8%
- source id
- kaggleBenchmarks
- leaderboard name
- MGSM: Multilingual Grade School Math Benchmark · MGSM German
- dimension
- math
- metric
- MGSM: Multilingual Grade School Math Benchmark · MGSM German
- rank
- 3
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 122
- name
- MGSM German
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 113
- name
- MGSM: Multilingual Grade School Math Benchmark
- type
- SUITE
- owner
- open-benchmarks
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- math
- version_id
- 99
- maintainer_tier
- Community-published
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · MGSM: Multilingual Grade School Math Benchmark
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MGSM: Multilingual Grade School Math Benchmark · MGSM German
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 99/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/mgsm/versions/1
- measurements
- name
- MGSM German
- unit
- percent
- scale
- 1
- metric
- MGSM: Multilingual Grade School Math Benchmark · MGSM German
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.948
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-30T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.948
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 122
- task_url
- /benchmarks/open-benchmarks/mgsm-german/versions/1
- sort_order
- DESCENDING
- source_name
- MGSM German
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 46
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-30T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
Original result ↗86.022%
- source id
- kaggleBenchmarks
- leaderboard name
- MathVista testmini · Math Word Problem Score
- dimension
- math
- metric
- MathVista testmini · Math Word Problem Score
- rank
- 3
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 266
- name
- Math Word Problem Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 129
- name
- MathVista testmini
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- math
- multimodal capabilities
- version_id
- 115
- maintainer_tier
- Community-published
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · MathVista testmini
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MathVista testmini · Math Word Problem Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 115/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/mathvista-testmini/versions/1
- measurements
- name
- Math Word Problem Score
- unit
- percent
- scale
- 1
- metric
- MathVista testmini · Math Word Problem Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.8602150537634409
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-07-04T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.8602150537634409
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 266
- sort_order
- DESCENDING
- source_name
- Math Word Problem Score
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 29
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-07-04T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
Original result ↗85.443%
- source id
- kaggleBenchmarks
- leaderboard name
- MathVista testmini · Textbook QA Score
- dimension
- math
- metric
- MathVista testmini · Textbook QA Score
- rank
- 3
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 267
- name
- Textbook QA Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 129
- name
- MathVista testmini
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- math
- multimodal capabilities
- version_id
- 115
- maintainer_tier
- Community-published
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · MathVista testmini
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MathVista testmini · Textbook QA Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 115/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/mathvista-testmini/versions/1
- measurements
- name
- Textbook QA Score
- unit
- percent
- scale
- 1
- metric
- MathVista testmini · Textbook QA Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.8544303797468354
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-07-04T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.8544303797468354
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 267
- sort_order
- DESCENDING
- source_name
- Textbook QA Score
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 29
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-07-04T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
Original result ↗84.6%
- source id
- kaggleBenchmarks
- leaderboard name
- MathVista testmini · Score
- dimension
- math
- metric
- MathVista testmini · Score
- rank
- 3
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 143
- name
- Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 129
- name
- MathVista testmini
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- math
- multimodal capabilities
- version_id
- 115
- maintainer_tier
- Community-published
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · MathVista testmini
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MathVista testmini · Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 115/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/mathvista-testmini/versions/1
- measurements
- name
- Score
- unit
- percent
- scale
- 1
- metric
- MathVista testmini · Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.846
- standardDeviation
- 0
- confidenceInterval
- 0.0223714242057879
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0223714242057879
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-07-04T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.846
- standardDeviation
- 0
- confidenceInterval
- 0.0223714242057879
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0223714242057879
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 143
- sort_order
- DESCENDING
- source_name
- Score
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- google/gemini-2.5-pro-preview-06-05
- metric_population
- 29
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-07-04T00:00:00.000Z
- source model id
- Gemini 2.5 Pro Preview
- confidence lower
- 0.8236285757942121
- confidence upper
- 0.8683714242057878
Original result ↗Published prices
1–6 / 6
$0.13
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
$0.38
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_write_tokens_per_million
- Currency
- USD
$0.000001
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- image
- Currency
- USD
$1.25
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
$10.00
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
$0.01
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- web_search
- Currency
- USD
Safety assessments
1–1 / 1
41 / 100
- source id
- stanfordFMTI
- canonical model id
- google/gemini-2.5-pro-preview-06-05
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Google
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 41 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–3 / 3
- field
- context_length
- value
- 1048576
- normalized value
- 1048576
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2025-01-31
- normalized value
- 2025-01-31
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 65536
- normalized value
- 65536
- scope
- source-model
- source id
- openRouter
- confidence
- 1
Explore more models