OpenAI: o4 Mini (batch)
OpenAI o4-mini is a compact reasoning model in the o-series, optimized for fast, cost-efficient performance while retaining strong multimodal and agentic capabilities. It supports tool use and demons…
openai/o4-mini-2025-04-16
OpenAI o4-mini is a compact reasoning model in the o-series, optimized for fast, cost-efficient performance while retaining strong multimodal and agentic capabilities. It supports tool use and demonstrates competitive reasoning and coding performance across benchmarks like AIME (99.5% with Python) and SWE-bench, outperforming its predecessor o3-mini and even approaching o3 in some domains.
Despite its smaller size, o4-mini exhibits high accuracy in STEM tasks, visual problem solving (e.g., MathVista, MMMU), and code editing. It is especially well-suited for high-throughput scenarios where latency or cost is critical. Thanks to its efficient architecture and refined reinforcement learning training, o4-mini can chain tools, generate structured outputs, and solve multi-step tasks with minimal delay—often in under a minute.
Specifications & capabilities
- Input
- image, text, file
- Output
- text
- Context window · tokens
- 200000
- Published model ID
- o4-mini-2025-04-16
- Capabilities
- fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput, webSearch
Description source ↗Evaluations
61–80 / 912
100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-302
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-302
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071728
- name
- gpqa-main-zero-shot/task-302
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-302
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-302
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-302
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T20:31:59.4175762Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071728
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-302
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T20:31:59.417Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-027
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-027
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984075
- name
- gpqa-diamond-zero-shot/task-027
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-027
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-027
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-027
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:09:32.6017947Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984075
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-027
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:09:32.601Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-171
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-171
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984221
- name
- gpqa-diamond-zero-shot/task-171
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-171
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-171
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-171
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:15:30.2421153Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984221
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-171
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:15:30.242Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-111
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-111
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071514
- name
- gpqa-main-zero-shot/task-111
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-111
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-111
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-111
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:06:10.8758589Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071514
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-111
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:06:10.875Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-367
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-367
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071799
- name
- gpqa-main-zero-shot/task-367
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-367
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-367
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-367
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T21:03:57.0610461Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071799
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-367
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T21:03:57.061Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-152
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-152
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984202
- name
- gpqa-diamond-zero-shot/task-152
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-152
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-152
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-152
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:16:06.1861226Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984202
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-152
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:16:06.186Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-238
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-238
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071659
- name
- gpqa-main-zero-shot/task-238
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-238
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-238
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-238
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T20:06:29.0911523Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071659
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-238
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T20:06:29.091Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-201
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-201
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071619
- name
- gpqa-main-zero-shot/task-201
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-201
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-201
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-201
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:49:44.935733Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071619
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-201
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:49:44.935Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-247
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-247
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071668
- name
- gpqa-main-zero-shot/task-247
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-247
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-247
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-247
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T20:09:44.144197Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071668
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-247
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T20:09:44.144Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-113
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-113
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071516
- name
- gpqa-main-zero-shot/task-113
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-113
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-113
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-113
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:06:07.2444857Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071516
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-113
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:06:07.244Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-410
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-410
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071849
- name
- gpqa-main-zero-shot/task-410
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-410
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-410
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-410
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T21:21:38.479313Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071849
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-410
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T21:21:38.479Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-195
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-195
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984245
- name
- gpqa-diamond-zero-shot/task-195
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-195
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-195
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-195
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:15:36.8130801Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984245
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-195
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:15:36.813Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-414
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-414
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071853
- name
- gpqa-main-zero-shot/task-414
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-414
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-414
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-414
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T21:23:41.4135638Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071853
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-414
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T21:23:41.413Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-045
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-045
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071442
- name
- gpqa-main-zero-shot/task-045
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-045
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-045
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-045
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T18:21:28.5102477Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071442
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-045
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T18:21:28.510Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-155
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-155
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071568
- name
- gpqa-main-zero-shot/task-155
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-155
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-155
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-155
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:28:43.1300063Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071568
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-155
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:28:43.130Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-186
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-186
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071600
- name
- gpqa-main-zero-shot/task-186
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-186
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-186
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-186
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:43:50.7248979Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071600
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-186
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:43:50.724Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-145
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-145
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071557
- name
- gpqa-main-zero-shot/task-145
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-145
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-145
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-145
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:22:21.406295Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071557
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-145
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:22:21.406Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-039
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-039
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071433
- name
- gpqa-main-zero-shot/task-039
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-039
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-039
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-039
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T18:17:38.6208932Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071433
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-039
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T18:17:38.620Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-067
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-067
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984116
- name
- gpqa-diamond-zero-shot/task-067
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-067
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-067
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-067
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:12:24.565343Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984116
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-067
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:12:24.565Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-172
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-172
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984222
- name
- gpqa-diamond-zero-shot/task-172
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-172
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-172
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-172
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:15:30.4165364Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984222
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-172
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:15:30.416Z
- source model id
- o4 mini
Original result ↗Published prices
1–15 / 15
$0.28
- Inference provider
- cloudflareWorkersAI
- Platform
- OpenAI
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing label
- Cached input tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$1.10
- Inference provider
- cloudflareWorkersAI
- Platform
- OpenAI
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing label
- Input tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$4.40
- Inference provider
- cloudflareWorkersAI
- Platform
- OpenAI
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing label
- Output tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$0.14
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.55
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$2.20
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.01
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- web_search
- Currency
- USD
- Billing conditions
- mode
- batch
$0.28
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | openai/o4-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$1.10
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | openai/o4-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$4.40
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | openai/o4-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.01
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- request
- Currency
- USD
- Billing conditions
- charge
- web_search
- endpoint
- azure | openai/o4-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Web search
- Pricing via
- Vercel AI Gateway
$0.28
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$1.10
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$4.40
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.01
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- request
- Currency
- USD
- Billing conditions
- charge
- web_search
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Web search
- Pricing via
- Vercel AI Gateway
Provider specifications & access
1–3 / 3
- source model id
- azure-openai/o4-mini@2025-04-16
- hosting
- foundry-managed-compute
- license
- custom
- context length
- 200000
- max output tokens
- 100000
- source model id
- openai/o4-mini
- hosting
- third-party
- context length
- 200000
- max output tokens
- 100000
- source model id
- openai/o4-mini
- hosting
- vercel-gateway
- context length
- 200000
- max output tokens
- 100000
- capabilities
- promptCaching
- reasoning
- structuredOutputs
- toolCalling
- visionInput
- webSearch
Safety assessments
1–1 / 1
35 / 100
- source id
- stanfordFMTI
- canonical model id
- openai/o4-mini-2025-04-16
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- OpenAI
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 35 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–11 / 11
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-06-30
- normalized value
- 2024-06-30
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-06-01
- normalized value
- 2024-06-01
- precision
- day
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- training_data_cutoff
- value
- May 2024
- normalized value
- 2024-05
- precision
- month
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
Explore more models