OpenAI: o4 Mini (batch)
OpenAI o4-mini is a compact reasoning model in the o-series, optimized for fast, cost-efficient performance while retaining strong multimodal and agentic capabilities. It supports tool use and demons…
openai/o4-mini-2025-04-16
OpenAI o4-mini is a compact reasoning model in the o-series, optimized for fast, cost-efficient performance while retaining strong multimodal and agentic capabilities. It supports tool use and demonstrates competitive reasoning and coding performance across benchmarks like AIME (99.5% with Python) and SWE-bench, outperforming its predecessor o3-mini and even approaching o3 in some domains.
Despite its smaller size, o4-mini exhibits high accuracy in STEM tasks, visual problem solving (e.g., MathVista, MMMU), and code editing. It is especially well-suited for high-throughput scenarios where latency or cost is critical. Thanks to its efficient architecture and refined reinforcement learning training, o4-mini can chain tools, generate structured outputs, and solve multi-step tasks with minimal delay—often in under a minute.
Specifications & capabilities
- Input
- image, text, file
- Output
- text
- Context window · tokens
- 200000
- Published model ID
- o4-mini-2025-04-16
- Capabilities
- fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput, webSearch
Description source ↗Evaluations
101–120 / 912
100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-115
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-115
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071518
- name
- gpqa-main-zero-shot/task-115
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-115
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-115
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-115
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:08:27.9329642Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071518
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-115
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:08:27.932Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-107
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-107
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984156
- name
- gpqa-diamond-zero-shot/task-107
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-107
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-107
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-107
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:13:19.5907698Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984156
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-107
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:13:19.590Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-053
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-053
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071453
- name
- gpqa-main-zero-shot/task-053
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-053
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-053
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-053
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T18:27:54.9499731Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071453
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-053
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T18:27:54.949Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-164
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-164
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071577
- name
- gpqa-main-zero-shot/task-164
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-164
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-164
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-164
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:32:19.8944852Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071577
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-164
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:32:19.894Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-415
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-415
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071854
- name
- gpqa-main-zero-shot/task-415
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-415
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-415
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-415
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T21:23:52.6052712Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071854
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-415
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T21:23:52.605Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-066
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-066
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984115
- name
- gpqa-diamond-zero-shot/task-066
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-066
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-066
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-066
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:12:11.405172Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984115
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-066
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:12:11.405Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-259
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-259
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071681
- name
- gpqa-main-zero-shot/task-259
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-259
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-259
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-259
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T20:13:53.8310744Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071681
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-259
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T20:13:53.831Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-021
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-021
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071412
- name
- gpqa-main-zero-shot/task-021
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-021
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-021
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-021
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T17:55:37.7966292Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071412
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-021
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T17:55:37.796Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-417
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-417
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071856
- name
- gpqa-main-zero-shot/task-417
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-417
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-417
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-417
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T21:23:51.7605873Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071856
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-417
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T21:23:51.760Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-086
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-086
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984135
- name
- gpqa-diamond-zero-shot/task-086
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-086
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-086
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-086
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:12:22.8979274Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984135
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-086
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:12:22.897Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-025
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-025
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984073
- name
- gpqa-diamond-zero-shot/task-025
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-025
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-025
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-025
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:09:34.4067793Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984073
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-025
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:09:34.406Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-348
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-348
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071777
- name
- gpqa-main-zero-shot/task-348
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-348
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-348
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-348
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T20:55:46.7791501Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071777
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-348
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T20:55:46.779Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-034
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-034
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984082
- name
- gpqa-diamond-zero-shot/task-034
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-034
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-034
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-034
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:09:33.1103792Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984082
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-034
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:09:33.110Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-019
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-019
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984067
- name
- gpqa-diamond-zero-shot/task-019
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-019
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-019
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-019
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:09:20.0261688Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984067
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-019
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:09:20.026Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-198
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-198
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071616
- name
- gpqa-main-zero-shot/task-198
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-198
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-198
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-198
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:48:09.3471673Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071616
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-198
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:48:09.347Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-096
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-096
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984145
- name
- gpqa-diamond-zero-shot/task-096
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-096
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-096
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-096
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:12:13.6750366Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984145
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-096
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:12:13.675Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-006
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-006
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071397
- name
- gpqa-main-zero-shot/task-006
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-006
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-006
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-006
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T17:26:39.8816348Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071397
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-006
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T17:26:39.881Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-264
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-264
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071688
- name
- gpqa-main-zero-shot/task-264
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-264
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-264
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-264
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T20:17:34.0661118Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071688
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-264
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T20:17:34.066Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-092
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-092
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071495
- name
- gpqa-main-zero-shot/task-092
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-092
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-092
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-092
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T18:56:17.838764Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071495
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-092
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T18:56:17.838Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-136
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-136
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984186
- name
- gpqa-diamond-zero-shot/task-136
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-136
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-136
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-136
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:13:28.5048892Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984186
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-136
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:13:28.504Z
- source model id
- o4 mini
Original result ↗Published prices
1–15 / 15
$0.28
- Inference provider
- cloudflareWorkersAI
- Platform
- OpenAI
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing label
- Cached input tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$1.10
- Inference provider
- cloudflareWorkersAI
- Platform
- OpenAI
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing label
- Input tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$4.40
- Inference provider
- cloudflareWorkersAI
- Platform
- OpenAI
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing label
- Output tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$0.14
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.55
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$2.20
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.01
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- web_search
- Currency
- USD
- Billing conditions
- mode
- batch
$0.28
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | openai/o4-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$1.10
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | openai/o4-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$4.40
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | openai/o4-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.01
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- request
- Currency
- USD
- Billing conditions
- charge
- web_search
- endpoint
- azure | openai/o4-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Web search
- Pricing via
- Vercel AI Gateway
$0.28
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$1.10
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$4.40
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.01
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- request
- Currency
- USD
- Billing conditions
- charge
- web_search
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Web search
- Pricing via
- Vercel AI Gateway
Provider specifications & access
1–3 / 3
- source model id
- azure-openai/o4-mini@2025-04-16
- hosting
- foundry-managed-compute
- license
- custom
- context length
- 200000
- max output tokens
- 100000
- source model id
- openai/o4-mini
- hosting
- third-party
- context length
- 200000
- max output tokens
- 100000
- source model id
- openai/o4-mini
- hosting
- vercel-gateway
- context length
- 200000
- max output tokens
- 100000
- capabilities
- promptCaching
- reasoning
- structuredOutputs
- toolCalling
- visionInput
- webSearch
Safety assessments
1–1 / 1
35 / 100
- source id
- stanfordFMTI
- canonical model id
- openai/o4-mini-2025-04-16
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- OpenAI
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 35 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–11 / 11
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-06-30
- normalized value
- 2024-06-30
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-06-01
- normalized value
- 2024-06-01
- precision
- day
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- training_data_cutoff
- value
- May 2024
- normalized value
- 2024-05
- precision
- month
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
Explore more models