OpenAI: o4 Mini (batch)
OpenAI o4-mini is a compact reasoning model in the o-series, optimized for fast, cost-efficient performance while retaining strong multimodal and agentic capabilities. It supports tool use and demons…
openai/o4-mini-2025-04-16
OpenAI o4-mini is a compact reasoning model in the o-series, optimized for fast, cost-efficient performance while retaining strong multimodal and agentic capabilities. It supports tool use and demonstrates competitive reasoning and coding performance across benchmarks like AIME (99.5% with Python) and SWE-bench, outperforming its predecessor o3-mini and even approaching o3 in some domains.
Despite its smaller size, o4-mini exhibits high accuracy in STEM tasks, visual problem solving (e.g., MathVista, MMMU), and code editing. It is especially well-suited for high-throughput scenarios where latency or cost is critical. Thanks to its efficient architecture and refined reinforcement learning training, o4-mini can chain tools, generate structured outputs, and solve multi-step tasks with minimal delay—often in under a minute.
Specifications & capabilities
- Input
- image, text, file
- Output
- text
- Context window · tokens
- 200000
- Published model ID
- o4-mini-2025-04-16
- Capabilities
- fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput, webSearch
Description source ↗Evaluations
81–100 / 912
100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-054
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-054
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071454
- name
- gpqa-main-zero-shot/task-054
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-054
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-054
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-054
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T18:29:49.8982357Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071454
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-054
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T18:29:49.898Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-178
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-178
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984228
- name
- gpqa-diamond-zero-shot/task-178
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-178
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-178
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-178
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:15:44.8781869Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984228
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-178
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:15:44.878Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-023
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-023
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071414
- name
- gpqa-main-zero-shot/task-023
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-023
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-023
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-023
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T17:57:27.5438607Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071414
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-023
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T17:57:27.543Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-191
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-191
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071608
- name
- gpqa-main-zero-shot/task-191
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-191
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-191
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-191
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:46:47.1819347Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071608
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-191
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 25
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:46:47.181Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-323
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-323
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071750
- name
- gpqa-main-zero-shot/task-323
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-323
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-323
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-323
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T20:44:05.5392427Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071750
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-323
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T20:44:05.539Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-169
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-169
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071582
- name
- gpqa-main-zero-shot/task-169
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-169
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-169
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-169
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:34:14.0060263Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071582
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-169
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:34:14.006Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-266
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-266
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071690
- name
- gpqa-main-zero-shot/task-266
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-266
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-266
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-266
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T20:19:47.6148581Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071690
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-266
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T20:19:47.614Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-187
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-187
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071601
- name
- gpqa-main-zero-shot/task-187
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-187
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-187
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-187
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:43:47.2669066Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071601
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-187
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:43:47.266Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-109
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-109
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071512
- name
- gpqa-main-zero-shot/task-109
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-109
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-109
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-109
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:04:19.7597131Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071512
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-109
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:04:19.759Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-060
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-060
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984109
- name
- gpqa-diamond-zero-shot/task-060
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-060
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-060
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-060
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:12:00.0315108Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984109
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-060
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:12:00.031Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-355
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-355
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071785
- name
- gpqa-main-zero-shot/task-355
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-355
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-355
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-355
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T20:57:54.4946235Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071785
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-355
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T20:57:54.494Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-030
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-030
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071423
- name
- gpqa-main-zero-shot/task-030
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-030
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-030
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-030
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T18:09:45.6680717Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071423
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-030
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T18:09:45.668Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-124
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-124
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071535
- name
- gpqa-main-zero-shot/task-124
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-124
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-124
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-124
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T19:12:15.218421Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071535
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-124
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T19:12:15.218Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-071
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-071
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071472
- name
- gpqa-main-zero-shot/task-071
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-071
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-071
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-071
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T18:41:53.2810613Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071472
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-071
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T18:41:53.281Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-018
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-018
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071409
- name
- gpqa-main-zero-shot/task-018
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-018
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-018
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-018
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T17:51:43.7531421Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071409
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-018
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T17:51:43.753Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-049
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-049
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071449
- name
- gpqa-main-zero-shot/task-049
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-049
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-049
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-049
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T18:25:40.7226322Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071449
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-049
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T18:25:40.722Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-337
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-337
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071766
- name
- gpqa-main-zero-shot/task-337
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-337
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-337
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-337
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T20:50:03.1595656Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071766
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-337
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T20:50:03.159Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-407
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-407
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071846
- name
- gpqa-main-zero-shot/task-407
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-407
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-407
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-407
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T21:20:21.7376912Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071846
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-407
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T21:20:21.737Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-044
- dimension
- reasoning
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-044
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 984092
- name
- gpqa-diamond-zero-shot/task-044
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 7
- name
- GPQA Diamond Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8176
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Diamond Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-044
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8176/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-diamond-set/versions/2
- measurements
- name
- gpqa-diamond-zero-shot/task-044
- unit
- percent
- scale
- 1
- metric
- GPQA Diamond Zero‑Shot · gpqa-diamond-zero-shot/task-044
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-12T18:09:44.9719577Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 984092
- sort_order
- DESCENDING
- source_name
- gpqa-diamond-zero-shot/task-044
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-12T17:49:58.132967500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 32
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-12T18:09:44.971Z
- source model id
- o4 mini
Original result ↗100%
- source id
- kaggleBenchmarks
- leaderboard name
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-078
- dimension
- reasoning
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-078
- rank
- 1
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1071480
- name
- gpqa-main-zero-shot/task-078
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 8
- name
- GPQA Main Zero‑Shot
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 2
- categories
- general knowledge and reasoning
- science
- version_id
- 8463
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · GPQA Main Zero‑Shot
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-078
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 8463/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/gpqa-zero-shot-main-set/versions/2
- measurements
- name
- gpqa-main-zero-shot/task-078
- unit
- percent
- scale
- 1
- metric
- GPQA Main Zero‑Shot · gpqa-main-zero-shot/task-078
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2026-10-20T18:45:47.0505132Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1071480
- sort_order
- DESCENDING
- source_name
- gpqa-main-zero-shot/task-078
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2026-10-21T18:15:21.342276500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o4-mini-2025-04-16
- metric_population
- 26
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-20T18:45:47.050Z
- source model id
- o4 mini
Original result ↗Published prices
1–15 / 15
$0.28
- Inference provider
- cloudflareWorkersAI
- Platform
- OpenAI
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing label
- Cached input tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$1.10
- Inference provider
- cloudflareWorkersAI
- Platform
- OpenAI
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing label
- Input tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$4.40
- Inference provider
- cloudflareWorkersAI
- Platform
- OpenAI
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing label
- Output tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$0.14
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.55
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$2.20
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.01
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- web_search
- Currency
- USD
- Billing conditions
- mode
- batch
$0.28
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | openai/o4-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$1.10
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | openai/o4-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$4.40
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | openai/o4-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.01
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- request
- Currency
- USD
- Billing conditions
- charge
- web_search
- endpoint
- azure | openai/o4-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Web search
- Pricing via
- Vercel AI Gateway
$0.28
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$1.10
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$4.40
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.01
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- request
- Currency
- USD
- Billing conditions
- charge
- web_search
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- Billing label
- Web search
- Pricing via
- Vercel AI Gateway
Provider specifications & access
1–3 / 3
- source model id
- azure-openai/o4-mini@2025-04-16
- hosting
- foundry-managed-compute
- license
- custom
- context length
- 200000
- max output tokens
- 100000
- source model id
- openai/o4-mini
- hosting
- third-party
- context length
- 200000
- max output tokens
- 100000
- source model id
- openai/o4-mini
- hosting
- vercel-gateway
- context length
- 200000
- max output tokens
- 100000
- capabilities
- promptCaching
- reasoning
- structuredOutputs
- toolCalling
- visionInput
- webSearch
Safety assessments
1–1 / 1
35 / 100
- source id
- stanfordFMTI
- canonical model id
- openai/o4-mini-2025-04-16
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- OpenAI
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 35 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–11 / 11
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-06-30
- normalized value
- 2024-06-30
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-06-01
- normalized value
- 2024-06-01
- precision
- day
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- training_data_cutoff
- value
- May 2024
- normalized value
- 2024-05
- precision
- month
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
Explore more models