OpenAI: o3
o3 is a well-rounded and powerful model across domains. It sets a new standard for math, science, coding, and visual reasoning tasks. It also excels at technical writing and instruction-following. Us…
openai/o3-2025-04-16
o3 is a well-rounded and powerful model across domains. It sets a new standard for math, science, coding, and visual reasoning tasks. It also excels at technical writing and instruction-following. Use it to think through multi-step problems that involve analysis across text, code, and images.
Specifications & capabilities
- Input
- image, text, file
- Output
- text
- Context window · tokens
- 200000
- Capabilities
- fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput
Description source ↗Evaluations
81–100 / 328
993.64
- source id
- kaggleBenchmarks
- leaderboard name
- Checkers · Score
- dimension
- general
- metric
- Checkers · Score
- rank
- 15
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 33515
- name
- Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 5687
- name
- Checkers
- type
- GAME
- owner
- kaggle
- version
- 1
- version_id
- 5710
- maintainer_tier
- Kaggle-published
- candidate
- candidate_class
- modelVersion
- collection
- kaggleGameArena
- record_kind
- aggregate
- game_arena
- true
- attribution
- Kaggle · kaggle · Checkers
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- Checkers · Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 5710/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/kaggle/checkers/versions/1
- measurements
- name
- Score
- unit
- score
- scale
- 1
- metric
- Checkers · Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 993.6400340410489
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 22.256228458412693
- minus
- 25.79839556602269
- hasUnevenConfidenceInterval
- true
- taskVersionId
- 0
- evaluationDate
- 2026-11-11T19:57:04.5294524Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 993.6400340410489
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 22.256228458412693
- minus
- 25.79839556602269
- hasUnevenConfidenceInterval
- true
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 33515
- sort_order
- DESCENDING
- source_name
- Score
- display_type
- counts
- task_version
- 1
- task_display_type
- COUNTS
- normalization_status
- normalized
- published_at
- 2026-06-11T15:24:41.429982100Z
- candidate_class
- modelVersion
- methodology_url
- https://www.kaggle.com/game-arena-faq
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- game_arena_rating
- Game-specific rating; compare within this game and version
- metric_population
- 41
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-11-11T19:57:04.529Z
- source model id
- o3
- confidence lower
- 967.8416384750262
- confidence upper
- 1015.8962624994616
Original result ↗50.48%
- source id
- kaggleBenchmarks
- leaderboard name
- SimpleQA · simpleqa_task
- dimension
- knowledge
- metric
- SimpleQA · simpleqa_task
- rank
- 15
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40103
- name
- simpleqa_task
- version
- 7
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 40
- name
- SimpleQA
- type
- INDIVIDUAL
- owner
- openai
- version
- 1
- version_id
- 26
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · openai · SimpleQA
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SimpleQA · simpleqa_task
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 26/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/openai/simpleqa/versions/1
- measurements
- name
- simpleqa_task
- unit
- percent
- scale
- 1
- metric
- SimpleQA · simpleqa_task
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.5048049091119602
- standardDeviation
- 0
- confidenceInterval
- 0.0144209055983782
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0144209055983782
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-05-29T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.5048049091119602
- standardDeviation
- 0
- confidenceInterval
- 0.0144209055983782
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0144209055983782
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40103
- task_url
- /benchmarks/tasks/benchmarkler/simpleqa-task
- sort_order
- DESCENDING
- source_name
- simpleqa_task
- display_type
- percentages
- task_version
- 7
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 49
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-05-29T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.49038400351358197
- confidence upper
- 0.5192258147103384
Original result ↗9.231%
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode Main Standard · SciCode Main Standard
- dimension
- coding
- metric
- SciCode Main Standard · SciCode Main Standard
- rank
- 15
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40105
- name
- SciCode Main Standard
- version
- 3
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 12
- name
- SciCode Main Standard
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 12
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode Main Standard
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode Main Standard · SciCode Main Standard
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 12/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode-main-standard/versions/1
- measurements
- name
- SciCode Main Standard
- unit
- percent
- scale
- 1
- metric
- SciCode Main Standard · SciCode Main Standard
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.0923076923076923
- standardDeviation
- 0
- confidenceInterval
- 0.0703687257914088
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0703687257914088
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-05-22T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.0923076923076923
- standardDeviation
- 0
- confidenceInterval
- 0.0703687257914088
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0703687257914088
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40105
- task_url
- /benchmarks/tasks/benchmarkler/scicode-standard-scicode-main-standard
- sort_order
- DESCENDING
- source_name
- SciCode Main Standard
- display_type
- percentages
- task_version
- 3
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 57
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-05-22T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.021938966516283492
- confidence upper
- 0.1626764180991011
Original result ↗1,230.685
- source id
- lmarena
- leaderboard name
- LMArena Vision Style Control Entity Recognition
- dimension
- multimodal
- metric
- Arena rating
- rank
- 16
- sample size
- 492
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o3 (2025-04-16)
- confidence lower
- 1199.0890502336329
- confidence upper
- 1262.2806896363436
Original result ↗52.257%
- source id
- kaggleBenchmarks
- leaderboard name
- SimpleQA Verified · simpleqa_verified_task
- dimension
- knowledge
- metric
- SimpleQA Verified · simpleqa_verified_task
- rank
- 16
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40086
- name
- simpleqa_verified_task
- version
- 7
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 137
- name
- SimpleQA Verified
- type
- INDIVIDUAL
- owner
- deepmind
- version
- 1
- version_id
- 123
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · deepmind · SimpleQA Verified
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SimpleQA Verified · simpleqa_verified_task
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 123/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/deepmind/simpleqa-verified/versions/1
- measurements
- name
- simpleqa_verified_task
- unit
- percent
- scale
- 1
- metric
- SimpleQA Verified · simpleqa_verified_task
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.522567703109328
- standardDeviation
- 0
- confidenceInterval
- 0.0308528445346074
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0308528445346074
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-07-24T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.522567703109328
- standardDeviation
- 0
- confidenceInterval
- 0.0308528445346074
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0308528445346074
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40086
- task_url
- /benchmarks/tasks/benchmarkler/simpleqa-verified-task
- sort_order
- DESCENDING
- source_name
- simpleqa_verified_task
- display_type
- percentages
- task_version
- 7
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-09-10T15:04:02.690199100Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 57
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-07-24T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.4917148585747206
- confidence upper
- 0.5534205476439353
Original result ↗38%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Traditional Mandarin · EM Traditional Mandarin
- dimension
- reasoning
- metric
- MultiLoKo Traditional Mandarin · EM Traditional Mandarin
- rank
- 16
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 56
- name
- EM Traditional Mandarin
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 79
- name
- MultiLoKo Traditional Mandarin
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 65
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Traditional Mandarin
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Traditional Mandarin · EM Traditional Mandarin
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 65/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-traditional-mandarin/versions/1
- measurements
- name
- EM Traditional Mandarin
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Traditional Mandarin · EM Traditional Mandarin
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.38
- standardDeviation
- 0
- confidenceInterval
- 0.0601680213454135
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0601680213454135
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.38
- standardDeviation
- 0
- confidenceInterval
- 0.0601680213454135
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0601680213454135
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 56
- sort_order
- DESCENDING
- source_name
- EM Traditional Mandarin
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.3198319786545865
- confidence upper
- 0.4401680213454135
Original result ↗925.053
- source id
- kaggleBenchmarks
- leaderboard name
- Chess · Score
- dimension
- general
- metric
- Chess · Score
- rank
- 17
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1446
- name
- Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 147
- name
- Chess
- type
- GAME
- owner
- kaggle
- version
- 2
- version_id
- 349
- maintainer_tier
- Kaggle-published
- candidate
- candidate_class
- modelVersion
- collection
- kaggleGameArena
- record_kind
- aggregate
- game_arena
- true
- attribution
- Kaggle · kaggle · Chess
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- Chess · Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 349/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/kaggle/chess-text/versions/2
- measurements
- name
- Score
- unit
- score
- scale
- 1
- metric
- Chess · Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 925.0527736757293
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 39.13897846125769
- minus
- 52.372522708570386
- hasUnevenConfidenceInterval
- true
- taskVersionId
- 0
- evaluationDate
- 2026-11-11T20:03:32.6840746Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 925.0527736757293
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 39.13897846125769
- minus
- 52.372522708570386
- hasUnevenConfidenceInterval
- true
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1446
- sort_order
- DESCENDING
- source_name
- Score
- display_type
- counts
- task_version
- 1
- task_display_type
- COUNTS
- normalization_status
- normalized
- published_at
- 2026-02-02T15:46:19.333333900Z
- candidate_class
- modelVersion
- methodology_url
- https://www.kaggle.com/game-arena-faq
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- game_arena_rating
- Game-specific rating; compare within this game and version
- metric_population
- 42
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-11-11T20:03:32.684Z
- source model id
- o3
- confidence lower
- 872.6802509671589
- confidence upper
- 964.191752136987
Original result ↗36.426%
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode · SciCode Subproblem Standard
- dimension
- coding
- metric
- SciCode · SciCode Subproblem Standard
- rank
- 17
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40106
- name
- SciCode Subproblem Standard
- version
- 3
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 16
- name
- SciCode
- type
- SUITE
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 16
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode · SciCode Subproblem Standard
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 16/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode/versions/1
- measurements
- name
- SciCode Subproblem Standard
- unit
- percent
- scale
- 1
- metric
- SciCode · SciCode Subproblem Standard
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.3642611683848797
- standardDeviation
- 0
- confidenceInterval
- 0.055290103685942
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.055290103685942
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-05-22T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.3642611683848797
- standardDeviation
- 0
- confidenceInterval
- 0.055290103685942
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.055290103685942
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40106
- task_url
- /benchmarks/open-benchmarks/scicode-subproblem-standard/versions/1
- sort_order
- DESCENDING
- source_name
- SciCode Subproblem Standard
- display_type
- percentages
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-10-21T20:29:26.251536900Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 62
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-05-22T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.3089710646989377
- confidence upper
- 0.4195512720708217
Original result ↗44.674%
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode · SciCode Subproblem With Background
- dimension
- coding
- metric
- SciCode · SciCode Subproblem With Background
- rank
- 18
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40200
- name
- SciCode Subproblem With Background
- version
- 3
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 16
- name
- SciCode
- type
- SUITE
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 16
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode · SciCode Subproblem With Background
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 16/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode/versions/1
- measurements
- name
- SciCode Subproblem With Background
- unit
- percent
- scale
- 1
- metric
- SciCode · SciCode Subproblem With Background
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.4467353951890034
- standardDeviation
- 0
- confidenceInterval
- 0.0571206606396046
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0571206606396046
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-05-22T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.4467353951890034
- standardDeviation
- 0
- confidenceInterval
- 0.0571206606396046
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0571206606396046
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40200
- task_url
- /benchmarks/open-benchmarks/scicode-subproblem-with-background/versions/1
- sort_order
- DESCENDING
- source_name
- SciCode Subproblem With Background
- display_type
- percentages
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-10-21T20:29:26.251536900Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 62
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-05-22T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.3896147345493988
- confidence upper
- 0.503856055828608
Original result ↗1,210.921
- source id
- lmarena
- leaderboard name
- LMArena Vision Captioning
- dimension
- multimodal
- metric
- Arena rating
- rank
- 19
- sample size
- 537
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o3 (2025-04-16)
- confidence lower
- 1183.171371186475
- confidence upper
- 1238.6700097881644
Original result ↗1,197.189
- source id
- lmarena
- leaderboard name
- LMArena Vision Creative Writing
- dimension
- multimodal
- metric
- Arena rating
- rank
- 19
- sample size
- 1880
- evaluated at
- 2026-01-09T00:00:00.000Z
- source model id
- o3-2025-04-16
- confidence lower
- 1183.0660806530764
- confidence upper
- 1211.311043064232
Original result ↗1,184.169
- source id
- lmarena
- leaderboard name
- LMArena Vision Style Control Captioning
- dimension
- multimodal
- metric
- Arena rating
- rank
- 19
- sample size
- 537
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o3 (2025-04-16)
- confidence lower
- 1154.2340623191944
- confidence upper
- 1214.1041079907434
Original result ↗9.231%
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode · SciCode Main Standard
- dimension
- coding
- metric
- SciCode · SciCode Main Standard
- rank
- 19
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40105
- name
- SciCode Main Standard
- version
- 3
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 16
- name
- SciCode
- type
- SUITE
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 16
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode · SciCode Main Standard
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 16/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode/versions/1
- measurements
- name
- SciCode Main Standard
- unit
- percent
- scale
- 1
- metric
- SciCode · SciCode Main Standard
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.0923076923076923
- standardDeviation
- 0
- confidenceInterval
- 0.0703687257914088
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0703687257914088
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-05-22T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.0923076923076923
- standardDeviation
- 0
- confidenceInterval
- 0.0703687257914088
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0703687257914088
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40105
- task_url
- /benchmarks/open-benchmarks/scicode-main-standard/versions/1
- sort_order
- DESCENDING
- source_name
- SciCode Main Standard
- display_type
- percentages
- task_version
- 3
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-10-21T20:29:26.251536900Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 62
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-05-22T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.021938966516283492
- confidence upper
- 0.1626764180991011
Original result ↗1,191.815
- source id
- lmarena
- leaderboard name
- LMArena Vision Style Control Creative Writing
- dimension
- multimodal
- metric
- Arena rating
- rank
- 20
- sample size
- 1880
- evaluated at
- 2026-01-09T00:00:00.000Z
- source model id
- o3-2025-04-16
- confidence lower
- 1177.1290080821327
- confidence upper
- 1206.5016337101663
Original result ↗186.782
- source id
- kaggleBenchmarks
- leaderboard name
- Bargaining · Score
- dimension
- general
- metric
- Bargaining · Score
- rank
- 20
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 37611
- name
- Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 6128
- name
- Bargaining
- type
- GAME
- owner
- kaggle
- version
- 1
- version_id
- 6152
- maintainer_tier
- Kaggle-published
- candidate
- candidate_class
- modelVersion
- collection
- kaggleGameArena
- record_kind
- aggregate
- game_arena
- true
- attribution
- Kaggle · kaggle · Bargaining
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- Bargaining · Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 6152/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/kaggle/bargaining/versions/1
- measurements
- name
- Score
- unit
- score
- scale
- 1
- metric
- Bargaining · Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 186.7824681728075
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 10.699219936152048
- minus
- 10.461803555387121
- hasUnevenConfidenceInterval
- true
- taskVersionId
- 0
- evaluationDate
- 2026-11-11T20:00:44.5076442Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 186.7824681728075
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 10.699219936152048
- minus
- 10.461803555387121
- hasUnevenConfidenceInterval
- true
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 37611
- sort_order
- DESCENDING
- source_name
- Score
- display_type
- counts
- task_version
- 1
- task_display_type
- COUNTS
- normalization_status
- normalized
- published_at
- 2026-07-23T16:10:38.700299600Z
- candidate_class
- modelVersion
- methodology_url
- https://www.kaggle.com/game-arena-faq
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- game_arena_rating
- Game-specific rating; compare within this game and version
- metric_population
- 39
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-11-11T20:00:44.507Z
- source model id
- o3
- confidence lower
- 176.3206646174204
- confidence upper
- 197.48168810895956
Original result ↗92.273%
- source id
- kaggleBenchmarks
- leaderboard name
- MMLU · mmlu_task
- dimension
- reasoning
- metric
- MMLU · mmlu_task
- rank
- 20
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40139
- name
- mmlu_task
- version
- 7
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 42
- name
- MMLU
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- version_id
- 28
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · MMLU
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MMLU · mmlu_task
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 28/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/mmlu/versions/1
- measurements
- name
- mmlu_task
- unit
- percent
- scale
- 1
- metric
- MMLU · mmlu_task
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.9227318045862412
- standardDeviation
- 0
- confidenceInterval
- 0.004416433916643
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.004416433916643
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-05-30T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.9227318045862412
- standardDeviation
- 0
- confidenceInterval
- 0.004416433916643
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.004416433916643
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40139
- task_url
- /benchmarks/tasks/benchmarkler/mmlu-task
- sort_order
- DESCENDING
- source_name
- mmlu_task
- display_type
- percentages
- task_version
- 7
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 61
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-05-30T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.9183153706695981
- confidence upper
- 0.9271482385028842
Original result ↗86.361%
- source id
- kaggleBenchmarks
- leaderboard name
- MMLU-Pro · mmlu_pro_task
- dimension
- reasoning
- metric
- MMLU-Pro · mmlu_pro_task
- rank
- 20
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40138
- name
- mmlu_pro_task
- version
- 12
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 44
- name
- MMLU-Pro
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- version_id
- 30
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · MMLU-Pro
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MMLU-Pro · mmlu_pro_task
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 30/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/mmlu-pro/versions/1
- measurements
- name
- mmlu_pro_task
- unit
- percent
- scale
- 1
- metric
- MMLU-Pro · mmlu_pro_task
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.8636136968085106
- standardDeviation
- 0
- confidenceInterval
- 0.0061323130772424
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0061323130772424
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-13T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.8636136968085106
- standardDeviation
- 0
- confidenceInterval
- 0.0061323130772424
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0061323130772424
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40138
- task_url
- /benchmarks/tasks/benchmarkler/mmlu-pro-task
- sort_order
- DESCENDING
- source_name
- mmlu_pro_task
- display_type
- percentages
- task_version
- 12
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 64
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-13T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.8574813837312683
- confidence upper
- 0.869746009885753
Original result ↗93.75%
- source id
- bfcl
- leaderboard name
- BFCL Relevance Detection
- dimension
- toolUse
- metric
- Relevance detection
- rank
- 21
Original result ↗453.719
- source id
- kaggleBenchmarks
- leaderboard name
- Reversi · Score
- dimension
- general
- metric
- Reversi · Score
- rank
- 22
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 41770
- name
- Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 6489
- name
- Reversi
- type
- GAME
- owner
- kaggle
- version
- 1
- version_id
- 6508
- maintainer_tier
- Kaggle-published
- candidate
- candidate_class
- modelVersion
- collection
- kaggleGameArena
- record_kind
- aggregate
- game_arena
- true
- attribution
- Kaggle · kaggle · Reversi
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- Reversi · Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 6508/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/kaggle/reversi/versions/1
- measurements
- name
- Score
- unit
- score
- scale
- 1
- metric
- Reversi · Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 453.7187331804164
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 44.575526133415224
- minus
- 65.26598419566625
- hasUnevenConfidenceInterval
- true
- taskVersionId
- 0
- evaluationDate
- 2026-11-11T20:01:44.8028176Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 453.7187331804164
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 44.575526133415224
- minus
- 65.26598419566625
- hasUnevenConfidenceInterval
- true
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 41770
- sort_order
- DESCENDING
- source_name
- Score
- display_type
- counts
- task_version
- 1
- task_display_type
- COUNTS
- normalization_status
- normalized
- published_at
- 2026-08-11T18:29:54.894504100Z
- candidate_class
- modelVersion
- methodology_url
- https://www.kaggle.com/game-arena-faq
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- game_arena_rating
- Game-specific rating; compare within this game and version
- metric_population
- 39
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-11-11T20:01:44.802Z
- source model id
- o3
- confidence lower
- 388.45274898475014
- confidence upper
- 498.2942593138316
Original result ↗1,232.898
- source id
- lmarena
- leaderboard name
- LMArena Vision Entity Recognition
- dimension
- multimodal
- metric
- Arena rating
- rank
- 24
- sample size
- 492
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o3 (2025-04-16)
- confidence lower
- 1202.8142319613644
- confidence upper
- 1262.9819786034154
Original result ↗Published prices
1–8 / 8
$0.50
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
$2.00
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
$8.00
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
$0.01
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- web_search
- Currency
- USD
$0.25
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$1.00
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$4.00
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.01
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- web_search
- Currency
- USD
- Billing conditions
- mode
- batch
Provider specifications & access
1–1 / 1
- source model id
- azure-openai/o3@2025-04-16
- hosting
- foundry-managed-compute
- license
- custom
- context length
- 200000
- max output tokens
- 100000
Safety assessments
1–1 / 1
35 / 100
- source id
- stanfordFMTI
- canonical model id
- openai/o3-2025-04-16
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- OpenAI
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 35 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–9 / 9
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-06-30
- normalized value
- 2024-06-30
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-06-30
- normalized value
- 2024-06-30
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- training_data_cutoff
- value
- May 2024
- normalized value
- 2024-05
- precision
- month
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
Explore more models