OpenAI: o3
o3 is a well-rounded and powerful model across domains. It sets a new standard for math, science, coding, and visual reasoning tasks. It also excels at technical writing and instruction-following. Us…
openai/o3-2025-04-16
o3 is a well-rounded and powerful model across domains. It sets a new standard for math, science, coding, and visual reasoning tasks. It also excels at technical writing and instruction-following. Use it to think through multi-step problems that involve analysis across text, code, and images.
Specifications & capabilities
- Input
- image, text, file
- Output
- text
- Context window · tokens
- 200000
- Capabilities
- fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput
Description source ↗Evaluations
61–80 / 328
59.055%
- source id
- kaggleBenchmarks
- leaderboard name
- AssetOpsBench · Consistency
- dimension
- reasoning
- metric
- AssetOpsBench · Consistency
- rank
- 7
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1045
- name
- Consistency
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 243
- name
- AssetOpsBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 222
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · AssetOpsBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AssetOpsBench · Consistency
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 222/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
- measurements
- name
- Consistency
- unit
- percent
- scale
- 1
- metric
- AssetOpsBench · Consistency
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.5905511811023622
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-11-24T03:35:12.735717Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.5905511811023622
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1045
- task_url
- /benchmarks/tasks/benchmarkler/failuresensoriq-consistency-benchmark-task
- sort_order
- DESCENDING
- source_name
- Consistency
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-01T22:15:26.261663300Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 25
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-11-24T03:35:12.735Z
- source model id
- o3
Original result ↗53.333%
- source id
- kaggleBenchmarks
- leaderboard name
- ITBench · FinOps Score
- dimension
- reasoning
- metric
- ITBench · FinOps Score
- rank
- 7
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1167
- name
- FinOps Score
- version
- 8
- sort_order
- DESCENDING
- display_type
- rawPercentages
- benchmark
- id
- 246
- name
- ITBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 225
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · ITBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- ITBench · FinOps Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 225/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/itbench/versions/1
- measurements
- name
- FinOps Score
- unit
- percent
- scale
- 100
- metric
- ITBench · FinOps Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 53.333333333333336
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-12-01T20:19:58.276422Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 53.333333333333336
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1167
- task_url
- /benchmarks/tasks/benchmarkler/itbench-finops-main-1
- sort_order
- DESCENDING
- source_name
- FinOps Score
- display_type
- rawPercentages
- task_version
- 8
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-02T12:36:17.407125500Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 13
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-12-01T20:19:58.276Z
- source model id
- o3
Original result ↗43.6%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Russian · EM Russian
- dimension
- reasoning
- metric
- MultiLoKo Russian · EM Russian
- rank
- 7
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 50
- name
- EM Russian
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 73
- name
- MultiLoKo Russian
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 59
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Russian
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Russian · EM Russian
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 59/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-russian/versions/1
- measurements
- name
- EM Russian
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Russian · EM Russian
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.436
- standardDeviation
- 0
- confidenceInterval
- 0.061469670239687
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.061469670239687
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.436
- standardDeviation
- 0
- confidenceInterval
- 0.061469670239687
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.061469670239687
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 50
- sort_order
- DESCENDING
- source_name
- EM Russian
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.374530329760313
- confidence upper
- 0.497469670239687
Original result ↗36.8%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Vietnamese · EM Vietnamese
- dimension
- reasoning
- metric
- MultiLoKo Vietnamese · EM Vietnamese
- rank
- 7
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 59
- name
- EM Vietnamese
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 82
- name
- MultiLoKo Vietnamese
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 68
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Vietnamese
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Vietnamese · EM Vietnamese
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 68/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-vietnamese/versions/1
- measurements
- name
- EM Vietnamese
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Vietnamese · EM Vietnamese
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.368
- standardDeviation
- 0
- confidenceInterval
- 0.0597806365533776
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0597806365533776
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.368
- standardDeviation
- 0
- confidenceInterval
- 0.0597806365533776
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0597806365533776
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 59
- sort_order
- DESCENDING
- source_name
- EM Vietnamese
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.3082193634466224
- confidence upper
- 0.4277806365533776
Original result ↗24%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Farsi · EM Farsi
- dimension
- reasoning
- metric
- MultiLoKo Farsi · EM Farsi
- rank
- 7
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 35
- name
- EM Farsi
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 58
- name
- MultiLoKo Farsi
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 44
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Farsi
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Farsi · EM Farsi
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 44/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-farsi/versions/1
- measurements
- name
- EM Farsi
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Farsi · EM Farsi
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.24
- standardDeviation
- 0
- confidenceInterval
- 0.0529408004810886
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0529408004810886
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.24
- standardDeviation
- 0
- confidenceInterval
- 0.0529408004810886
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0529408004810886
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 35
- sort_order
- DESCENDING
- source_name
- EM Farsi
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 50
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.1870591995189114
- confidence upper
- 0.2929408004810886
Original result ↗49.968
- source id
- kaggleBenchmarks
- leaderboard name
- IndicGenBench · Average
- dimension
- general
- metric
- IndicGenBench · Average
- rank
- 8
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 897
- name
- Average
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 212
- name
- IndicGenBench
- type
- SUITE
- owner
- deepmind
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- version_id
- 191
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · deepmind · IndicGenBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- IndicGenBench · Average
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 191/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/deepmind/indic-gen-bench/versions/1
- measurements
- name
- Average
- unit
- score
- scale
- 1
- metric
- IndicGenBench · Average
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 49.96820259464826
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-10-29T00:38:23.308961Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 49.96820259464826
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 897
- sort_order
- DESCENDING
- source_name
- Average
- display_type
- counts
- task_version
- 1
- task_display_type
- COUNTS
- normalization_status
- normalized
- published_at
- 2025-12-04T15:09:28.942941700Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 14
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-10-29T00:38:23.308Z
- source model id
- o3
Original result ↗63.05%
- source id
- bfcl
- leaderboard name
- BFCL Overall
- dimension
- toolUse
- metric
- Overall accuracy
- rank
- 8
Original result ↗62.25%
- source id
- bfcl
- leaderboard name
- BFCL Multi Turn
- dimension
- agentic
- metric
- Multi-turn accuracy
- rank
- 8
Original result ↗28.8%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Cantonese · EM Cantonese
- dimension
- reasoning
- metric
- MultiLoKo Cantonese · EM Cantonese
- rank
- 8
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 32
- name
- EM Cantonese
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 55
- name
- MultiLoKo Cantonese
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 41
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Cantonese
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Cantonese · EM Cantonese
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 41/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-cantonese/versions/1
- measurements
- name
- EM Cantonese
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Cantonese · EM Cantonese
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.288
- standardDeviation
- 0
- confidenceInterval
- 0.056132492548835
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.056132492548835
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.288
- standardDeviation
- 0
- confidenceInterval
- 0.056132492548835
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.056132492548835
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 32
- sort_order
- DESCENDING
- source_name
- EM Cantonese
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.23186750745116497
- confidence upper
- 0.344132492548835
Original result ↗539.599
- source id
- kaggleBenchmarks
- leaderboard name
- Five in a Row · Score
- dimension
- general
- metric
- Five in a Row · Score
- rank
- 9
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 5444
- name
- Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 2150
- name
- Five in a Row
- type
- GAME
- owner
- kaggle
- version
- 1
- version_id
- 2163
- maintainer_tier
- Kaggle-published
- candidate
- candidate_class
- modelVersion
- collection
- kaggleGameArena
- record_kind
- aggregate
- game_arena
- true
- attribution
- Kaggle · kaggle · Five in a Row
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- Five in a Row · Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 2163/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/kaggle/five-in-a-row/versions/1
- measurements
- name
- Score
- unit
- score
- scale
- 1
- metric
- Five in a Row · Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 539.5993415188569
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 50.652004487147565
- minus
- 67.9756091778508
- hasUnevenConfidenceInterval
- true
- taskVersionId
- 0
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- false
- numericResultNullable
- value
- 539.5993415188569
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 50.652004487147565
- minus
- 67.9756091778508
- hasUnevenConfidenceInterval
- true
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 5444
- sort_order
- DESCENDING
- source_name
- Score
- display_type
- counts
- task_version
- 1
- task_display_type
- COUNTS
- normalization_status
- normalized
- published_at
- 2026-04-30T16:37:18.401609400Z
- candidate_class
- modelVersion
- methodology_url
- https://www.kaggle.com/game-arena-faq
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- game_arena_rating
- Game-specific rating; compare within this game and version
- metric_population
- 20
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- source model id
- o3
- confidence lower
- 471.62373234100613
- confidence upper
- 590.2513460060045
Original result ↗62.404
- source id
- kaggleBenchmarks
- leaderboard name
- IndicGenBench · XQuAD-In
- dimension
- general
- metric
- IndicGenBench · XQuAD-In
- rank
- 9
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 820
- name
- XQuAD-In
- version
- 3
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 212
- name
- IndicGenBench
- type
- SUITE
- owner
- deepmind
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- version_id
- 191
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · deepmind · IndicGenBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- IndicGenBench · XQuAD-In
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 191/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/deepmind/indic-gen-bench/versions/1
- measurements
- name
- XQuAD-In
- unit
- score
- scale
- 1
- metric
- IndicGenBench · XQuAD-In
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 62.40408358745326
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-10-29T00:38:23.308961Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 62.40408358745326
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 820
- task_url
- /benchmarks/tasks/aminmohamedmohami/xquad-in-task
- sort_order
- DESCENDING
- source_name
- XQuAD-In
- display_type
- counts
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-04T15:09:28.942941700Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 14
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-10-29T00:38:23.308Z
- source model id
- o3
Original result ↗77%
- source id
- bfcl
- leaderboard name
- BFCL Web Search
- dimension
- agentic
- metric
- Web-search accuracy
- rank
- 9
Original result ↗62.355%
- source id
- kaggleBenchmarks
- leaderboard name
- AssetOpsBench · Pert. Complex Accuracy
- dimension
- reasoning
- metric
- AssetOpsBench · Pert. Complex Accuracy
- rank
- 10
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1044
- name
- Pert. Complex Accuracy
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 243
- name
- AssetOpsBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 222
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · AssetOpsBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AssetOpsBench · Pert. Complex Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 222/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
- measurements
- name
- Pert. Complex Accuracy
- unit
- percent
- scale
- 1
- metric
- AssetOpsBench · Pert. Complex Accuracy
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.6235470566179228
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-11-24T03:34:24.867788Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.6235470566179228
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1044
- task_url
- /benchmarks/tasks/benchmarkler/failuresensoriq-perturbationcomplex-benchmark-task
- sort_order
- DESCENDING
- source_name
- Pert. Complex Accuracy
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-01T22:15:26.261663300Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 25
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-11-24T03:34:24.867Z
- source model id
- o3
Original result ↗51.83%
- source id
- bfcl
- leaderboard name
- BFCL Memory
- dimension
- agentic
- metric
- Memory accuracy
- rank
- 10
Original result ↗47.31%
- source id
- bfcl
- leaderboard name
- BFCL Memory
- dimension
- agentic
- metric
- Memory accuracy
- rank
- 12
Original result ↗37.2%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Simplified Mandarin · EM Simplified Mandarin
- dimension
- reasoning
- metric
- MultiLoKo Simplified Mandarin · EM Simplified Mandarin
- rank
- 13
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 51
- name
- EM Simplified Mandarin
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 74
- name
- MultiLoKo Simplified Mandarin
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 60
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Simplified Mandarin
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Simplified Mandarin · EM Simplified Mandarin
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 60/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-simplified-mandarin/versions/1
- measurements
- name
- EM Simplified Mandarin
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Simplified Mandarin · EM Simplified Mandarin
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.372
- standardDeviation
- 0
- confidenceInterval
- 0.0599141467052741
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0599141467052741
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.372
- standardDeviation
- 0
- confidenceInterval
- 0.0599141467052741
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0599141467052741
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 51
- sort_order
- DESCENDING
- source_name
- EM Simplified Mandarin
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.3120858532947259
- confidence upper
- 0.4319141467052741
Original result ↗15.2%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Khmer · EM Khmer
- dimension
- reasoning
- metric
- MultiLoKo Khmer · EM Khmer
- rank
- 13
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 43
- name
- EM Khmer
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 66
- name
- MultiLoKo Khmer
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 52
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Khmer
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Khmer · EM Khmer
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 52/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-khmer/versions/1
- measurements
- name
- EM Khmer
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Khmer · EM Khmer
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.152
- standardDeviation
- 0
- confidenceInterval
- 0.0445038729169581
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0445038729169581
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.152
- standardDeviation
- 0
- confidenceInterval
- 0.0445038729169581
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0445038729169581
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 43
- sort_order
- DESCENDING
- source_name
- EM Khmer
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.1074961270830419
- confidence upper
- 0.1965038729169581
Original result ↗1.17
- source id
- kaggleBenchmarks
- leaderboard name
- Heads Up Poker · Mean BB/100
- dimension
- general
- metric
- Heads Up Poker · Mean BB/100
- rank
- 14
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 775
- name
- Mean BB/100
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 201
- name
- Heads Up Poker
- type
- GAME
- owner
- kaggle
- version
- 1
- version_id
- 180
- maintainer_tier
- Kaggle-published
- candidate
- candidate_class
- modelVersion
- collection
- kaggleGameArena
- record_kind
- aggregate
- game_arena
- true
- attribution
- Kaggle · kaggle · Heads Up Poker
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- Heads Up Poker · Mean BB/100
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 180/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/kaggle/poker-heads-up/versions/1
- measurements
- name
- Mean BB/100
- unit
- score
- scale
- 1
- metric
- Heads Up Poker · Mean BB/100
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 1.1699342185592179
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 6.406351648351647
- minus
- 6.12091865079365
- hasUnevenConfidenceInterval
- true
- taskVersionId
- 0
- evaluationDate
- 2026-10-08T17:19:02.7626688Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 1.1699342185592179
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 6.406351648351647
- minus
- 6.12091865079365
- hasUnevenConfidenceInterval
- true
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 775
- sort_order
- DESCENDING
- source_name
- Mean BB/100
- display_type
- counts
- task_version
- 1
- task_display_type
- COUNTS
- normalization_status
- normalized
- published_at
- 2026-02-02T15:50:27.731526100Z
- candidate_class
- modelVersion
- methodology_url
- https://www.kaggle.com/game-arena-faq
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- game_arena_rating
- Game-specific rating; compare within this game and version
- metric_population
- 31
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-10-08T17:19:02.762Z
- source model id
- o3
- confidence lower
- -4.950984432234431
- confidence upper
- 7.576285866910865
Original result ↗0.447
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode Subproblem With Background · SciCode Subproblem with Background
- dimension
- coding
- metric
- SciCode Subproblem With Background · SciCode Subproblem with Background
- rank
- 14
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40200
- name
- SciCode Subproblem with Background
- version
- 3
- sort_order
- DESCENDING
- display_type
- rawValues
- benchmark
- id
- 15
- name
- SciCode Subproblem With Background
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 15
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode Subproblem With Background
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode Subproblem With Background · SciCode Subproblem with Background
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 15/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode-subproblem-with-background/versions/1
- measurements
- name
- SciCode Subproblem with Background
- unit
- score
- scale
- 1
- metric
- SciCode Subproblem With Background · SciCode Subproblem with Background
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.4467353951890034
- standardDeviation
- 0
- confidenceInterval
- 0.0571206606396046
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0571206606396046
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-05-22T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.4467353951890034
- standardDeviation
- 0
- confidenceInterval
- 0.0571206606396046
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0571206606396046
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40200
- task_url
- /benchmarks/tasks/benchmarkler/scicode-background-scicode-subproblem-with-background
- sort_order
- DESCENDING
- source_name
- SciCode Subproblem with Background
- display_type
- rawValues
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 57
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-05-22T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.3896147345493988
- confidence upper
- 0.503856055828608
Original result ↗0.364
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode Subproblem Standard · SciCode Subproblem Standard
- dimension
- coding
- metric
- SciCode Subproblem Standard · SciCode Subproblem Standard
- rank
- 14
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40106
- name
- SciCode Subproblem Standard
- version
- 3
- sort_order
- DESCENDING
- display_type
- rawValues
- benchmark
- id
- 14
- name
- SciCode Subproblem Standard
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 14
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode Subproblem Standard
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode Subproblem Standard · SciCode Subproblem Standard
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 14/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode-subproblem-standard/versions/1
- measurements
- name
- SciCode Subproblem Standard
- unit
- score
- scale
- 1
- metric
- SciCode Subproblem Standard · SciCode Subproblem Standard
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.3642611683848797
- standardDeviation
- 0
- confidenceInterval
- 0.055290103685942
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.055290103685942
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-05-22T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.3642611683848797
- standardDeviation
- 0
- confidenceInterval
- 0.055290103685942
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.055290103685942
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40106
- task_url
- /benchmarks/tasks/benchmarkler/scicode-standard-scicode-subproblem-standard
- sort_order
- DESCENDING
- source_name
- SciCode Subproblem Standard
- display_type
- rawValues
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o3-2025-04-16
- metric_population
- 57
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-05-22T00:00:00.000Z
- source model id
- o3
- confidence lower
- 0.3089710646989377
- confidence upper
- 0.4195512720708217
Original result ↗Published prices
1–8 / 8
$0.50
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
$2.00
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
$8.00
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
$0.01
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- web_search
- Currency
- USD
$0.25
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$1.00
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$4.00
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.01
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- web_search
- Currency
- USD
- Billing conditions
- mode
- batch
Provider specifications & access
1–1 / 1
- source model id
- azure-openai/o3@2025-04-16
- hosting
- foundry-managed-compute
- license
- custom
- context length
- 200000
- max output tokens
- 100000
Safety assessments
1–1 / 1
35 / 100
- source id
- stanfordFMTI
- canonical model id
- openai/o3-2025-04-16
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- OpenAI
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 35 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–9 / 9
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-06-30
- normalized value
- 2024-06-30
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-06-30
- normalized value
- 2024-06-30
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- training_data_cutoff
- value
- May 2024
- normalized value
- 2024-05
- precision
- month
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
Explore more models