OpenAI: o1
The latest and strongest model family from OpenAI, o1 is designed to spend more time thinking before responding. The o1 model series is trained with large-scale reinforcement learning to reason...
openai/o1-2024-12-17
The latest and strongest model family from OpenAI, o1 is designed to spend more time thinking before responding. The o1 model series is trained with large-scale reinforcement learning to reason...
Specifications & capabilities
- Input
- text, image, file
- Output
- text
- Context window · tokens
- 200000
- Knowledge cutoff
- 2023-09
- Capabilities
- multimodal, reasoning, toolCalling, visionInput
Evaluations
81–100 / 200
55.469%
- source id
- liveBench
- leaderboard name
- LiveBench Coding
- dimension
- coding
- metric
- Average score
- rank
- 31
- sample size
- 128
- evaluated at
- 2025-03-04T16:30:54.204Z
- source model id
- o1-2024-12-17-medium
Original result ↗38.488%
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode · SciCode Subproblem With Background
- dimension
- coding
- metric
- SciCode · SciCode Subproblem With Background
- rank
- 31
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40200
- name
- SciCode Subproblem With Background
- version
- 3
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 16
- name
- SciCode
- type
- SUITE
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 16
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode · SciCode Subproblem With Background
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 16/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode/versions/1
- measurements
- name
- SciCode Subproblem With Background
- unit
- percent
- scale
- 1
- metric
- SciCode · SciCode Subproblem With Background
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.3848797250859107
- standardDeviation
- 0
- confidenceInterval
- 0.0559041610417728
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0559041610417728
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-05-22T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.3848797250859107
- standardDeviation
- 0
- confidenceInterval
- 0.0559041610417728
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0559041610417728
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40200
- task_url
- /benchmarks/open-benchmarks/scicode-subproblem-with-background/versions/1
- sort_order
- DESCENDING
- source_name
- SciCode Subproblem With Background
- display_type
- percentages
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-10-21T20:29:26.251536900Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o1-2024-12-17
- metric_population
- 62
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-05-22T00:00:00.000Z
- source model id
- o1
- confidence lower
- 0.32897556404413786
- confidence upper
- 0.4407838861276835
Original result ↗29.21%
- source id
- kaggleBenchmarks
- leaderboard name
- SciCode · SciCode Subproblem Standard
- dimension
- coding
- metric
- SciCode · SciCode Subproblem Standard
- rank
- 33
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40106
- name
- SciCode Subproblem Standard
- version
- 3
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 16
- name
- SciCode
- type
- SUITE
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- coding
- science
- version_id
- 16
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · SciCode
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- SciCode · SciCode Subproblem Standard
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 16/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/scicode/versions/1
- measurements
- name
- SciCode Subproblem Standard
- unit
- percent
- scale
- 1
- metric
- SciCode · SciCode Subproblem Standard
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.2920962199312715
- standardDeviation
- 0
- confidenceInterval
- 0.0522458357290782
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0522458357290782
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-05-22T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.2920962199312715
- standardDeviation
- 0
- confidenceInterval
- 0.0522458357290782
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0522458357290782
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40106
- task_url
- /benchmarks/open-benchmarks/scicode-subproblem-standard/versions/1
- sort_order
- DESCENDING
- source_name
- SciCode Subproblem Standard
- display_type
- percentages
- task_version
- 3
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-10-21T20:29:26.251536900Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o1-2024-12-17
- metric_population
- 62
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-05-22T00:00:00.000Z
- source model id
- o1
- confidence lower
- 0.2398503842021933
- confidence upper
- 0.3443420556603497
Original result ↗70%
- source id
- kaggleBenchmarks
- leaderboard name
- AIME 2025 · aime_task
- dimension
- math
- metric
- AIME 2025 · aime_task
- rank
- 35
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40087
- name
- aime_task
- version
- 6
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 125
- name
- AIME 2025
- type
- INDIVIDUAL
- owner
- open-benchmarks
- version
- 1
- categories
- general knowledge and reasoning
- math
- version_id
- 111
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · open-benchmarks · AIME 2025
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AIME 2025 · aime_task
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 111/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/open-benchmarks/aime-2025/versions/1
- measurements
- name
- aime_task
- unit
- percent
- scale
- 1
- metric
- AIME 2025 · aime_task
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.7
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-07-07T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.7
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40087
- task_url
- /benchmarks/tasks/benchmarkler/aime-task
- sort_order
- DESCENDING
- source_name
- aime_task
- display_type
- percentages
- task_version
- 6
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/o1-2024-12-17
- metric_population
- 68
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-07-07T00:00:00.000Z
- source model id
- o1
Original result ↗53.125%
- source id
- liveBench
- leaderboard name
- LiveBench Coding
- dimension
- coding
- metric
- Average score
- rank
- 39
- sample size
- 128
- evaluated at
- 2025-02-06T18:32:30.729Z
- source model id
- o1-2024-12-17-low
Original result ↗1,409.967
- source id
- lmarena
- leaderboard name
- LMArena Text Style Control Korean
- dimension
- style
- metric
- Arena rating
- rank
- 74
- sample size
- 396
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1378.2982278237268
- confidence upper
- 1441.6356946309188
Original result ↗1,264.246
- source id
- lmarena
- leaderboard name
- LMArena Vision Style Control Chinese
- dimension
- multimodal
- metric
- Arena rating
- rank
- 74
- sample size
- 99
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1207.5905211706813
- confidence upper
- 1320.9024767761211
Original result ↗1,396.179
- source id
- lmarena
- leaderboard name
- LMArena Text Korean
- dimension
- general
- metric
- Arena rating
- rank
- 75
- sample size
- 396
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1364.4278475017493
- confidence upper
- 1427.9296496706431
Original result ↗1,234.746
- source id
- lmarena
- leaderboard name
- LMArena Vision Chinese
- dimension
- multimodal
- metric
- Arena rating
- rank
- 86
- sample size
- 99
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1176.4525622815686
- confidence upper
- 1293.0391525493314
Original result ↗1,192.851
- source id
- lmarena
- leaderboard name
- LMArena Vision Style Control Overall
- dimension
- multimodal
- metric
- Arena rating
- rank
- 97
- sample size
- 3694
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1182.0624459002702
- confidence upper
- 1203.6398010801863
Original result ↗1,186.167
- source id
- lmarena
- leaderboard name
- LMArena Vision Style Control English
- dimension
- multimodal
- metric
- Arena rating
- rank
- 103
- sample size
- 1943
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1171.613986670553
- confidence upper
- 1200.7198697492242
Original result ↗1,168.253
- source id
- lmarena
- leaderboard name
- LMArena Vision Overall
- dimension
- multimodal
- metric
- Arena rating
- rank
- 111
- sample size
- 3694
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1157.4565110782632
- confidence upper
- 1179.0490471342498
Original result ↗1,162.09
- source id
- lmarena
- leaderboard name
- LMArena Vision English
- dimension
- multimodal
- metric
- Arena rating
- rank
- 116
- sample size
- 1943
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1147.5936255075844
- confidence upper
- 1176.5872903126333
Original result ↗1,374.235
- source id
- lmarena
- leaderboard name
- LMArena Text Style Control Japanese
- dimension
- style
- metric
- Arena rating
- rank
- 118
- sample size
- 581
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1348.0634522923253
- confidence upper
- 1400.4060876330122
Original result ↗1,389.898
- source id
- lmarena
- leaderboard name
- LMArena Text Style Control Industry Entertainment And Sports And Media
- dimension
- style
- metric
- Arena rating
- rank
- 127
- sample size
- 5210
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1381.4039006728633
- confidence upper
- 1398.391784033138
Original result ↗1,398.156
- source id
- lmarena
- leaderboard name
- LMArena Text Style Control Industry Writing And Literature And Language
- dimension
- style
- metric
- Arena rating
- rank
- 135
- sample size
- 7663
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1390.885899892981
- confidence upper
- 1405.4256264358874
Original result ↗1,346.264
- source id
- lmarena
- leaderboard name
- LMArena Text Japanese
- dimension
- general
- metric
- Arena rating
- rank
- 135
- sample size
- 581
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1320.1935591328697
- confidence upper
- 1372.3340204106332
Original result ↗1,406.985
- source id
- lmarena
- leaderboard name
- LMArena Text Style Control Instruction Following
- dimension
- style
- metric
- Arena rating
- rank
- 141
- sample size
- 10246
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1400.4481831005905
- confidence upper
- 1413.5225372285454
Original result ↗1,381.295
- source id
- lmarena
- leaderboard name
- LMArena Text Style Control Creative Writing
- dimension
- style
- metric
- Arena rating
- rank
- 147
- sample size
- 4642
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1372.3280954774007
- confidence upper
- 1390.2613684180405
Original result ↗1,414.118
- source id
- lmarena
- leaderboard name
- LMArena Text Style Control Industry Mathematical
- dimension
- style
- metric
- Arena rating
- rank
- 151
- sample size
- 2644
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- o1 (2024-12-17)
- confidence lower
- 1402.5487739383361
- confidence upper
- 1425.6870403970324
Original result ↗Provider specifications & access
1–1 / 1
- source model id
- azure-openai/o1@2024-12-17
- hosting
- foundry-managed-compute
- license
- custom
- context length
- 200000
- max output tokens
- 100000
Safety assessments
1–1 / 1
35 / 100
- source id
- stanfordFMTI
- canonical model id
- openai/o1-2024-12-17
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- OpenAI
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 35 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–3 / 3
- field
- context_length
- value
- 200000
- normalized value
- 200000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- max_output_tokens
- value
- 100000
- normalized value
- 100000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- training_data_cutoff
- value
- September 2023
- normalized value
- 2023-09
- precision
- month
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
Explore more models