OpenAI: o1

The latest and strongest model family from OpenAI, o1 is designed to spend more time thinking before responding. The o1 model series is trained with large-scale reinforcement learning to reason...

openai/o1-2024-12-17

The latest and strongest model family from OpenAI, o1 is designed to spend more time thinking before responding. The o1 model series is trained with large-scale reinforcement learning to reason...

Specifications & capabilities

Input
text, image, file
Output
text
Context window · tokens
200000
Knowledge cutoff
2023-09
Capabilities
multimodal, reasoning, toolCalling, visionInput

Evaluations

81–100 / 200

LiveBench

55.469%

source id
liveBench
leaderboard name
LiveBench Coding
dimension
coding
metric
Average score
rank
31
sample size
128
evaluated at
2025-03-04T16:30:54.204Z
source model id
o1-2024-12-17-medium
Original result ↗

Kaggle Benchmarks

38.488%

source id
kaggleBenchmarks
leaderboard name
SciCode · SciCode Subproblem With Background
dimension
coding
metric
SciCode · SciCode Subproblem With Background
rank
31
aggregation scope
kaggle
true
status
published
license
Apache-2.0
direction
higherIsBetter
conditions
task
id
40200
name
SciCode Subproblem With Background
version
3
sort_order
DESCENDING
display_type
percentages
benchmark
id
16
name
SciCode
type
SUITE
owner
open-benchmarks
version
1
categories
  • general knowledge and reasoning
  • coding
  • science
version_id
16
maintainer_tier
Kaggle-maintained
maintenance_level
KAGGLE_MAINTAINED
candidate
candidate_class
modelVersion
record_kind
aggregate
attribution
Kaggle · open-benchmarks · SciCode
license_url
https://www.apache.org/licenses/LICENSE-2.0
metric_kind
SciCode · SciCode Subproblem With Background
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
16/leaderboard.json
source_page
https://www.kaggle.com/benchmarks/open-benchmarks/scicode/versions/1
measurements
  • name
    SciCode Subproblem With Background
    unit
    percent
    scale
    1
    metric
    SciCode · SciCode Subproblem With Background
    result
    resultCase
    numericResult
    booleanResult
    false
    numericResult
    value
    0.3848797250859107
    standardDeviation
    0
    confidenceInterval
    0.0559041610417728
    hasStandardDeviation
    false
    hasConfidenceInterval
    true
    confidenceIntervalNullable
    0.0559041610417728
    hasUnevenConfidenceInterval
    false
    taskVersionId
    0
    evaluationDate
    2025-05-22T00:00:00Z
    hasBooleanResult
    false
    hasNumericResult
    true
    hasTaskVersionId
    false
    hasEvaluationDate
    true
    numericResultNullable
    value
    0.3848797250859107
    standardDeviation
    0
    confidenceInterval
    0.0559041610417728
    hasStandardDeviation
    false
    hasConfidenceInterval
    true
    confidenceIntervalNullable
    0.0559041610417728
    hasUnevenConfidenceInterval
    false
    hasNumericResultPublic
    false
    customAdditionalResults
      hasNumericResultPrivate
      false
      task_id
      40200
      task_url
      /benchmarks/open-benchmarks/scicode-subproblem-with-background/versions/1
      sort_order
      DESCENDING
      source_name
      SciCode Subproblem With Background
      display_type
      percentages
      task_version
      3
      task_display_type
      RAW_VALUES
      normalization_status
      normalized
    published_at
    2025-10-21T20:29:26.251536900Z
    candidate_class
    modelVersion
    source_revision
    b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
    publisher_anchor
    openai/o1-2024-12-17
    metric_population
    62
    benchmark_evaluation
    true
    task_metadata_source
    benchmarkVersion
    candidate_metadata_source
    benchmarkVersionMappings
    evaluated at
    2025-05-22T00:00:00.000Z
    source model id
    o1
    confidence lower
    0.32897556404413786
    confidence upper
    0.4407838861276835
    Original result ↗

    Kaggle Benchmarks

    29.21%

    source id
    kaggleBenchmarks
    leaderboard name
    SciCode · SciCode Subproblem Standard
    dimension
    coding
    metric
    SciCode · SciCode Subproblem Standard
    rank
    33
    aggregation scope
    kaggle
    true
    status
    published
    license
    Apache-2.0
    direction
    higherIsBetter
    conditions
    task
    id
    40106
    name
    SciCode Subproblem Standard
    version
    3
    sort_order
    DESCENDING
    display_type
    percentages
    benchmark
    id
    16
    name
    SciCode
    type
    SUITE
    owner
    open-benchmarks
    version
    1
    categories
    • general knowledge and reasoning
    • coding
    • science
    version_id
    16
    maintainer_tier
    Kaggle-maintained
    maintenance_level
    KAGGLE_MAINTAINED
    candidate
    candidate_class
    modelVersion
    record_kind
    aggregate
    attribution
    Kaggle · open-benchmarks · SciCode
    license_url
    https://www.apache.org/licenses/LICENSE-2.0
    metric_kind
    SciCode · SciCode Subproblem Standard
    rank_method
    competition rank among reported evaluations in identical conditions, including unlinked observations
    source_file
    16/leaderboard.json
    source_page
    https://www.kaggle.com/benchmarks/open-benchmarks/scicode/versions/1
    measurements
    • name
      SciCode Subproblem Standard
      unit
      percent
      scale
      1
      metric
      SciCode · SciCode Subproblem Standard
      result
      resultCase
      numericResult
      booleanResult
      false
      numericResult
      value
      0.2920962199312715
      standardDeviation
      0
      confidenceInterval
      0.0522458357290782
      hasStandardDeviation
      false
      hasConfidenceInterval
      true
      confidenceIntervalNullable
      0.0522458357290782
      hasUnevenConfidenceInterval
      false
      taskVersionId
      0
      evaluationDate
      2025-05-22T00:00:00Z
      hasBooleanResult
      false
      hasNumericResult
      true
      hasTaskVersionId
      false
      hasEvaluationDate
      true
      numericResultNullable
      value
      0.2920962199312715
      standardDeviation
      0
      confidenceInterval
      0.0522458357290782
      hasStandardDeviation
      false
      hasConfidenceInterval
      true
      confidenceIntervalNullable
      0.0522458357290782
      hasUnevenConfidenceInterval
      false
      hasNumericResultPublic
      false
      customAdditionalResults
        hasNumericResultPrivate
        false
        task_id
        40106
        task_url
        /benchmarks/open-benchmarks/scicode-subproblem-standard/versions/1
        sort_order
        DESCENDING
        source_name
        SciCode Subproblem Standard
        display_type
        percentages
        task_version
        3
        task_display_type
        RAW_VALUES
        normalization_status
        normalized
      published_at
      2025-10-21T20:29:26.251536900Z
      candidate_class
      modelVersion
      source_revision
      b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
      publisher_anchor
      openai/o1-2024-12-17
      metric_population
      62
      benchmark_evaluation
      true
      task_metadata_source
      benchmarkVersion
      candidate_metadata_source
      benchmarkVersionMappings
      evaluated at
      2025-05-22T00:00:00.000Z
      source model id
      o1
      confidence lower
      0.2398503842021933
      confidence upper
      0.3443420556603497
      Original result ↗

      Kaggle Benchmarks

      70%

      source id
      kaggleBenchmarks
      leaderboard name
      AIME 2025 · aime_task
      dimension
      math
      metric
      AIME 2025 · aime_task
      rank
      35
      aggregation scope
      kaggle
      true
      status
      published
      license
      Apache-2.0
      direction
      higherIsBetter
      conditions
      task
      id
      40087
      name
      aime_task
      version
      6
      sort_order
      DESCENDING
      display_type
      percentages
      benchmark
      id
      125
      name
      AIME 2025
      type
      INDIVIDUAL
      owner
      open-benchmarks
      version
      1
      categories
      • general knowledge and reasoning
      • math
      version_id
      111
      maintainer_tier
      Kaggle-maintained
      maintenance_level
      KAGGLE_MAINTAINED
      candidate
      candidate_class
      modelVersion
      record_kind
      aggregate
      attribution
      Kaggle · open-benchmarks · AIME 2025
      license_url
      https://www.apache.org/licenses/LICENSE-2.0
      metric_kind
      AIME 2025 · aime_task
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      111/leaderboard.json
      source_page
      https://www.kaggle.com/benchmarks/open-benchmarks/aime-2025/versions/1
      measurements
      • name
        aime_task
        unit
        percent
        scale
        1
        metric
        AIME 2025 · aime_task
        result
        resultCase
        numericResult
        booleanResult
        false
        numericResult
        value
        0.7
        standardDeviation
        0
        confidenceInterval
        0
        hasStandardDeviation
        false
        hasConfidenceInterval
        false
        hasUnevenConfidenceInterval
        false
        taskVersionId
        0
        evaluationDate
        2025-07-07T00:00:00Z
        hasBooleanResult
        false
        hasNumericResult
        true
        hasTaskVersionId
        false
        hasEvaluationDate
        true
        numericResultNullable
        value
        0.7
        standardDeviation
        0
        confidenceInterval
        0
        hasStandardDeviation
        false
        hasConfidenceInterval
        false
        hasUnevenConfidenceInterval
        false
        hasNumericResultPublic
        false
        customAdditionalResults
          hasNumericResultPrivate
          false
          task_id
          40087
          task_url
          /benchmarks/tasks/benchmarkler/aime-task
          sort_order
          DESCENDING
          source_name
          aime_task
          display_type
          percentages
          task_version
          6
          task_display_type
          PERCENTAGES
          normalization_status
          normalized
        published_at
        2025-07-15T11:49:31.790Z
        candidate_class
        modelVersion
        source_revision
        b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
        publisher_anchor
        openai/o1-2024-12-17
        metric_population
        68
        benchmark_evaluation
        true
        task_metadata_source
        benchmarkVersion
        candidate_metadata_source
        benchmarkVersionMappings
        evaluated at
        2025-07-07T00:00:00.000Z
        source model id
        o1
        Original result ↗

        LiveBench

        53.125%

        source id
        liveBench
        leaderboard name
        LiveBench Coding
        dimension
        coding
        metric
        Average score
        rank
        39
        sample size
        128
        evaluated at
        2025-02-06T18:32:30.729Z
        source model id
        o1-2024-12-17-low
        Original result ↗

        LMArena

        1,409.967

        source id
        lmarena
        leaderboard name
        LMArena Text Style Control Korean
        dimension
        style
        metric
        Arena rating
        rank
        74
        sample size
        396
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1378.2982278237268
        confidence upper
        1441.6356946309188
        Original result ↗

        LMArena

        1,264.246

        source id
        lmarena
        leaderboard name
        LMArena Vision Style Control Chinese
        dimension
        multimodal
        metric
        Arena rating
        rank
        74
        sample size
        99
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1207.5905211706813
        confidence upper
        1320.9024767761211
        Original result ↗

        LMArena

        1,396.179

        source id
        lmarena
        leaderboard name
        LMArena Text Korean
        dimension
        general
        metric
        Arena rating
        rank
        75
        sample size
        396
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1364.4278475017493
        confidence upper
        1427.9296496706431
        Original result ↗

        LMArena

        1,234.746

        source id
        lmarena
        leaderboard name
        LMArena Vision Chinese
        dimension
        multimodal
        metric
        Arena rating
        rank
        86
        sample size
        99
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1176.4525622815686
        confidence upper
        1293.0391525493314
        Original result ↗

        LMArena

        1,192.851

        source id
        lmarena
        leaderboard name
        LMArena Vision Style Control Overall
        dimension
        multimodal
        metric
        Arena rating
        rank
        97
        sample size
        3694
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1182.0624459002702
        confidence upper
        1203.6398010801863
        Original result ↗

        LMArena

        1,186.167

        source id
        lmarena
        leaderboard name
        LMArena Vision Style Control English
        dimension
        multimodal
        metric
        Arena rating
        rank
        103
        sample size
        1943
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1171.613986670553
        confidence upper
        1200.7198697492242
        Original result ↗

        LMArena

        1,168.253

        source id
        lmarena
        leaderboard name
        LMArena Vision Overall
        dimension
        multimodal
        metric
        Arena rating
        rank
        111
        sample size
        3694
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1157.4565110782632
        confidence upper
        1179.0490471342498
        Original result ↗

        LMArena

        1,162.09

        source id
        lmarena
        leaderboard name
        LMArena Vision English
        dimension
        multimodal
        metric
        Arena rating
        rank
        116
        sample size
        1943
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1147.5936255075844
        confidence upper
        1176.5872903126333
        Original result ↗

        LMArena

        1,374.235

        source id
        lmarena
        leaderboard name
        LMArena Text Style Control Japanese
        dimension
        style
        metric
        Arena rating
        rank
        118
        sample size
        581
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1348.0634522923253
        confidence upper
        1400.4060876330122
        Original result ↗

        LMArena

        1,389.898

        source id
        lmarena
        leaderboard name
        LMArena Text Style Control Industry Entertainment And Sports And Media
        dimension
        style
        metric
        Arena rating
        rank
        127
        sample size
        5210
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1381.4039006728633
        confidence upper
        1398.391784033138
        Original result ↗

        LMArena

        1,398.156

        source id
        lmarena
        leaderboard name
        LMArena Text Style Control Industry Writing And Literature And Language
        dimension
        style
        metric
        Arena rating
        rank
        135
        sample size
        7663
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1390.885899892981
        confidence upper
        1405.4256264358874
        Original result ↗

        LMArena

        1,346.264

        source id
        lmarena
        leaderboard name
        LMArena Text Japanese
        dimension
        general
        metric
        Arena rating
        rank
        135
        sample size
        581
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1320.1935591328697
        confidence upper
        1372.3340204106332
        Original result ↗

        LMArena

        1,406.985

        source id
        lmarena
        leaderboard name
        LMArena Text Style Control Instruction Following
        dimension
        style
        metric
        Arena rating
        rank
        141
        sample size
        10246
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1400.4481831005905
        confidence upper
        1413.5225372285454
        Original result ↗

        LMArena

        1,381.295

        source id
        lmarena
        leaderboard name
        LMArena Text Style Control Creative Writing
        dimension
        style
        metric
        Arena rating
        rank
        147
        sample size
        4642
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1372.3280954774007
        confidence upper
        1390.2613684180405
        Original result ↗

        LMArena

        1,414.118

        source id
        lmarena
        leaderboard name
        LMArena Text Style Control Industry Mathematical
        dimension
        style
        metric
        Arena rating
        rank
        151
        sample size
        2644
        evaluated at
        2026-11-09T00:00:00.000Z
        source model id
        o1 (2024-12-17)
        confidence lower
        1402.5487739383361
        confidence upper
        1425.6870403970324
        Original result ↗

        Provider specifications & access

        1–1 / 1

        OpenAI o1 · azure-openai v2024-12-17 ↗

        source model id
        azure-openai/o1@2024-12-17
        hosting
        foundry-managed-compute
        platforms
        • Microsoft Foundry
        license
        custom
        context length
        200000
        max output tokens
        100000
        architecture
        input_modalities
        • text
        • image
        output_modalities
        • text
        capabilities
        • reasoning
        • toolCalling

        Safety assessments

        1–1 / 1

        Foundation Model Transparency Index 2025 ↗

        35 / 100

        source id
        stanfordFMTI
        canonical model id
        openai/o1-2024-12-17
        taxonomy
        transparency
        hazard category
        transparency
        hazard name
        Organization transparency
        policy area
        OpenAI
        assessment type
        organization-level disclosure
        metric
        disclosure_score
        result label
        35 / 100
        sample size
        100
        updated at
        2026-11-09T18:08:05.227Z

        Source specification observations

        1–3 / 3

        azureFoundry ↗

        field
        context_length
        value
        200000
        normalized value
        200000
        scope
        source-model
        source id
        azureFoundry
        confidence
        1

        azureFoundry ↗

        field
        max_output_tokens
        value
        100000
        normalized value
        100000
        scope
        source-model
        source id
        azureFoundry
        confidence
        1

        azureFoundry ↗

        field
        knowledge_cutoff
        reported field
        training_data_cutoff
        value
        September 2023
        normalized value
        2023-09
        precision
        month
        scope
        source-model
        source id
        azureFoundry
        confidence
        1

        Original sources

        1–8 / 8

        Microsoft Foundry · Model page ↗

        Microsoft Foundry · Model documentation ↗

        GitHub · Catalog ↗

        GitHub · Catalog ↗

        Kaggle · Catalog ↗

        LMArena · Catalog ↗

        Microsoft Foundry · Catalog ↗

        livebench.ai · Catalog ↗

        Source links

        1–7 / 7

        Explore more models

        Models

        Loading
        EVIDENCE / COMPARISON

        Benchmarks

        Explore every benchmark

        Loading

        These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

        Install TensorTrace