OpenAI: GPT-5 Mini

GPT-5 Mini is a compact version of GPT-5, designed to handle lighter-weight reasoning tasks. It provides the same instruction-following and safety-tuning benefits as GPT-5, but with reduced latency a…

openai/gpt-5-mini-2025-08-07

GPT-5 Mini is a compact version of GPT-5, designed to handle lighter-weight reasoning tasks. It provides the same instruction-following and safety-tuning benefits as GPT-5, but with reduced latency and cost. GPT-5 Mini is the successor to OpenAI's o4-mini model.

Specifications & capabilities

Input
text, image, file
Output
text
Context window · tokens
400000
Published model ID
gpt-5-mini-2025-08-07
Capabilities
fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput, webSearch
Description source ↗

Evaluations

1–20 / 158

BFCL

82%

source id
bfcl
leaderboard name
BFCL Web Search
dimension
agentic
metric
Web-search accuracy
rank
4
Original result ↗

Kaggle Benchmarks

484

source id
kaggleBenchmarks
leaderboard name
Chess Suite · Text Input With Openings
dimension
general
metric
Chess Suite · Text Input With Openings
rank
6
aggregation scope
kaggle
true
status
published
license
Apache-2.0
direction
higherIsBetter
conditions
task
id
1869
name
Text Input With Openings
version
1
sort_order
DESCENDING
display_type
counts
benchmark
id
86
name
Chess Suite
type
SUITE
owner
kaggle
version
2
categories
    version_id
    437
    maintainer_tier
    Kaggle-published
    candidate
    candidate_class
    modelVersion
    record_kind
    aggregate
    attribution
    Kaggle · kaggle · Chess Suite
    license_url
    https://www.apache.org/licenses/LICENSE-2.0
    metric_kind
    Chess Suite · Text Input With Openings
    rank_method
    competition rank among reported evaluations in identical conditions, including unlinked observations
    source_file
    437/leaderboard.json
    source_page
    https://www.kaggle.com/benchmarks/kaggle/chess-suite/versions/2
    measurements
    • name
      Text Input With Openings
      unit
      score
      scale
      1
      metric
      Chess Suite · Text Input With Openings
      result
      resultCase
      numericResult
      booleanResult
      false
      numericResult
      value
      484
      standardDeviation
      0
      confidenceInterval
      0
      hasStandardDeviation
      false
      hasConfidenceInterval
      false
      unevenConfidenceInterval
      plus
      94
      minus
      69
      hasUnevenConfidenceInterval
      true
      taskVersionId
      0
      evaluationDate
      2026-01-13T00:00:00Z
      hasBooleanResult
      false
      hasNumericResult
      true
      hasTaskVersionId
      false
      hasEvaluationDate
      true
      numericResultNullable
      value
      484
      standardDeviation
      0
      confidenceInterval
      0
      hasStandardDeviation
      false
      hasConfidenceInterval
      false
      unevenConfidenceInterval
      plus
      94
      minus
      69
      hasUnevenConfidenceInterval
      true
      hasNumericResultPublic
      false
      customAdditionalResults
        hasNumericResultPrivate
        false
        task_id
        1869
        task_url
        /benchmarks/kaggle/chess-text-openings/versions/2
        sort_order
        DESCENDING
        source_name
        Text Input With Openings
        display_type
        counts
        task_version
        1
        task_display_type
        COUNTS
        normalization_status
        normalized
      published_at
      2026-02-02T15:46:09.865215700Z
      candidate_class
      modelVersion
      source_revision
      b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
      publisher_anchor
      openai/gpt-5-mini-2025-08-07
      metric_population
      8
      benchmark_evaluation
      true
      task_metadata_source
      benchmarkVersion
      candidate_metadata_source
      benchmarkVersionMappings
      evaluated at
      2026-01-13T00:00:00.000Z
      source model id
      GPT-5 mini
      confidence lower
      415
      confidence upper
      578
      Original result ↗

      Kaggle Benchmarks

      484

      source id
      kaggleBenchmarks
      leaderboard name
      Chess Openings · Score
      dimension
      general
      metric
      Chess Openings · Score
      rank
      7
      aggregation scope
      kaggle
      true
      status
      published
      license
      Apache-2.0
      direction
      higherIsBetter
      conditions
      task
      id
      1869
      name
      Score
      version
      1
      sort_order
      DESCENDING
      display_type
      counts
      benchmark
      id
      183
      name
      Chess Openings
      type
      GAME
      owner
      kaggle
      version
      2
      categories
        version_id
        436
        maintainer_tier
        Kaggle-published
        candidate
        candidate_class
        modelVersion
        collection
        kaggleGameArena
        record_kind
        aggregate
        game_arena
        true
        attribution
        Kaggle · kaggle · Chess Openings
        license_url
        https://www.apache.org/licenses/LICENSE-2.0
        metric_kind
        Chess Openings · Score
        rank_method
        competition rank among reported evaluations in identical conditions, including unlinked observations
        source_file
        436/leaderboard.json
        source_page
        https://www.kaggle.com/benchmarks/kaggle/chess-text-openings/versions/2
        measurements
        • name
          Score
          unit
          score
          scale
          1
          metric
          Chess Openings · Score
          result
          resultCase
          numericResult
          booleanResult
          false
          numericResult
          value
          484
          standardDeviation
          0
          confidenceInterval
          0
          hasStandardDeviation
          false
          hasConfidenceInterval
          false
          unevenConfidenceInterval
          plus
          94
          minus
          69
          hasUnevenConfidenceInterval
          true
          taskVersionId
          0
          evaluationDate
          2026-01-13T00:00:00Z
          hasBooleanResult
          false
          hasNumericResult
          true
          hasTaskVersionId
          false
          hasEvaluationDate
          true
          numericResultNullable
          value
          484
          standardDeviation
          0
          confidenceInterval
          0
          hasStandardDeviation
          false
          hasConfidenceInterval
          false
          unevenConfidenceInterval
          plus
          94
          minus
          69
          hasUnevenConfidenceInterval
          true
          hasNumericResultPublic
          false
          customAdditionalResults
            hasNumericResultPrivate
            false
            task_id
            1869
            sort_order
            DESCENDING
            source_name
            Score
            display_type
            counts
            task_version
            1
            task_display_type
            COUNTS
            normalization_status
            normalized
          published_at
          2026-02-02T15:46:28.981771500Z
          candidate_class
          modelVersion
          methodology_url
          https://www.kaggle.com/game-arena-faq
          source_revision
          b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
          publisher_anchor
          openai/gpt-5-mini-2025-08-07
          game_arena_rating
          Game-specific rating; compare within this game and version
          metric_population
          11
          benchmark_evaluation
          true
          task_metadata_source
          benchmarkVersion
          candidate_metadata_source
          benchmarkVersionMappings
          evaluated at
          2026-01-13T00:00:00.000Z
          source model id
          GPT-5 mini
          confidence lower
          415
          confidence upper
          578
          Original result ↗

          OpenRouter Benchmarks

          72.444%

          source id
          openRouterBenchmarks
          leaderboard name
          tau2-bench Verified Airline · Accuracy · OpenAI
          dimension
          agentic
          metric
          tau2-bench Verified Airline · Accuracy
          rank
          7
          sample size
          150
          aggregation scope
          status
          published
          harness
          url
          https://github.com/OpenRouterTeam/benchmark-harness
          name
          OpenRouter benchmark harness
          direction
          higherIsBetter
          run_count
          3
          conditions
          window
          newest 90 days; successful visible nonzero runs
          dataset
          benchmark-leaderboard
          benchmark
          id
          tau_bench_verified_airline
          name
          tau2-bench Verified Airline
          record_kind
          aggregate
          provider_name
          OpenAI
          attribution
          Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
          last_run_at
          2026-10-02T23:27:09.304Z
          license_url
          https://creativecommons.org/licenses/by/4.0/
          methodology
          Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
          metric_kind
          tau2-bench Verified Airline · Accuracy
          rank_method
          competition rank among reported evaluations in identical conditions, including unlinked observations
          sample_size
          150
          source_file
          benchmark-leaderboard.json
          source_page
          https://openrouter.ai/benchmarks/tau2-bench-airline
          measurements
          accuracy
          0.7244443333333334
          accuracy_std_dev
          0.02199873172606905
          cost_per_task_usd
          0.12152117999999999
          output_tokens_per_task
          54771.27333333333
          latency_seconds_per_task
          471.1736333333334
          published_at
          2026-11-16T01:46:02.653Z
          snapshot_date
          2026-11-16
          source_revision
          7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
          transformations
          TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
          metric_population
          27
          benchmark_evaluation
          true
          openrouter_permaslug
          openai/gpt-5-mini-2025-08-07
          source model id
          openai/gpt-5-mini-2025-08-07
          Original result ↗

          Kaggle Benchmarks

          68.243%

          source id
          kaggleBenchmarks
          leaderboard name
          AssetOpsBench · Elimination Accuracy
          dimension
          reasoning
          metric
          AssetOpsBench · Elimination Accuracy
          rank
          10
          aggregation scope
          kaggle
          true
          status
          published
          license
          Apache-2.0
          direction
          higherIsBetter
          conditions
          task
          id
          1041
          name
          Elimination Accuracy
          version
          1
          sort_order
          DESCENDING
          display_type
          percentages
          benchmark
          id
          243
          name
          AssetOpsBench
          type
          INDIVIDUAL
          owner
          ibm-research
          version
          1
          categories
          • evaluation
          • general knowledge and reasoning
          version_id
          222
          maintainer_tier
          Kaggle-maintained
          maintenance_level
          KAGGLE_MAINTAINED
          candidate
          candidate_class
          modelVersion
          record_kind
          aggregate
          attribution
          Kaggle · ibm-research · AssetOpsBench
          license_url
          https://www.apache.org/licenses/LICENSE-2.0
          metric_kind
          AssetOpsBench · Elimination Accuracy
          rank_method
          competition rank among reported evaluations in identical conditions, including unlinked observations
          source_file
          222/leaderboard.json
          source_page
          https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
          measurements
          • name
            Elimination Accuracy
            unit
            percent
            scale
            1
            metric
            AssetOpsBench · Elimination Accuracy
            result
            resultCase
            numericResult
            booleanResult
            false
            numericResult
            value
            0.682427258805513
            standardDeviation
            0
            confidenceInterval
            0
            hasStandardDeviation
            false
            hasConfidenceInterval
            false
            hasUnevenConfidenceInterval
            false
            taskVersionId
            0
            evaluationDate
            2025-11-22T14:59:08.026672Z
            hasBooleanResult
            false
            hasNumericResult
            true
            hasTaskVersionId
            false
            hasEvaluationDate
            true
            numericResultNullable
            value
            0.682427258805513
            standardDeviation
            0
            confidenceInterval
            0
            hasStandardDeviation
            false
            hasConfidenceInterval
            false
            hasUnevenConfidenceInterval
            false
            hasNumericResultPublic
            false
            customAdditionalResults
              hasNumericResultPrivate
              false
              task_id
              1041
              task_url
              /benchmarks/tasks/benchmarkler/failuresensoriq-eliminationaccuracy-benchmark-task
              sort_order
              DESCENDING
              source_name
              Elimination Accuracy
              display_type
              percentages
              task_version
              1
              task_display_type
              RAW_VALUES
              normalization_status
              normalized
            published_at
            2025-12-01T22:15:26.261663300Z
            candidate_class
            modelVersion
            source_revision
            b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
            publisher_anchor
            openai/gpt-5-mini-2025-08-07
            metric_population
            25
            benchmark_evaluation
            true
            task_metadata_source
            benchmarkVersion
            candidate_metadata_source
            benchmarkVersionMappings
            evaluated at
            2025-11-22T14:59:08.026Z
            source model id
            GPT-5 mini
            Original result ↗

            Kaggle Benchmarks

            65.456%

            source id
            kaggleBenchmarks
            leaderboard name
            AssetOpsBench · F-Score
            dimension
            reasoning
            metric
            AssetOpsBench · F-Score
            rank
            10
            aggregation scope
            kaggle
            true
            status
            published
            license
            Apache-2.0
            direction
            higherIsBetter
            conditions
            task
            id
            1040
            name
            F-Score
            version
            1
            sort_order
            DESCENDING
            display_type
            percentages
            benchmark
            id
            243
            name
            AssetOpsBench
            type
            INDIVIDUAL
            owner
            ibm-research
            version
            1
            categories
            • evaluation
            • general knowledge and reasoning
            version_id
            222
            maintainer_tier
            Kaggle-maintained
            maintenance_level
            KAGGLE_MAINTAINED
            candidate
            candidate_class
            modelVersion
            record_kind
            aggregate
            attribution
            Kaggle · ibm-research · AssetOpsBench
            license_url
            https://www.apache.org/licenses/LICENSE-2.0
            metric_kind
            AssetOpsBench · F-Score
            rank_method
            competition rank among reported evaluations in identical conditions, including unlinked observations
            source_file
            222/leaderboard.json
            source_page
            https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
            measurements
            • name
              F-Score
              unit
              percent
              scale
              1
              metric
              AssetOpsBench · F-Score
              result
              resultCase
              numericResult
              booleanResult
              false
              numericResult
              value
              0.6545590994371482
              standardDeviation
              0
              confidenceInterval
              0
              hasStandardDeviation
              false
              hasConfidenceInterval
              false
              hasUnevenConfidenceInterval
              false
              taskVersionId
              0
              evaluationDate
              2025-11-22T14:27:16.736904Z
              hasBooleanResult
              false
              hasNumericResult
              true
              hasTaskVersionId
              false
              hasEvaluationDate
              true
              numericResultNullable
              value
              0.6545590994371482
              standardDeviation
              0
              confidenceInterval
              0
              hasStandardDeviation
              false
              hasConfidenceInterval
              false
              hasUnevenConfidenceInterval
              false
              hasNumericResultPublic
              false
              customAdditionalResults
                hasNumericResultPrivate
                false
                task_id
                1040
                task_url
                /benchmarks/tasks/benchmarkler/failuresensoriq-fscore-benchmark-task
                sort_order
                DESCENDING
                source_name
                F-Score
                display_type
                percentages
                task_version
                1
                task_display_type
                RAW_VALUES
                normalization_status
                normalized
              published_at
              2025-12-01T22:15:26.261663300Z
              candidate_class
              modelVersion
              source_revision
              b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
              publisher_anchor
              openai/gpt-5-mini-2025-08-07
              metric_population
              25
              benchmark_evaluation
              true
              task_metadata_source
              benchmarkVersion
              candidate_metadata_source
              benchmarkVersionMappings
              evaluated at
              2025-11-22T14:27:16.736Z
              source model id
              GPT-5 mini
              Original result ↗

              Kaggle Benchmarks

              65.292%

              source id
              kaggleBenchmarks
              leaderboard name
              AssetOpsBench · Score
              dimension
              reasoning
              metric
              AssetOpsBench · Score
              rank
              10
              aggregation scope
              kaggle
              true
              status
              published
              license
              Apache-2.0
              direction
              higherIsBetter
              conditions
              task
              id
              487619
              name
              Score
              version
              5
              sort_order
              DESCENDING
              display_type
              percentages
              benchmark
              id
              243
              name
              AssetOpsBench
              type
              INDIVIDUAL
              owner
              ibm-research
              version
              1
              categories
              • evaluation
              • general knowledge and reasoning
              version_id
              222
              maintainer_tier
              Kaggle-maintained
              maintenance_level
              KAGGLE_MAINTAINED
              candidate
              candidate_class
              modelVersion
              record_kind
              aggregate
              attribution
              Kaggle · ibm-research · AssetOpsBench
              license_url
              https://www.apache.org/licenses/LICENSE-2.0
              metric_kind
              AssetOpsBench · Score
              rank_method
              competition rank among reported evaluations in identical conditions, including unlinked observations
              source_file
              222/leaderboard.json
              source_page
              https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
              measurements
              • name
                Score
                unit
                percent
                scale
                1
                metric
                AssetOpsBench · Score
                result
                resultCase
                numericResult
                booleanResult
                false
                numericResult
                value
                0.6529183852018497
                standardDeviation
                0
                confidenceInterval
                0
                hasStandardDeviation
                false
                hasConfidenceInterval
                false
                hasUnevenConfidenceInterval
                false
                taskVersionId
                0
                evaluationDate
                2025-11-22T04:59:55.345713Z
                hasBooleanResult
                false
                hasNumericResult
                true
                hasTaskVersionId
                false
                hasEvaluationDate
                true
                numericResultNullable
                value
                0.6529183852018497
                standardDeviation
                0
                confidenceInterval
                0
                hasStandardDeviation
                false
                hasConfidenceInterval
                false
                hasUnevenConfidenceInterval
                false
                hasNumericResultPublic
                false
                customAdditionalResults
                  hasNumericResultPrivate
                  false
                  task_id
                  487619
                  task_url
                  /benchmarks/tasks/benchmarkler/failuresensoriq-main-benchmark-task
                  sort_order
                  DESCENDING
                  source_name
                  Score
                  display_type
                  percentages
                  task_version
                  5
                  task_display_type
                  PERCENTAGES
                  normalization_status
                  normalized
                published_at
                2025-12-01T22:15:26.261663300Z
                candidate_class
                modelVersion
                source_revision
                b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
                publisher_anchor
                openai/gpt-5-mini-2025-08-07
                metric_population
                25
                benchmark_evaluation
                true
                task_metadata_source
                benchmarkVersion
                candidate_metadata_source
                benchmarkVersionMappings
                evaluated at
                2025-11-22T04:59:55.345Z
                source model id
                GPT-5 mini
                Original result ↗

                Kaggle Benchmarks

                56.843%

                source id
                kaggleBenchmarks
                leaderboard name
                AssetOpsBench · Consistency
                dimension
                reasoning
                metric
                AssetOpsBench · Consistency
                rank
                11
                aggregation scope
                kaggle
                true
                status
                published
                license
                Apache-2.0
                direction
                higherIsBetter
                conditions
                task
                id
                1045
                name
                Consistency
                version
                1
                sort_order
                DESCENDING
                display_type
                percentages
                benchmark
                id
                243
                name
                AssetOpsBench
                type
                INDIVIDUAL
                owner
                ibm-research
                version
                1
                categories
                • evaluation
                • general knowledge and reasoning
                version_id
                222
                maintainer_tier
                Kaggle-maintained
                maintenance_level
                KAGGLE_MAINTAINED
                candidate
                candidate_class
                modelVersion
                record_kind
                aggregate
                attribution
                Kaggle · ibm-research · AssetOpsBench
                license_url
                https://www.apache.org/licenses/LICENSE-2.0
                metric_kind
                AssetOpsBench · Consistency
                rank_method
                competition rank among reported evaluations in identical conditions, including unlinked observations
                source_file
                222/leaderboard.json
                source_page
                https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
                measurements
                • name
                  Consistency
                  unit
                  percent
                  scale
                  1
                  metric
                  AssetOpsBench · Consistency
                  result
                  resultCase
                  numericResult
                  booleanResult
                  false
                  numericResult
                  value
                  0.5684289463817023
                  standardDeviation
                  0
                  confidenceInterval
                  0
                  hasStandardDeviation
                  false
                  hasConfidenceInterval
                  false
                  hasUnevenConfidenceInterval
                  false
                  taskVersionId
                  0
                  evaluationDate
                  2025-11-24T03:35:02.651676Z
                  hasBooleanResult
                  false
                  hasNumericResult
                  true
                  hasTaskVersionId
                  false
                  hasEvaluationDate
                  true
                  numericResultNullable
                  value
                  0.5684289463817023
                  standardDeviation
                  0
                  confidenceInterval
                  0
                  hasStandardDeviation
                  false
                  hasConfidenceInterval
                  false
                  hasUnevenConfidenceInterval
                  false
                  hasNumericResultPublic
                  false
                  customAdditionalResults
                    hasNumericResultPrivate
                    false
                    task_id
                    1045
                    task_url
                    /benchmarks/tasks/benchmarkler/failuresensoriq-consistency-benchmark-task
                    sort_order
                    DESCENDING
                    source_name
                    Consistency
                    display_type
                    percentages
                    task_version
                    1
                    task_display_type
                    RAW_VALUES
                    normalization_status
                    normalized
                  published_at
                  2025-12-01T22:15:26.261663300Z
                  candidate_class
                  modelVersion
                  source_revision
                  b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
                  publisher_anchor
                  openai/gpt-5-mini-2025-08-07
                  metric_population
                  25
                  benchmark_evaluation
                  true
                  task_metadata_source
                  benchmarkVersion
                  candidate_metadata_source
                  benchmarkVersionMappings
                  evaluated at
                  2025-11-24T03:35:02.651Z
                  source model id
                  GPT-5 mini
                  Original result ↗

                  BFCL

                  91.01%

                  source id
                  bfcl
                  leaderboard name
                  BFCL Irrelevance Detection
                  dimension
                  toolUse
                  metric
                  Irrelevance detection
                  rank
                  12
                  Original result ↗

                  Kaggle Benchmarks

                  538.583

                  source id
                  kaggleBenchmarks
                  leaderboard name
                  Chess Suite · Text Input
                  dimension
                  general
                  metric
                  Chess Suite · Text Input
                  rank
                  13
                  aggregation scope
                  kaggle
                  true
                  status
                  published
                  license
                  Apache-2.0
                  direction
                  higherIsBetter
                  conditions
                  task
                  id
                  1446
                  name
                  Text Input
                  version
                  1
                  sort_order
                  DESCENDING
                  display_type
                  counts
                  benchmark
                  id
                  86
                  name
                  Chess Suite
                  type
                  SUITE
                  owner
                  kaggle
                  version
                  2
                  categories
                    version_id
                    437
                    maintainer_tier
                    Kaggle-published
                    candidate
                    candidate_class
                    modelVersion
                    record_kind
                    aggregate
                    attribution
                    Kaggle · kaggle · Chess Suite
                    license_url
                    https://www.apache.org/licenses/LICENSE-2.0
                    metric_kind
                    Chess Suite · Text Input
                    rank_method
                    competition rank among reported evaluations in identical conditions, including unlinked observations
                    source_file
                    437/leaderboard.json
                    source_page
                    https://www.kaggle.com/benchmarks/kaggle/chess-suite/versions/2
                    measurements
                    • name
                      Text Input
                      unit
                      score
                      scale
                      1
                      metric
                      Chess Suite · Text Input
                      result
                      resultCase
                      numericResult
                      booleanResult
                      false
                      numericResult
                      value
                      538.5827064346333
                      standardDeviation
                      0
                      confidenceInterval
                      0
                      hasStandardDeviation
                      false
                      hasConfidenceInterval
                      false
                      unevenConfidenceInterval
                      plus
                      43.13619464476801
                      minus
                      56.4977525774118
                      hasUnevenConfidenceInterval
                      true
                      taskVersionId
                      0
                      evaluationDate
                      2026-11-11T20:03:32.6840746Z
                      hasBooleanResult
                      false
                      hasNumericResult
                      true
                      hasTaskVersionId
                      false
                      hasEvaluationDate
                      true
                      numericResultNullable
                      value
                      538.5827064346333
                      standardDeviation
                      0
                      confidenceInterval
                      0
                      hasStandardDeviation
                      false
                      hasConfidenceInterval
                      false
                      unevenConfidenceInterval
                      plus
                      43.13619464476801
                      minus
                      56.4977525774118
                      hasUnevenConfidenceInterval
                      true
                      hasNumericResultPublic
                      false
                      customAdditionalResults
                        hasNumericResultPrivate
                        false
                        task_id
                        1446
                        task_url
                        /benchmarks/kaggle/chess-text/versions/2
                        sort_order
                        DESCENDING
                        source_name
                        Text Input
                        display_type
                        counts
                        task_version
                        1
                        task_display_type
                        COUNTS
                        normalization_status
                        normalized
                      published_at
                      2026-02-02T15:46:09.865215700Z
                      candidate_class
                      modelVersion
                      source_revision
                      b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
                      publisher_anchor
                      openai/gpt-5-mini-2025-08-07
                      metric_population
                      19
                      benchmark_evaluation
                      true
                      task_metadata_source
                      benchmarkVersion
                      candidate_metadata_source
                      benchmarkVersionMappings
                      evaluated at
                      2026-11-11T20:03:32.684Z
                      source model id
                      GPT-5 mini
                      confidence lower
                      482.08495385722154
                      confidence upper
                      581.7189010794013
                      Original result ↗

                      Kaggle Benchmarks

                      386.526

                      source id
                      kaggleBenchmarks
                      leaderboard name
                      Five in a Row · Score
                      dimension
                      general
                      metric
                      Five in a Row · Score
                      rank
                      13
                      aggregation scope
                      kaggle
                      true
                      status
                      published
                      license
                      Apache-2.0
                      direction
                      higherIsBetter
                      conditions
                      task
                      id
                      5444
                      name
                      Score
                      version
                      1
                      sort_order
                      DESCENDING
                      display_type
                      counts
                      benchmark
                      id
                      2150
                      name
                      Five in a Row
                      type
                      GAME
                      owner
                      kaggle
                      version
                      1
                      categories
                        version_id
                        2163
                        maintainer_tier
                        Kaggle-published
                        candidate
                        candidate_class
                        modelVersion
                        collection
                        kaggleGameArena
                        record_kind
                        aggregate
                        game_arena
                        true
                        attribution
                        Kaggle · kaggle · Five in a Row
                        license_url
                        https://www.apache.org/licenses/LICENSE-2.0
                        metric_kind
                        Five in a Row · Score
                        rank_method
                        competition rank among reported evaluations in identical conditions, including unlinked observations
                        source_file
                        2163/leaderboard.json
                        source_page
                        https://www.kaggle.com/benchmarks/kaggle/five-in-a-row/versions/1
                        measurements
                        • name
                          Score
                          unit
                          score
                          scale
                          1
                          metric
                          Five in a Row · Score
                          result
                          resultCase
                          numericResult
                          booleanResult
                          false
                          numericResult
                          value
                          386.52559338948436
                          standardDeviation
                          0
                          confidenceInterval
                          0
                          hasStandardDeviation
                          false
                          hasConfidenceInterval
                          false
                          unevenConfidenceInterval
                          plus
                          45.32339204248149
                          minus
                          57.49538551852601
                          hasUnevenConfidenceInterval
                          true
                          taskVersionId
                          0
                          hasBooleanResult
                          false
                          hasNumericResult
                          true
                          hasTaskVersionId
                          false
                          hasEvaluationDate
                          false
                          numericResultNullable
                          value
                          386.52559338948436
                          standardDeviation
                          0
                          confidenceInterval
                          0
                          hasStandardDeviation
                          false
                          hasConfidenceInterval
                          false
                          unevenConfidenceInterval
                          plus
                          45.32339204248149
                          minus
                          57.49538551852601
                          hasUnevenConfidenceInterval
                          true
                          hasNumericResultPublic
                          false
                          customAdditionalResults
                            hasNumericResultPrivate
                            false
                            task_id
                            5444
                            sort_order
                            DESCENDING
                            source_name
                            Score
                            display_type
                            counts
                            task_version
                            1
                            task_display_type
                            COUNTS
                            normalization_status
                            normalized
                          published_at
                          2026-04-30T16:37:18.401609400Z
                          candidate_class
                          modelVersion
                          methodology_url
                          https://www.kaggle.com/game-arena-faq
                          source_revision
                          b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
                          publisher_anchor
                          openai/gpt-5-mini-2025-08-07
                          game_arena_rating
                          Game-specific rating; compare within this game and version
                          metric_population
                          20
                          benchmark_evaluation
                          true
                          task_metadata_source
                          benchmarkVersion
                          candidate_metadata_source
                          benchmarkVersionMappings
                          source model id
                          GPT-5 mini
                          confidence lower
                          329.03020787095835
                          confidence upper
                          431.84898543196584
                          Original result ↗

                          Kaggle Benchmarks

                          62.43%

                          source id
                          kaggleBenchmarks
                          leaderboard name
                          AssetOpsBench · Pert. Simple Accuracy
                          dimension
                          reasoning
                          metric
                          AssetOpsBench · Pert. Simple Accuracy
                          rank
                          13
                          aggregation scope
                          kaggle
                          true
                          status
                          published
                          license
                          Apache-2.0
                          direction
                          higherIsBetter
                          conditions
                          task
                          id
                          1043
                          name
                          Pert. Simple Accuracy
                          version
                          1
                          sort_order
                          DESCENDING
                          display_type
                          percentages
                          benchmark
                          id
                          243
                          name
                          AssetOpsBench
                          type
                          INDIVIDUAL
                          owner
                          ibm-research
                          version
                          1
                          categories
                          • evaluation
                          • general knowledge and reasoning
                          version_id
                          222
                          maintainer_tier
                          Kaggle-maintained
                          maintenance_level
                          KAGGLE_MAINTAINED
                          candidate
                          candidate_class
                          modelVersion
                          record_kind
                          aggregate
                          attribution
                          Kaggle · ibm-research · AssetOpsBench
                          license_url
                          https://www.apache.org/licenses/LICENSE-2.0
                          metric_kind
                          AssetOpsBench · Pert. Simple Accuracy
                          rank_method
                          competition rank among reported evaluations in identical conditions, including unlinked observations
                          source_file
                          222/leaderboard.json
                          source_page
                          https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
                          measurements
                          • name
                            Pert. Simple Accuracy
                            unit
                            percent
                            scale
                            1
                            metric
                            AssetOpsBench · Pert. Simple Accuracy
                            result
                            resultCase
                            numericResult
                            booleanResult
                            false
                            numericResult
                            value
                            0.6242969628796401
                            standardDeviation
                            0
                            confidenceInterval
                            0
                            hasStandardDeviation
                            false
                            hasConfidenceInterval
                            false
                            hasUnevenConfidenceInterval
                            false
                            taskVersionId
                            0
                            evaluationDate
                            2025-11-23T14:35:55.116219Z
                            hasBooleanResult
                            false
                            hasNumericResult
                            true
                            hasTaskVersionId
                            false
                            hasEvaluationDate
                            true
                            numericResultNullable
                            value
                            0.6242969628796401
                            standardDeviation
                            0
                            confidenceInterval
                            0
                            hasStandardDeviation
                            false
                            hasConfidenceInterval
                            false
                            hasUnevenConfidenceInterval
                            false
                            hasNumericResultPublic
                            false
                            customAdditionalResults
                              hasNumericResultPrivate
                              false
                              task_id
                              1043
                              task_url
                              /benchmarks/tasks/benchmarkler/failuresensoriq-perturbationsimple-benchmark-task
                              sort_order
                              DESCENDING
                              source_name
                              Pert. Simple Accuracy
                              display_type
                              percentages
                              task_version
                              1
                              task_display_type
                              RAW_VALUES
                              normalization_status
                              normalized
                            published_at
                            2025-12-01T22:15:26.261663300Z
                            candidate_class
                            modelVersion
                            source_revision
                            b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
                            publisher_anchor
                            openai/gpt-5-mini-2025-08-07
                            metric_population
                            25
                            benchmark_evaluation
                            true
                            task_metadata_source
                            benchmarkVersion
                            candidate_metadata_source
                            benchmarkVersionMappings
                            evaluated at
                            2025-11-23T14:35:55.116Z
                            source model id
                            GPT-5 mini
                            Original result ↗

                            SWE-bench

                            39.7%

                            source id
                            sweBench
                            leaderboard name
                            SWE-bench Multilingual
                            dimension
                            coding
                            metric
                            Resolved tasks
                            rank
                            13
                            sample size
                            300
                            evaluated at
                            2026-02-13T00:00:00.000Z
                            Original result ↗

                            Kaggle Benchmarks

                            59.843%

                            source id
                            kaggleBenchmarks
                            leaderboard name
                            AssetOpsBench · Pert. Complex Accuracy
                            dimension
                            reasoning
                            metric
                            AssetOpsBench · Pert. Complex Accuracy
                            rank
                            14
                            aggregation scope
                            kaggle
                            true
                            status
                            published
                            license
                            Apache-2.0
                            direction
                            higherIsBetter
                            conditions
                            task
                            id
                            1044
                            name
                            Pert. Complex Accuracy
                            version
                            1
                            sort_order
                            DESCENDING
                            display_type
                            percentages
                            benchmark
                            id
                            243
                            name
                            AssetOpsBench
                            type
                            INDIVIDUAL
                            owner
                            ibm-research
                            version
                            1
                            categories
                            • evaluation
                            • general knowledge and reasoning
                            version_id
                            222
                            maintainer_tier
                            Kaggle-maintained
                            maintenance_level
                            KAGGLE_MAINTAINED
                            candidate
                            candidate_class
                            modelVersion
                            record_kind
                            aggregate
                            attribution
                            Kaggle · ibm-research · AssetOpsBench
                            license_url
                            https://www.apache.org/licenses/LICENSE-2.0
                            metric_kind
                            AssetOpsBench · Pert. Complex Accuracy
                            rank_method
                            competition rank among reported evaluations in identical conditions, including unlinked observations
                            source_file
                            222/leaderboard.json
                            source_page
                            https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
                            measurements
                            • name
                              Pert. Complex Accuracy
                              unit
                              percent
                              scale
                              1
                              metric
                              AssetOpsBench · Pert. Complex Accuracy
                              result
                              resultCase
                              numericResult
                              booleanResult
                              false
                              numericResult
                              value
                              0.5984251968503937
                              standardDeviation
                              0
                              confidenceInterval
                              0
                              hasStandardDeviation
                              false
                              hasConfidenceInterval
                              false
                              hasUnevenConfidenceInterval
                              false
                              taskVersionId
                              0
                              evaluationDate
                              2025-11-24T03:34:12.690737Z
                              hasBooleanResult
                              false
                              hasNumericResult
                              true
                              hasTaskVersionId
                              false
                              hasEvaluationDate
                              true
                              numericResultNullable
                              value
                              0.5984251968503937
                              standardDeviation
                              0
                              confidenceInterval
                              0
                              hasStandardDeviation
                              false
                              hasConfidenceInterval
                              false
                              hasUnevenConfidenceInterval
                              false
                              hasNumericResultPublic
                              false
                              customAdditionalResults
                                hasNumericResultPrivate
                                false
                                task_id
                                1044
                                task_url
                                /benchmarks/tasks/benchmarkler/failuresensoriq-perturbationcomplex-benchmark-task
                                sort_order
                                DESCENDING
                                source_name
                                Pert. Complex Accuracy
                                display_type
                                percentages
                                task_version
                                1
                                task_display_type
                                RAW_VALUES
                                normalization_status
                                normalized
                              published_at
                              2025-12-01T22:15:26.261663300Z
                              candidate_class
                              modelVersion
                              source_revision
                              b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
                              publisher_anchor
                              openai/gpt-5-mini-2025-08-07
                              metric_population
                              25
                              benchmark_evaluation
                              true
                              task_metadata_source
                              benchmarkVersion
                              candidate_metadata_source
                              benchmarkVersionMappings
                              evaluated at
                              2025-11-24T03:34:12.690Z
                              source model id
                              GPT-5 mini
                              Original result ↗

                              BFCL

                              93.75%

                              source id
                              bfcl
                              leaderboard name
                              BFCL Relevance Detection
                              dimension
                              toolUse
                              metric
                              Relevance detection
                              rank
                              15
                              Original result ↗

                              Kaggle Benchmarks

                              59.047%

                              source id
                              kaggleBenchmarks
                              leaderboard name
                              AssetOpsBench · Selection Accuracy
                              dimension
                              reasoning
                              metric
                              AssetOpsBench · Selection Accuracy
                              rank
                              15
                              aggregation scope
                              kaggle
                              true
                              status
                              published
                              license
                              Apache-2.0
                              direction
                              higherIsBetter
                              conditions
                              task
                              id
                              1042
                              name
                              Selection Accuracy
                              version
                              1
                              sort_order
                              DESCENDING
                              display_type
                              percentages
                              benchmark
                              id
                              243
                              name
                              AssetOpsBench
                              type
                              INDIVIDUAL
                              owner
                              ibm-research
                              version
                              1
                              categories
                              • evaluation
                              • general knowledge and reasoning
                              version_id
                              222
                              maintainer_tier
                              Kaggle-maintained
                              maintenance_level
                              KAGGLE_MAINTAINED
                              candidate
                              candidate_class
                              modelVersion
                              record_kind
                              aggregate
                              attribution
                              Kaggle · ibm-research · AssetOpsBench
                              license_url
                              https://www.apache.org/licenses/LICENSE-2.0
                              metric_kind
                              AssetOpsBench · Selection Accuracy
                              rank_method
                              competition rank among reported evaluations in identical conditions, including unlinked observations
                              source_file
                              222/leaderboard.json
                              source_page
                              https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
                              measurements
                              • name
                                Selection Accuracy
                                unit
                                percent
                                scale
                                1
                                metric
                                AssetOpsBench · Selection Accuracy
                                result
                                resultCase
                                numericResult
                                booleanResult
                                false
                                numericResult
                                value
                                0.590465872156013
                                standardDeviation
                                0
                                confidenceInterval
                                0
                                hasStandardDeviation
                                false
                                hasConfidenceInterval
                                false
                                hasUnevenConfidenceInterval
                                false
                                taskVersionId
                                0
                                evaluationDate
                                2025-11-22T14:59:36.126412Z
                                hasBooleanResult
                                false
                                hasNumericResult
                                true
                                hasTaskVersionId
                                false
                                hasEvaluationDate
                                true
                                numericResultNullable
                                value
                                0.590465872156013
                                standardDeviation
                                0
                                confidenceInterval
                                0
                                hasStandardDeviation
                                false
                                hasConfidenceInterval
                                false
                                hasUnevenConfidenceInterval
                                false
                                hasNumericResultPublic
                                false
                                customAdditionalResults
                                  hasNumericResultPrivate
                                  false
                                  task_id
                                  1042
                                  task_url
                                  /benchmarks/tasks/benchmarkler/failuresensoriq-selectionaccuracy-benchmark-task
                                  sort_order
                                  DESCENDING
                                  source_name
                                  Selection Accuracy
                                  display_type
                                  percentages
                                  task_version
                                  1
                                  task_display_type
                                  RAW_VALUES
                                  normalization_status
                                  normalized
                                published_at
                                2025-12-01T22:15:26.261663300Z
                                candidate_class
                                modelVersion
                                source_revision
                                b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
                                publisher_anchor
                                openai/gpt-5-mini-2025-08-07
                                metric_population
                                25
                                benchmark_evaluation
                                true
                                task_metadata_source
                                benchmarkVersion
                                candidate_metadata_source
                                benchmarkVersionMappings
                                evaluated at
                                2025-11-22T14:59:36.126Z
                                source model id
                                GPT-5 mini
                                Original result ↗

                                LMArena

                                1,216.049

                                source id
                                lmarena
                                leaderboard name
                                LMArena Vision Captioning
                                dimension
                                multimodal
                                metric
                                Arena rating
                                rank
                                17
                                sample size
                                282
                                evaluated at
                                2026-11-09T00:00:00.000Z
                                source model id
                                GPT-5 mini (High)
                                confidence lower
                                1179.443271087021
                                confidence upper
                                1252.6544769355569
                                Original result ↗

                                OpenRouter Benchmarks

                                80.64%

                                source id
                                openRouterBenchmarks
                                leaderboard name
                                GPQA Diamond · Accuracy · OpenAI
                                dimension
                                knowledge
                                metric
                                GPQA Diamond · Accuracy
                                rank
                                18
                                sample size
                                396
                                aggregation scope
                                status
                                published
                                harness
                                url
                                https://github.com/OpenRouterTeam/benchmark-harness
                                name
                                OpenRouter benchmark harness
                                direction
                                higherIsBetter
                                run_count
                                2
                                conditions
                                window
                                newest 90 days; successful visible nonzero runs
                                dataset
                                benchmark-leaderboard
                                benchmark
                                id
                                gpqa_diamond
                                name
                                GPQA Diamond
                                record_kind
                                aggregate
                                provider_name
                                OpenAI
                                attribution
                                Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
                                last_run_at
                                2026-10-01T19:26:25.385Z
                                license_url
                                https://creativecommons.org/licenses/by/4.0/
                                methodology
                                Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
                                metric_kind
                                GPQA Diamond · Accuracy
                                rank_method
                                competition rank among reported evaluations in identical conditions, including unlinked observations
                                sample_size
                                396
                                source_file
                                benchmark-leaderboard.json
                                source_page
                                https://openrouter.ai/benchmarks/gpqa-diamond
                                measurements
                                accuracy
                                0.806397
                                accuracy_std_dev
                                0.003367000000000009
                                cost_per_task_usd
                                0.04417995707070707
                                output_tokens_per_task
                                21993.772727272728
                                latency_seconds_per_task
                                210.13046464646465
                                published_at
                                2026-11-16T01:46:02.653Z
                                snapshot_date
                                2026-11-16
                                source_revision
                                7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
                                transformations
                                TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
                                metric_population
                                26
                                benchmark_evaluation
                                true
                                openrouter_permaslug
                                openai/gpt-5-mini-2025-08-07
                                source model id
                                openai/gpt-5-mini-2025-08-07
                                Original result ↗

                                Published prices

                                1–20 / 42

                                gpt-5-mini ↗

                                $0.02

                                Inference provider
                                cheaperInference
                                Platform
                                Cheaper Inference
                                Unit
                                cache_read_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                zdr
                                false
                                protocol
                                chat_completions
                                service_tier
                                standard
                                Billing label
                                Cached input tokens (per 1M)

                                gpt-5-mini ↗

                                $0.00

                                Inference provider
                                cheaperInference
                                Platform
                                Cheaper Inference
                                Unit
                                cache_write_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                zdr
                                false
                                protocol
                                chat_completions
                                service_tier
                                standard
                                Billing label
                                Cache write, 5 minutes (per 1M)

                                gpt-5-mini ↗

                                $0.16

                                Inference provider
                                cheaperInference
                                Platform
                                Cheaper Inference
                                Unit
                                input_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                zdr
                                false
                                protocol
                                chat_completions
                                service_tier
                                standard
                                Billing label
                                Input tokens (per 1M)

                                gpt-5-mini ↗

                                $1.30

                                Inference provider
                                cheaperInference
                                Platform
                                Cheaper Inference
                                Unit
                                output_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                zdr
                                false
                                protocol
                                chat_completions
                                service_tier
                                standard
                                Billing label
                                Output tokens (per 1M)

                                openai/gpt-5-mini ↗

                                $0.03

                                Inference provider
                                cloudflareWorkersAI
                                Platform
                                OpenAI
                                Unit
                                cache_read_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                Billing label
                                Cached input tokens (per 1M)
                                Pricing via
                                Cloudflare AI Gateway

                                openai/gpt-5-mini ↗

                                $0.25

                                Inference provider
                                cloudflareWorkersAI
                                Platform
                                OpenAI
                                Unit
                                input_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                Billing label
                                Input tokens (per 1M)
                                Pricing via
                                Cloudflare AI Gateway

                                openai/gpt-5-mini ↗

                                $2.00

                                Inference provider
                                cloudflareWorkersAI
                                Platform
                                OpenAI
                                Unit
                                output_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                Billing label
                                Output tokens (per 1M)
                                Pricing via
                                Cloudflare AI Gateway

                                openai/gpt-5-mini ↗

                                $0.02

                                Inference provider
                                openRouter
                                Platform
                                OpenRouter
                                Unit
                                cache_read_tokens_per_million
                                Currency
                                USD
                                Billing conditions

                                openai/gpt-5-mini ↗

                                $0.25

                                Inference provider
                                openRouter
                                Platform
                                OpenRouter
                                Unit
                                input_tokens_per_million
                                Currency
                                USD
                                Billing conditions

                                openai/gpt-5-mini ↗

                                $2.00

                                Inference provider
                                openRouter
                                Platform
                                OpenRouter
                                Unit
                                output_tokens_per_million
                                Currency
                                USD
                                Billing conditions

                                openai/gpt-5-mini ↗

                                $0.01

                                Inference provider
                                openRouter
                                Platform
                                OpenRouter
                                Unit
                                web_search
                                Currency
                                USD
                                Billing conditions

                                openai/gpt-5-mini:batch ↗

                                $0.01

                                Inference provider
                                openRouter
                                Platform
                                OpenRouter
                                Unit
                                cache_read_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                mode
                                batch

                                openai/gpt-5-mini:batch ↗

                                $0.13

                                Inference provider
                                openRouter
                                Platform
                                OpenRouter
                                Unit
                                input_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                mode
                                batch

                                openai/gpt-5-mini:batch ↗

                                $1.00

                                Inference provider
                                openRouter
                                Platform
                                OpenRouter
                                Unit
                                output_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                mode
                                batch

                                openai/gpt-5-mini ↗

                                $0.03

                                Inference provider
                                vercelAIGatewayCatalog
                                Platform
                                azure
                                Unit
                                cache_read_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                endpoint
                                azure | openai/gpt-5-mini
                                model_type
                                language
                                billing_scope
                                via Vercel AI Gateway
                                Billing label
                                Cached input / 1M
                                Pricing via
                                Vercel AI Gateway

                                openai/gpt-5-mini ↗

                                $0.25

                                Inference provider
                                vercelAIGatewayCatalog
                                Platform
                                azure
                                Unit
                                input_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                endpoint
                                azure | openai/gpt-5-mini
                                model_type
                                language
                                billing_scope
                                via Vercel AI Gateway
                                Billing label
                                Input tokens / 1M
                                Pricing via
                                Vercel AI Gateway

                                openai/gpt-5-mini ↗

                                $2.00

                                Inference provider
                                vercelAIGatewayCatalog
                                Platform
                                azure
                                Unit
                                output_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                endpoint
                                azure | openai/gpt-5-mini
                                model_type
                                language
                                billing_scope
                                via Vercel AI Gateway
                                Billing label
                                Output tokens / 1M
                                Pricing via
                                Vercel AI Gateway

                                openai/gpt-5-mini ↗

                                $0.01

                                Inference provider
                                vercelAIGatewayCatalog
                                Platform
                                azure
                                Unit
                                request
                                Currency
                                USD
                                Billing conditions
                                charge
                                web_search
                                endpoint
                                azure | openai/gpt-5-mini
                                model_type
                                language
                                billing_scope
                                via Vercel AI Gateway
                                Billing label
                                Web search
                                Pricing via
                                Vercel AI Gateway

                                openai/gpt-5-mini ↗

                                $0.02

                                Inference provider
                                vercelAIGatewayCatalog
                                Platform
                                openai
                                Unit
                                cache_read_tokens_per_million
                                Currency
                                USD
                                Billing conditions
                                endpoint
                                openai | openai/gpt-5-mini
                                model_type
                                language
                                billing_scope
                                via Vercel AI Gateway
                                Billing label
                                Cached input / 1M
                                Pricing via
                                Vercel AI Gateway

                                Provider specifications & access

                                1–4 / 4

                                OpenAI gpt-5-mini · azure-openai v2025-08-07 ↗

                                source model id
                                azure-openai/gpt-5-mini@2025-08-07
                                hosting
                                foundry-managed-compute
                                platforms
                                • Microsoft Foundry
                                license
                                custom
                                context length
                                400000
                                max input tokens
                                272000
                                max output tokens
                                128000
                                architecture
                                input_modalities
                                • text
                                • image
                                output_modalities
                                • text
                                capabilities
                                • reasoning
                                • toolCalling

                                gpt-5-mini ↗

                                source model id
                                gpt-5-mini
                                hosting
                                gateway
                                platforms
                                • Cheaper Inference
                                context length
                                400000
                                max output tokens
                                128000
                                architecture
                                input_modalities
                                • text
                                • image
                                output_modalities
                                • text
                                capabilities
                                • reasoning
                                • structuredOutputs
                                • toolCalling
                                • visionInput
                                • webSearch

                                GPT-5 mini ↗

                                source model id
                                openai/gpt-5-mini
                                hosting
                                third-party
                                platforms
                                • OpenAI
                                context length
                                128000
                                max output tokens
                                16384
                                architecture
                                input_modalities
                                • text
                                output_modalities
                                • text
                                capabilities

                                  GPT-5 mini ↗

                                  source model id
                                  openai/gpt-5-mini
                                  hosting
                                  vercel-gateway
                                  platforms
                                  • Vercel AI Gateway
                                  context length
                                  400000
                                  max output tokens
                                  128000
                                  architecture
                                  input_modalities
                                  • text
                                  • image
                                  • pdf
                                  output_modalities
                                  • text
                                  capabilities
                                  • promptCaching
                                  • reasoning
                                  • structuredOutputs
                                  • toolCalling
                                  • visionInput
                                  • webSearch

                                  Safety assessments

                                  1–1 / 1

                                  Foundation Model Transparency Index 2025 ↗

                                  35 / 100

                                  source id
                                  stanfordFMTI
                                  canonical model id
                                  openai/gpt-5-mini-2025-08-07
                                  taxonomy
                                  transparency
                                  hazard category
                                  transparency
                                  hazard name
                                  Organization transparency
                                  policy area
                                  OpenAI
                                  assessment type
                                  organization-level disclosure
                                  metric
                                  disclosure_score
                                  result label
                                  35 / 100
                                  sample size
                                  100
                                  updated at
                                  2026-11-09T18:08:05.227Z

                                  Source specification observations

                                  1–15 / 15

                                  azureFoundry ↗

                                  field
                                  context_length
                                  value
                                  400000
                                  normalized value
                                  400000
                                  scope
                                  source-model
                                  source id
                                  azureFoundry
                                  confidence
                                  1

                                  cloudflareWorkersAI ↗

                                  field
                                  context_length
                                  value
                                  128000
                                  normalized value
                                  128000
                                  scope
                                  source-model
                                  source id
                                  cloudflareWorkersAI
                                  confidence
                                  1

                                  openRouter ↗

                                  field
                                  context_length
                                  value
                                  400000
                                  normalized value
                                  400000
                                  scope
                                  source-model
                                  source id
                                  openRouter
                                  confidence
                                  1

                                  openRouter ↗

                                  field
                                  context_length
                                  value
                                  400000
                                  normalized value
                                  400000
                                  scope
                                  source-model
                                  source id
                                  openRouter
                                  confidence
                                  1

                                  vercelAIGatewayCatalog ↗

                                  field
                                  context_length
                                  value
                                  400000
                                  normalized value
                                  400000
                                  scope
                                  source-model
                                  source id
                                  vercelAIGatewayCatalog
                                  confidence
                                  1

                                  openRouter ↗

                                  field
                                  knowledge_cutoff
                                  reported field
                                  knowledge_cutoff
                                  value
                                  2024-05-31
                                  normalized value
                                  2024-05-31
                                  precision
                                  day
                                  scope
                                  source-model
                                  source id
                                  openRouter
                                  confidence
                                  1

                                  openRouter ↗

                                  field
                                  knowledge_cutoff
                                  reported field
                                  knowledge_cutoff
                                  value
                                  2024-05-31
                                  normalized value
                                  2024-05-31
                                  precision
                                  day
                                  scope
                                  source-model
                                  source id
                                  openRouter
                                  confidence
                                  1

                                  vercelAIGatewayCatalog ↗

                                  field
                                  knowledge_cutoff
                                  reported field
                                  knowledge_cutoff
                                  value
                                  2024-05-31
                                  normalized value
                                  2024-05-31
                                  precision
                                  day
                                  scope
                                  source-model
                                  source id
                                  vercelAIGatewayCatalog
                                  confidence
                                  1

                                  azureFoundry ↗

                                  field
                                  max_input_tokens
                                  value
                                  272000
                                  normalized value
                                  272000
                                  scope
                                  source-model
                                  source id
                                  azureFoundry
                                  confidence
                                  1

                                  azureFoundry ↗

                                  field
                                  max_output_tokens
                                  value
                                  128000
                                  normalized value
                                  128000
                                  scope
                                  source-model
                                  source id
                                  azureFoundry
                                  confidence
                                  1

                                  cloudflareWorkersAI ↗

                                  field
                                  max_output_tokens
                                  value
                                  16384
                                  normalized value
                                  16384
                                  scope
                                  source-model
                                  source id
                                  cloudflareWorkersAI
                                  confidence
                                  1

                                  openRouter ↗

                                  field
                                  max_output_tokens
                                  value
                                  128000
                                  normalized value
                                  128000
                                  scope
                                  source-model
                                  source id
                                  openRouter
                                  confidence
                                  1

                                  openRouter ↗

                                  field
                                  max_output_tokens
                                  value
                                  128000
                                  normalized value
                                  128000
                                  scope
                                  source-model
                                  source id
                                  openRouter
                                  confidence
                                  1

                                  vercelAIGatewayCatalog ↗

                                  field
                                  max_output_tokens
                                  value
                                  128000
                                  normalized value
                                  128000
                                  scope
                                  source-model
                                  source id
                                  vercelAIGatewayCatalog
                                  confidence
                                  1

                                  azureFoundry ↗

                                  field
                                  knowledge_cutoff
                                  reported field
                                  training_data_cutoff
                                  value
                                  June 2024
                                  normalized value
                                  2024-06
                                  precision
                                  month
                                  scope
                                  source-model
                                  source id
                                  azureFoundry
                                  confidence
                                  1

                                  Original sources

                                  1–19 / 19

                                  OpenAI · Model reference ↗

                                  Microsoft Foundry · Model page ↗

                                  OpenRouter · Model page ↗

                                  OpenRouter · Model page ↗

                                  Vercel AI Gateway · Model page ↗

                                  Microsoft Foundry · Model documentation ↗

                                  GitHub · Source snapshot ↗

                                  api.cheaperinference.com · Source snapshot ↗

                                  Cloudflare AI · Catalog ↗

                                  GitHub · Catalog ↗

                                  GitHub · Catalog ↗

                                  Kaggle · Catalog ↗

                                  LMArena · Catalog ↗

                                  Microsoft Foundry · Catalog ↗

                                  OpenRouter · Catalog ↗

                                  OpenRouter · Catalog ↗

                                  Vercel AI Gateway · Catalog ↗

                                  gorilla.cs.berkeley.edu · Catalog ↗

                                  www.swebench.com · Catalog ↗

                                  Source links

                                  1–14 / 14

                                  Explore more models

                                  Models

                                  Loading
                                  EVIDENCE / COMPARISON

                                  Benchmarks

                                  Explore every benchmark

                                  Loading

                                  These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

                                  Install TensorTrace