OpenAI: GPT-5 Mini
GPT-5 Mini is a compact version of GPT-5, designed to handle lighter-weight reasoning tasks. It provides the same instruction-following and safety-tuning benefits as GPT-5, but with reduced latency a…
openai/gpt-5-mini-2025-08-07
GPT-5 Mini is a compact version of GPT-5, designed to handle lighter-weight reasoning tasks. It provides the same instruction-following and safety-tuning benefits as GPT-5, but with reduced latency and cost. GPT-5 Mini is the successor to OpenAI's o4-mini model.
Specifications & capabilities
- Input
- text, image, file
- Output
- text
- Context window · tokens
- 400000
- Published model ID
- gpt-5-mini-2025-08-07
- Capabilities
- fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput, webSearch
Description source ↗Evaluations
1–20 / 158
82%
- source id
- bfcl
- leaderboard name
- BFCL Web Search
- dimension
- agentic
- metric
- Web-search accuracy
- rank
- 4
Original result ↗484
- source id
- kaggleBenchmarks
- leaderboard name
- Chess Suite · Text Input With Openings
- dimension
- general
- metric
- Chess Suite · Text Input With Openings
- rank
- 6
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1869
- name
- Text Input With Openings
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 86
- name
- Chess Suite
- type
- SUITE
- owner
- kaggle
- version
- 2
- version_id
- 437
- maintainer_tier
- Kaggle-published
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · kaggle · Chess Suite
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- Chess Suite · Text Input With Openings
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 437/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/kaggle/chess-suite/versions/2
- measurements
- name
- Text Input With Openings
- unit
- score
- scale
- 1
- metric
- Chess Suite · Text Input With Openings
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 484
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 94
- minus
- 69
- hasUnevenConfidenceInterval
- true
- taskVersionId
- 0
- evaluationDate
- 2026-01-13T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 484
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 94
- minus
- 69
- hasUnevenConfidenceInterval
- true
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1869
- task_url
- /benchmarks/kaggle/chess-text-openings/versions/2
- sort_order
- DESCENDING
- source_name
- Text Input With Openings
- display_type
- counts
- task_version
- 1
- task_display_type
- COUNTS
- normalization_status
- normalized
- published_at
- 2026-02-02T15:46:09.865215700Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-5-mini-2025-08-07
- metric_population
- 8
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-01-13T00:00:00.000Z
- source model id
- GPT-5 mini
- confidence lower
- 415
- confidence upper
- 578
Original result ↗484
- source id
- kaggleBenchmarks
- leaderboard name
- Chess Openings · Score
- dimension
- general
- metric
- Chess Openings · Score
- rank
- 7
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1869
- name
- Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 183
- name
- Chess Openings
- type
- GAME
- owner
- kaggle
- version
- 2
- version_id
- 436
- maintainer_tier
- Kaggle-published
- candidate
- candidate_class
- modelVersion
- collection
- kaggleGameArena
- record_kind
- aggregate
- game_arena
- true
- attribution
- Kaggle · kaggle · Chess Openings
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- Chess Openings · Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 436/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/kaggle/chess-text-openings/versions/2
- measurements
- name
- Score
- unit
- score
- scale
- 1
- metric
- Chess Openings · Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 484
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 94
- minus
- 69
- hasUnevenConfidenceInterval
- true
- taskVersionId
- 0
- evaluationDate
- 2026-01-13T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 484
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 94
- minus
- 69
- hasUnevenConfidenceInterval
- true
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1869
- sort_order
- DESCENDING
- source_name
- Score
- display_type
- counts
- task_version
- 1
- task_display_type
- COUNTS
- normalization_status
- normalized
- published_at
- 2026-02-02T15:46:28.981771500Z
- candidate_class
- modelVersion
- methodology_url
- https://www.kaggle.com/game-arena-faq
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-5-mini-2025-08-07
- game_arena_rating
- Game-specific rating; compare within this game and version
- metric_population
- 11
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-01-13T00:00:00.000Z
- source model id
- GPT-5 mini
- confidence lower
- 415
- confidence upper
- 578
Original result ↗72.444%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · OpenAI
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 7
- sample size
- 150
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 3
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- OpenAI
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-02T23:27:09.304Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 150
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.7244443333333334
- accuracy_std_dev
- 0.02199873172606905
- cost_per_task_usd
- 0.12152117999999999
- output_tokens_per_task
- 54771.27333333333
- latency_seconds_per_task
- 471.1736333333334
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 27
- benchmark_evaluation
- true
- openrouter_permaslug
- openai/gpt-5-mini-2025-08-07
- source model id
- openai/gpt-5-mini-2025-08-07
Original result ↗68.243%
- source id
- kaggleBenchmarks
- leaderboard name
- AssetOpsBench · Elimination Accuracy
- dimension
- reasoning
- metric
- AssetOpsBench · Elimination Accuracy
- rank
- 10
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1041
- name
- Elimination Accuracy
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 243
- name
- AssetOpsBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 222
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · AssetOpsBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AssetOpsBench · Elimination Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 222/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
- measurements
- name
- Elimination Accuracy
- unit
- percent
- scale
- 1
- metric
- AssetOpsBench · Elimination Accuracy
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.682427258805513
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-11-22T14:59:08.026672Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.682427258805513
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1041
- task_url
- /benchmarks/tasks/benchmarkler/failuresensoriq-eliminationaccuracy-benchmark-task
- sort_order
- DESCENDING
- source_name
- Elimination Accuracy
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-01T22:15:26.261663300Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-5-mini-2025-08-07
- metric_population
- 25
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-11-22T14:59:08.026Z
- source model id
- GPT-5 mini
Original result ↗65.456%
- source id
- kaggleBenchmarks
- leaderboard name
- AssetOpsBench · F-Score
- dimension
- reasoning
- metric
- AssetOpsBench · F-Score
- rank
- 10
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1040
- name
- F-Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 243
- name
- AssetOpsBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 222
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · AssetOpsBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AssetOpsBench · F-Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 222/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
- measurements
- name
- F-Score
- unit
- percent
- scale
- 1
- metric
- AssetOpsBench · F-Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.6545590994371482
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-11-22T14:27:16.736904Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.6545590994371482
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1040
- task_url
- /benchmarks/tasks/benchmarkler/failuresensoriq-fscore-benchmark-task
- sort_order
- DESCENDING
- source_name
- F-Score
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-01T22:15:26.261663300Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-5-mini-2025-08-07
- metric_population
- 25
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-11-22T14:27:16.736Z
- source model id
- GPT-5 mini
Original result ↗65.292%
- source id
- kaggleBenchmarks
- leaderboard name
- AssetOpsBench · Score
- dimension
- reasoning
- metric
- AssetOpsBench · Score
- rank
- 10
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 487619
- name
- Score
- version
- 5
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 243
- name
- AssetOpsBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 222
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · AssetOpsBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AssetOpsBench · Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 222/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
- measurements
- name
- Score
- unit
- percent
- scale
- 1
- metric
- AssetOpsBench · Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.6529183852018497
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-11-22T04:59:55.345713Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.6529183852018497
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 487619
- task_url
- /benchmarks/tasks/benchmarkler/failuresensoriq-main-benchmark-task
- sort_order
- DESCENDING
- source_name
- Score
- display_type
- percentages
- task_version
- 5
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-12-01T22:15:26.261663300Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-5-mini-2025-08-07
- metric_population
- 25
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-11-22T04:59:55.345Z
- source model id
- GPT-5 mini
Original result ↗56.843%
- source id
- kaggleBenchmarks
- leaderboard name
- AssetOpsBench · Consistency
- dimension
- reasoning
- metric
- AssetOpsBench · Consistency
- rank
- 11
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1045
- name
- Consistency
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 243
- name
- AssetOpsBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 222
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · AssetOpsBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AssetOpsBench · Consistency
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 222/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
- measurements
- name
- Consistency
- unit
- percent
- scale
- 1
- metric
- AssetOpsBench · Consistency
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.5684289463817023
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-11-24T03:35:02.651676Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.5684289463817023
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1045
- task_url
- /benchmarks/tasks/benchmarkler/failuresensoriq-consistency-benchmark-task
- sort_order
- DESCENDING
- source_name
- Consistency
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-01T22:15:26.261663300Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-5-mini-2025-08-07
- metric_population
- 25
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-11-24T03:35:02.651Z
- source model id
- GPT-5 mini
Original result ↗91.01%
- source id
- bfcl
- leaderboard name
- BFCL Irrelevance Detection
- dimension
- toolUse
- metric
- Irrelevance detection
- rank
- 12
Original result ↗538.583
- source id
- kaggleBenchmarks
- leaderboard name
- Chess Suite · Text Input
- dimension
- general
- metric
- Chess Suite · Text Input
- rank
- 13
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1446
- name
- Text Input
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 86
- name
- Chess Suite
- type
- SUITE
- owner
- kaggle
- version
- 2
- version_id
- 437
- maintainer_tier
- Kaggle-published
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · kaggle · Chess Suite
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- Chess Suite · Text Input
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 437/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/kaggle/chess-suite/versions/2
- measurements
- name
- Text Input
- unit
- score
- scale
- 1
- metric
- Chess Suite · Text Input
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 538.5827064346333
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 43.13619464476801
- minus
- 56.4977525774118
- hasUnevenConfidenceInterval
- true
- taskVersionId
- 0
- evaluationDate
- 2026-11-11T20:03:32.6840746Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 538.5827064346333
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 43.13619464476801
- minus
- 56.4977525774118
- hasUnevenConfidenceInterval
- true
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1446
- task_url
- /benchmarks/kaggle/chess-text/versions/2
- sort_order
- DESCENDING
- source_name
- Text Input
- display_type
- counts
- task_version
- 1
- task_display_type
- COUNTS
- normalization_status
- normalized
- published_at
- 2026-02-02T15:46:09.865215700Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-5-mini-2025-08-07
- metric_population
- 19
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2026-11-11T20:03:32.684Z
- source model id
- GPT-5 mini
- confidence lower
- 482.08495385722154
- confidence upper
- 581.7189010794013
Original result ↗386.526
- source id
- kaggleBenchmarks
- leaderboard name
- Five in a Row · Score
- dimension
- general
- metric
- Five in a Row · Score
- rank
- 13
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 5444
- name
- Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- counts
- benchmark
- id
- 2150
- name
- Five in a Row
- type
- GAME
- owner
- kaggle
- version
- 1
- version_id
- 2163
- maintainer_tier
- Kaggle-published
- candidate
- candidate_class
- modelVersion
- collection
- kaggleGameArena
- record_kind
- aggregate
- game_arena
- true
- attribution
- Kaggle · kaggle · Five in a Row
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- Five in a Row · Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 2163/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/kaggle/five-in-a-row/versions/1
- measurements
- name
- Score
- unit
- score
- scale
- 1
- metric
- Five in a Row · Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 386.52559338948436
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 45.32339204248149
- minus
- 57.49538551852601
- hasUnevenConfidenceInterval
- true
- taskVersionId
- 0
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- false
- numericResultNullable
- value
- 386.52559338948436
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- unevenConfidenceInterval
- plus
- 45.32339204248149
- minus
- 57.49538551852601
- hasUnevenConfidenceInterval
- true
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 5444
- sort_order
- DESCENDING
- source_name
- Score
- display_type
- counts
- task_version
- 1
- task_display_type
- COUNTS
- normalization_status
- normalized
- published_at
- 2026-04-30T16:37:18.401609400Z
- candidate_class
- modelVersion
- methodology_url
- https://www.kaggle.com/game-arena-faq
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-5-mini-2025-08-07
- game_arena_rating
- Game-specific rating; compare within this game and version
- metric_population
- 20
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- source model id
- GPT-5 mini
- confidence lower
- 329.03020787095835
- confidence upper
- 431.84898543196584
Original result ↗62.43%
- source id
- kaggleBenchmarks
- leaderboard name
- AssetOpsBench · Pert. Simple Accuracy
- dimension
- reasoning
- metric
- AssetOpsBench · Pert. Simple Accuracy
- rank
- 13
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1043
- name
- Pert. Simple Accuracy
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 243
- name
- AssetOpsBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 222
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · AssetOpsBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AssetOpsBench · Pert. Simple Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 222/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
- measurements
- name
- Pert. Simple Accuracy
- unit
- percent
- scale
- 1
- metric
- AssetOpsBench · Pert. Simple Accuracy
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.6242969628796401
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-11-23T14:35:55.116219Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.6242969628796401
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1043
- task_url
- /benchmarks/tasks/benchmarkler/failuresensoriq-perturbationsimple-benchmark-task
- sort_order
- DESCENDING
- source_name
- Pert. Simple Accuracy
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-01T22:15:26.261663300Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-5-mini-2025-08-07
- metric_population
- 25
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-11-23T14:35:55.116Z
- source model id
- GPT-5 mini
Original result ↗39.7%
- source id
- sweBench
- leaderboard name
- SWE-bench Multilingual
- dimension
- coding
- metric
- Resolved tasks
- rank
- 13
- sample size
- 300
- evaluated at
- 2026-02-13T00:00:00.000Z
Original result ↗59.843%
- source id
- kaggleBenchmarks
- leaderboard name
- AssetOpsBench · Pert. Complex Accuracy
- dimension
- reasoning
- metric
- AssetOpsBench · Pert. Complex Accuracy
- rank
- 14
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1044
- name
- Pert. Complex Accuracy
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 243
- name
- AssetOpsBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 222
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · AssetOpsBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AssetOpsBench · Pert. Complex Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 222/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
- measurements
- name
- Pert. Complex Accuracy
- unit
- percent
- scale
- 1
- metric
- AssetOpsBench · Pert. Complex Accuracy
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.5984251968503937
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-11-24T03:34:12.690737Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.5984251968503937
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1044
- task_url
- /benchmarks/tasks/benchmarkler/failuresensoriq-perturbationcomplex-benchmark-task
- sort_order
- DESCENDING
- source_name
- Pert. Complex Accuracy
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-01T22:15:26.261663300Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-5-mini-2025-08-07
- metric_population
- 25
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-11-24T03:34:12.690Z
- source model id
- GPT-5 mini
Original result ↗93.75%
- source id
- bfcl
- leaderboard name
- BFCL Relevance Detection
- dimension
- toolUse
- metric
- Relevance detection
- rank
- 15
Original result ↗59.047%
- source id
- kaggleBenchmarks
- leaderboard name
- AssetOpsBench · Selection Accuracy
- dimension
- reasoning
- metric
- AssetOpsBench · Selection Accuracy
- rank
- 15
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 1042
- name
- Selection Accuracy
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 243
- name
- AssetOpsBench
- type
- INDIVIDUAL
- owner
- ibm-research
- version
- 1
- categories
- evaluation
- general knowledge and reasoning
- version_id
- 222
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · ibm-research · AssetOpsBench
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- AssetOpsBench · Selection Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 222/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/ibm-research/asset-ops-bench/versions/1
- measurements
- name
- Selection Accuracy
- unit
- percent
- scale
- 1
- metric
- AssetOpsBench · Selection Accuracy
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.590465872156013
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-11-22T14:59:36.126412Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.590465872156013
- standardDeviation
- 0
- confidenceInterval
- 0
- hasStandardDeviation
- false
- hasConfidenceInterval
- false
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 1042
- task_url
- /benchmarks/tasks/benchmarkler/failuresensoriq-selectionaccuracy-benchmark-task
- sort_order
- DESCENDING
- source_name
- Selection Accuracy
- display_type
- percentages
- task_version
- 1
- task_display_type
- RAW_VALUES
- normalization_status
- normalized
- published_at
- 2025-12-01T22:15:26.261663300Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-5-mini-2025-08-07
- metric_population
- 25
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-11-22T14:59:36.126Z
- source model id
- GPT-5 mini
Original result ↗44.3%
- source id
- bfcl
- leaderboard name
- BFCL Memory
- dimension
- agentic
- metric
- Memory accuracy
- rank
- 15
Original result ↗1,216.049
- source id
- lmarena
- leaderboard name
- LMArena Vision Captioning
- dimension
- multimodal
- metric
- Arena rating
- rank
- 17
- sample size
- 282
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- GPT-5 mini (High)
- confidence lower
- 1179.443271087021
- confidence upper
- 1252.6544769355569
Original result ↗55.46%
- source id
- bfcl
- leaderboard name
- BFCL Overall
- dimension
- toolUse
- metric
- Overall accuracy
- rank
- 17
Original result ↗80.64%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · OpenAI
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 18
- sample size
- 396
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 2
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- OpenAI
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-01T19:26:25.385Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 396
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.806397
- accuracy_std_dev
- 0.003367000000000009
- cost_per_task_usd
- 0.04417995707070707
- output_tokens_per_task
- 21993.772727272728
- latency_seconds_per_task
- 210.13046464646465
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 26
- benchmark_evaluation
- true
- openrouter_permaslug
- openai/gpt-5-mini-2025-08-07
- source model id
- openai/gpt-5-mini-2025-08-07
Original result ↗Published prices
21–40 / 42
$0.01
- Inference provider
- vercelAIGatewayCatalog
- Platform
- openai
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- openai | openai/gpt-5-mini
- model_type
- language
- service_tier
- flex
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.05
- Inference provider
- vercelAIGatewayCatalog
- Platform
- openai
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- openai | openai/gpt-5-mini
- model_type
- language
- service_tier
- priority
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.25
- Inference provider
- vercelAIGatewayCatalog
- Platform
- openai
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- openai | openai/gpt-5-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.13
- Inference provider
- vercelAIGatewayCatalog
- Platform
- openai
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- openai | openai/gpt-5-mini
- model_type
- language
- service_tier
- flex
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.45
- Inference provider
- vercelAIGatewayCatalog
- Platform
- openai
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- openai | openai/gpt-5-mini
- model_type
- language
- service_tier
- priority
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$2.00
- Inference provider
- vercelAIGatewayCatalog
- Platform
- openai
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- openai | openai/gpt-5-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$1.00
- Inference provider
- vercelAIGatewayCatalog
- Platform
- openai
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- openai | openai/gpt-5-mini
- model_type
- language
- service_tier
- flex
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$3.60
- Inference provider
- vercelAIGatewayCatalog
- Platform
- openai
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- openai | openai/gpt-5-mini
- model_type
- language
- service_tier
- priority
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.01
- Inference provider
- vercelAIGatewayCatalog
- Platform
- openai
- Unit
- request
- Currency
- USD
- Billing conditions
- charge
- web_search
- endpoint
- openai | openai/gpt-5-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Web search
- Pricing via
- Vercel AI Gateway
$0.02
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- varies_by_provider
- true
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.05
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- service_tier
- fast
- billing_scope
- Vercel public catalog; endpoint prices may differ
- varies_by_provider
- true
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.01
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- service_tier
- flex
- billing_scope
- Vercel public catalog; endpoint prices may differ
- varies_by_provider
- true
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.05
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- service_tier
- priority
- billing_scope
- Vercel public catalog; endpoint prices may differ
- varies_by_provider
- true
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.25
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- varies_by_provider
- true
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.45
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- service_tier
- fast
- billing_scope
- Vercel public catalog; endpoint prices may differ
- varies_by_provider
- true
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.13
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- service_tier
- flex
- billing_scope
- Vercel public catalog; endpoint prices may differ
- varies_by_provider
- true
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.45
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- service_tier
- priority
- billing_scope
- Vercel public catalog; endpoint prices may differ
- varies_by_provider
- true
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$2.00
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- billing_scope
- Vercel public catalog; endpoint prices may differ
- varies_by_provider
- true
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$3.60
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- service_tier
- fast
- billing_scope
- Vercel public catalog; endpoint prices may differ
- varies_by_provider
- true
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$1.00
- Inference provider
- vercelAIGatewayCatalog
- Platform
- Vercel AI Gateway
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- model_type
- language
- quote_scope
- gateway_catalog
- service_tier
- flex
- billing_scope
- Vercel public catalog; endpoint prices may differ
- varies_by_provider
- true
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
Provider specifications & access
1–4 / 4
- source model id
- azure-openai/gpt-5-mini@2025-08-07
- hosting
- foundry-managed-compute
- license
- custom
- context length
- 400000
- max input tokens
- 272000
- max output tokens
- 128000
- source model id
- gpt-5-mini
- hosting
- gateway
- context length
- 400000
- max output tokens
- 128000
- capabilities
- reasoning
- structuredOutputs
- toolCalling
- visionInput
- webSearch
- source model id
- openai/gpt-5-mini
- hosting
- third-party
- context length
- 128000
- max output tokens
- 16384
- source model id
- openai/gpt-5-mini
- hosting
- vercel-gateway
- context length
- 400000
- max output tokens
- 128000
- capabilities
- promptCaching
- reasoning
- structuredOutputs
- toolCalling
- visionInput
- webSearch
Safety assessments
1–1 / 1
35 / 100
- source id
- stanfordFMTI
- canonical model id
- openai/gpt-5-mini-2025-08-07
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- OpenAI
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 35 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–15 / 15
- field
- context_length
- value
- 400000
- normalized value
- 400000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- context_length
- value
- 400000
- normalized value
- 400000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 400000
- normalized value
- 400000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 400000
- normalized value
- 400000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-05-31
- normalized value
- 2024-05-31
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-05-31
- normalized value
- 2024-05-31
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-05-31
- normalized value
- 2024-05-31
- precision
- day
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- max_input_tokens
- value
- 272000
- normalized value
- 272000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- max_output_tokens
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- max_output_tokens
- value
- 16384
- normalized value
- 16384
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- max_output_tokens
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- training_data_cutoff
- value
- June 2024
- normalized value
- 2024-06
- precision
- month
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
Explore more models