OpenAI: GPT-4.1 Mini
GPT-4.1 Mini is a mid-sized model delivering performance competitive with GPT-4o at substantially lower latency and cost. It retains a 1 million token context window and scores 45.1% on hard instruct…
openai/gpt-4.1-mini-2025-04-14
GPT-4.1 Mini is a mid-sized model delivering performance competitive with GPT-4o at substantially lower latency and cost. It retains a 1 million token context window and scores 45.1% on hard instruction evals, 35.8% on MultiChallenge, and 84.1% on IFEval. Mini also shows strong coding ability (e.g., 31.6% on Aider’s polyglot diff benchmark) and vision understanding, making it suitable for interactive applications with tight performance constraints.
Specifications & capabilities
- Input
- image, text, file
- Output
- text
- Context window · tokens
- 1047576
- Published model ID
- gpt-4.1-mini-2025-04-14
- Capabilities
- fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput, webSearch
Description source ↗Evaluations
1–20 / 105
1,192.574
- source id
- lmarena
- leaderboard name
- LMArena Vision Style Control Captioning
- dimension
- multimodal
- metric
- Arena rating
- rank
- 17
- sample size
- 392
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- GPT-4.1 mini (2025-04-14)
- confidence lower
- 1158.3006797494722
- confidence upper
- 1226.8471439972236
Original result ↗1,187.329
- source id
- lmarena
- leaderboard name
- LMArena Vision Style Control Creative Writing
- dimension
- multimodal
- metric
- Arena rating
- rank
- 22
- sample size
- 1276
- evaluated at
- 2026-01-09T00:00:00.000Z
- source model id
- gpt-4.1-mini-2025-04-14
- confidence lower
- 1169.3015766217668
- confidence upper
- 1205.3566664730774
Original result ↗64.927%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · OpenAI
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 22
- sample size
- 594
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 3
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- OpenAI
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-02T23:15:53.868Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 594
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.6492706666666667
- accuracy_std_dev
- 0.010498645193018418
- cost_per_task_usd
- 0.0041127255892255896
- output_tokens_per_task
- 2375.9343434343436
- latency_seconds_per_task
- 24.949132996632997
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 26
- benchmark_evaluation
- true
- openrouter_permaslug
- openai/gpt-4.1-mini-2025-04-14
- source model id
- openai/gpt-4.1-mini-2025-04-14
Original result ↗57%
- source id
- bfcl
- leaderboard name
- BFCL Web Search
- dimension
- agentic
- metric
- Web-search accuracy
- rank
- 23
Original result ↗45.111%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · OpenAI
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 23
- sample size
- 150
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 3
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- OpenAI
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-02T23:07:02.872Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 150
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.45111100000000004
- accuracy_std_dev
- 0.01571332689152746
- cost_per_task_usd
- 0.023389446666666668
- output_tokens_per_task
- 2398.8933333333334
- latency_seconds_per_task
- 54.68944666666666
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 27
- benchmark_evaluation
- true
- openrouter_permaslug
- openai/gpt-4.1-mini-2025-04-14
- source model id
- openai/gpt-4.1-mini-2025-04-14
Original result ↗1,172.954
- source id
- lmarena
- leaderboard name
- LMArena Vision Captioning
- dimension
- multimodal
- metric
- Arena rating
- rank
- 25
- sample size
- 392
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- GPT-4.1 mini (2025-04-14)
- confidence lower
- 1140.5650673326934
- confidence upper
- 1205.342676431339
Original result ↗50.45%
- source id
- bfcl
- leaderboard name
- BFCL Overall
- dimension
- toolUse
- metric
- Overall accuracy
- rank
- 27
Original result ↗26.88%
- source id
- bfcl
- leaderboard name
- BFCL Memory
- dimension
- agentic
- metric
- Memory accuracy
- rank
- 27
Original result ↗1,164.89
- source id
- lmarena
- leaderboard name
- LMArena Vision Creative Writing
- dimension
- multimodal
- metric
- Arena rating
- rank
- 29
- sample size
- 1276
- evaluated at
- 2026-01-09T00:00:00.000Z
- source model id
- gpt-4.1-mini-2025-04-14
- confidence lower
- 1147.4023790771869
- confidence upper
- 1182.376663648448
Original result ↗87.5%
- source id
- bfcl
- leaderboard name
- BFCL Relevance Detection
- dimension
- toolUse
- metric
- Relevance detection
- rank
- 29
Original result ↗1,197.021
- source id
- lmarena
- leaderboard name
- LMArena Vision Style Control Entity Recognition
- dimension
- multimodal
- metric
- Arena rating
- rank
- 32
- sample size
- 357
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- GPT-4.1 mini (2025-04-14)
- confidence lower
- 1163.2491826313176
- confidence upper
- 1230.79232307274
Original result ↗24.3%
- source id
- bfcl
- leaderboard name
- BFCL Memory
- dimension
- agentic
- metric
- Memory accuracy
- rank
- 34
Original result ↗34.13%
- source id
- bfcl
- leaderboard name
- BFCL Multi Turn
- dimension
- agentic
- metric
- Multi-turn accuracy
- rank
- 37
Original result ↗64.015%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · Azure
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 38
- sample size
- 792
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 4
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- Azure
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-01T19:13:29.560Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 792
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.6401515
- accuracy_std_dev
- 0.002759842885020819
- cost_per_task_usd
- 0.004124544191919192
- output_tokens_per_task
- 2259.632575757576
- latency_seconds_per_task
- 34.47635353535353
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 43
- benchmark_evaluation
- true
- openrouter_permaslug
- openai/gpt-4.1-mini-2025-04-14
- source model id
- openai/gpt-4.1-mini-2025-04-14
Original result ↗40.333%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · Azure
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 39
- sample size
- 200
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 4
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- Azure
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-01T19:05:00.133Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 200
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.40333325000000003
- accuracy_std_dev
- 0.01914841159698371
- cost_per_task_usd
- 0.023807599999999998
- output_tokens_per_task
- 2775.135
- latency_seconds_per_task
- 77.145375
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 40
- benchmark_evaluation
- true
- openrouter_permaslug
- openai/gpt-4.1-mini-2025-04-14
- source model id
- openai/gpt-4.1-mini-2025-04-14
Original result ↗74.76%
- source id
- bfcl
- leaderboard name
- BFCL Live
- dimension
- toolUse
- metric
- Live accuracy
- rank
- 40
Original result ↗1,186.975
- source id
- lmarena
- leaderboard name
- LMArena Vision Entity Recognition
- dimension
- multimodal
- metric
- Arena rating
- rank
- 45
- sample size
- 357
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- GPT-4.1 mini (2025-04-14)
- confidence lower
- 1153.9453032816723
- confidence upper
- 1220.004268754512
Original result ↗81.25%
- source id
- bfcl
- leaderboard name
- BFCL Relevance Detection
- dimension
- toolUse
- metric
- Relevance detection
- rank
- 46
Original result ↗84.6%
- source id
- bfcl
- leaderboard name
- BFCL Non-Live AST
- dimension
- toolUse
- metric
- Non-live AST accuracy
- rank
- 49
Original result ↗81.69%
- source id
- bfcl
- leaderboard name
- BFCL Irrelevance Detection
- dimension
- toolUse
- metric
- Irrelevance detection
- rank
- 51
Original result ↗Published prices
1–20 / 36
$0.08
- Inference provider
- cheaperInference
- Platform
- Cheaper Inference
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- zdr
- false
- protocol
- chat_completions
- service_tier
- standard
- Billing label
- Cached input tokens (per 1M)
$0.00
- Inference provider
- cheaperInference
- Platform
- Cheaper Inference
- Unit
- cache_write_tokens_per_million
- Currency
- USD
- Billing conditions
- zdr
- false
- protocol
- chat_completions
- service_tier
- standard
- Billing label
- Cache write, 5 minutes (per 1M)
$0.30
- Inference provider
- cheaperInference
- Platform
- Cheaper Inference
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- zdr
- false
- protocol
- chat_completions
- service_tier
- standard
- Billing label
- Input tokens (per 1M)
$1.20
- Inference provider
- cheaperInference
- Platform
- Cheaper Inference
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- zdr
- false
- protocol
- chat_completions
- service_tier
- standard
- Billing label
- Output tokens (per 1M)
$0.10
- Inference provider
- cloudflareWorkersAI
- Platform
- OpenAI
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing label
- Cached input tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$0.40
- Inference provider
- cloudflareWorkersAI
- Platform
- OpenAI
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing label
- Input tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$1.60
- Inference provider
- cloudflareWorkersAI
- Platform
- OpenAI
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing label
- Output tokens (per 1M)
- Pricing via
- Cloudflare AI Gateway
$0.10
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
$0.40
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
$1.60
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
$0.01
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- web_search
- Currency
- USD
$0.05
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.20
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.80
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.01
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- web_search
- Currency
- USD
- Billing conditions
- mode
- batch
$0.10
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | openai/gpt-4.1-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.40
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | openai/gpt-4.1-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$1.60
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | openai/gpt-4.1-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.01
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- request
- Currency
- USD
- Billing conditions
- charge
- web_search
- endpoint
- azure | openai/gpt-4.1-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Web search
- Pricing via
- Vercel AI Gateway
$0.10
- Inference provider
- vercelAIGatewayCatalog
- Platform
- openai
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- openai | openai/gpt-4.1-mini
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
Provider specifications & access
1–4 / 4
- source model id
- azure-openai/gpt-4.1-mini@2025-04-14
- hosting
- foundry-managed-compute
- license
- custom
- context length
- 1048576
- max output tokens
- 32768
- source model id
- gpt-4.1-mini
- hosting
- gateway
- context length
- 1047576
- max output tokens
- 32768
- capabilities
- reasoning
- structuredOutputs
- toolCalling
- visionInput
- webSearch
- source model id
- openai/gpt-4.1-mini
- hosting
- third-party
- context length
- 1047576
- max output tokens
- 32768
- source model id
- openai/gpt-4.1-mini
- hosting
- vercel-gateway
- context length
- 1047576
- max output tokens
- 32768
- capabilities
- promptCaching
- structuredOutputs
- toolCalling
- visionInput
- webSearch
Safety assessments
1–1 / 1
35 / 100
- source id
- stanfordFMTI
- canonical model id
- openai/gpt-4.1-mini-2025-04-14
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- OpenAI
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 35 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–14 / 14
- field
- context_length
- value
- 1048576
- normalized value
- 1048576
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 1047576
- normalized value
- 1047576
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- context_length
- value
- 1047576
- normalized value
- 1047576
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 1047576
- normalized value
- 1047576
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 1047576
- normalized value
- 1047576
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-06-30
- normalized value
- 2024-06-30
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-06-30
- normalized value
- 2024-06-30
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-06-01
- normalized value
- 2024-06-01
- precision
- day
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- max_output_tokens
- value
- 32768
- normalized value
- 32768
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- max_output_tokens
- value
- 32768
- normalized value
- 32768
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- max_output_tokens
- value
- 32768
- normalized value
- 32768
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 32768
- normalized value
- 32768
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 32768
- normalized value
- 32768
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- training_data_cutoff
- value
- May 2024
- normalized value
- 2024-05
- precision
- month
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
Explore more models