MiniMax: MiniMax M3
MiniMax-M3 is a multimodal foundation model from MiniMax. It supports text, image, and video inputs with text output, a 1M-token context window, and is suited for long-horizon agentic work, coding, a…
minimax/minimax-m3-20260531
MiniMax-M3 is a multimodal foundation model from MiniMax. It supports text, image, and video inputs with text output, a 1M-token context window, and is suited for long-horizon agentic work, coding, and tool use. It is built on MiniMax Sparse Attention (MSA), which replaces full attention with KV-block selection to cut per-token compute at long context — roughly 1/20 the cost of the previous generation at 1M tokens, with substantially faster prefill and decode while retaining quality across most tasks.
Trained as a native multimodal model on interleaved data and tuned for multi-turn, production-like collaboration via an interactive user-simulator framework, the model is oriented toward sustained, multi-step tasks rather than single-turn execution.
Specifications & capabilities
- Input
- text, image, video
- Output
- text
- Context window · tokens
- 1048576
- Published model ID
- MiniMax-M3
- Capabilities
- multimodal, promptCaching, reasoning, streaming, structuredOutputs, toolCalling, videoInput, visionInput
Description source ↗Evaluations
21–40 / 52
87.506%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · AtlasCloud
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 8
- sample size
- 1977
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 10
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- AtlasCloud
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T16:04:29.094Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 1977
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.8750631623672231
- accuracy_std_dev
- 0.10207384869887097
- cost_per_task_usd
- 0.02678827718765807
- output_tokens_per_task
- 22634.93171471927
- latency_seconds_per_task
- 188.46465857359635
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 30
- benchmark_evaluation
- true
- openrouter_permaslug
- minimax/minimax-m3-20260531
- source model id
- minimax/minimax-m3-20260531
Original result ↗66%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · Morph
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 9
- sample size
- 50
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 1
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- Morph
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-08-22T08:53:18.310Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 50
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.66
- cost_per_task_usd
- 0.06369964
- output_tokens_per_task
- 8805.34
- latency_seconds_per_task
- 706.01128
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 9
- benchmark_evaluation
- true
- openrouter_permaslug
- minimax/minimax-m3-20260531
- source model id
- minimax/minimax-m3-20260531
Original result ↗74.167%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · CoreWeave
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 11
- sample size
- 400
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 8
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- CoreWeave
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T18:57:59.813Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 400
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.741666625
- accuracy_std_dev
- 0.030866893899198455
- cost_per_task_usd
- 0.021115824999999998
- output_tokens_per_task
- 8219.325
- latency_seconds_per_task
- 150.5440025
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 22
- benchmark_evaluation
- true
- openrouter_permaslug
- minimax/minimax-m3-20260531
- source model id
- minimax/minimax-m3-20260531
Original result ↗73.783%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · Parasail
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 12
- sample size
- 534
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 11
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- Parasail
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-11-06T06:42:03.203Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 534
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.7378277303370787
- accuracy_std_dev
- 0.033381118228698506
- cost_per_task_usd
- 0.025130365168539327
- output_tokens_per_task
- 8311.610486891386
- latency_seconds_per_task
- 93.50449625468165
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 28
- benchmark_evaluation
- true
- openrouter_permaslug
- minimax/minimax-m3-20260531
- source model id
- minimax/minimax-m3-20260531
Original result ↗86.6%
- source id
- openCompass
- leaderboard name
- Average
- dimension
- general
- metric
- Average
- rank
- 13
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- KnowledgeTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Average
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- MiniMax-M3
Original result ↗86.6%
- source id
- openCompass
- leaderboard name
- Knowledge
- dimension
- general
- metric
- Knowledge
- rank
- 13
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- OverallTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Knowledge
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- MiniMax-M3
Original result ↗84.2%
- source id
- openCompass
- leaderboard name
- Knowledge_CommonSense
- dimension
- general
- metric
- Knowledge_CommonSense
- rank
- 13
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- KnowledgeTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Knowledge_CommonSense
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- MiniMax-M3
Original result ↗74.3%
- source id
- openCompass
- leaderboard name
- Math_College
- dimension
- general
- metric
- Math_College
- rank
- 13
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MathTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Math_College
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- MiniMax-M3
Original result ↗73.611%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · AtlasCloud
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 13
- sample size
- 444
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 9
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- AtlasCloud
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T19:48:53.852Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 444
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.736111045045045
- accuracy_std_dev
- 0.04484669172680976
- cost_per_task_usd
- 0.02811942117117117
- output_tokens_per_task
- 10611.61936936937
- latency_seconds_per_task
- 111.18540990990991
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 29
- benchmark_evaluation
- true
- openrouter_permaslug
- minimax/minimax-m3-20260531
- source model id
- minimax/minimax-m3-20260531
Original result ↗87.1%
- source id
- openCompass
- leaderboard name
- Knowledge_Humanity
- dimension
- general
- metric
- Knowledge_Humanity
- rank
- 14
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- KnowledgeTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Knowledge_Humanity
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- MiniMax-M3
Original result ↗69.9%
- source id
- openCompass
- leaderboard name
- Common_Reasoning
- dimension
- general
- metric
- Common_Reasoning
- rank
- 14
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- ReasonTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Common_Reasoning
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- MiniMax-M3
Original result ↗38.1%
- source id
- openCompass
- leaderboard name
- Academic_Reasoning
- dimension
- general
- metric
- Academic_Reasoning
- rank
- 14
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- ReasonTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Academic_Reasoning
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- MiniMax-M3
Original result ↗82.5%
- source id
- openCompass
- leaderboard name
- Knowledge_Social_Science
- dimension
- general
- metric
- Knowledge_Social_Science
- rank
- 15
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- KnowledgeTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Knowledge_Social_Science
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- MiniMax-M3
Original result ↗73.037%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · GMICloud
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 15
- sample size
- 450
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 9
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- GMICloud
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-11-10T06:43:24.233Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 450
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.7303704444444444
- accuracy_std_dev
- 0.04158720192054578
- cost_per_task_usd
- 0.028855546666666666
- output_tokens_per_task
- 13689.44
- latency_seconds_per_task
- 158.0610911111111
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 23
- benchmark_evaluation
- true
- openrouter_permaslug
- minimax/minimax-m3-20260531
- source model id
- minimax/minimax-m3-20260531
Original result ↗72.5%
- source id
- openCompass
- leaderboard name
- Comprehensive_Coding_Ability
- dimension
- general
- metric
- Comprehensive_Coding_Ability
- rank
- 15
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- CodeTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Comprehensive_Coding_Ability
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- MiniMax-M3
Original result ↗72.5%
- source id
- openCompass
- leaderboard name
- Code
- dimension
- general
- metric
- Code
- rank
- 15
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- OverallTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Code
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- MiniMax-M3
Original result ↗72.5%
- source id
- openCompass
- leaderboard name
- Average
- dimension
- general
- metric
- Average
- rank
- 15
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- CodeTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Average
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- MiniMax-M3
Original result ↗71.778%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · StreamLake
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 15
- sample size
- 150
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 3
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- StreamLake
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T19:03:35.054Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 150
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.717778
- accuracy_std_dev
- 0.046930323977857506
- cost_per_task_usd
- 0.045013793333333336
- output_tokens_per_task
- 18662.633333333335
- latency_seconds_per_task
- 196.45852
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 25
- benchmark_evaluation
- true
- openrouter_permaslug
- minimax/minimax-m3-20260531
- source model id
- minimax/minimax-m3-20260531
Original result ↗69%
- source id
- openCompass
- leaderboard name
- Average
- dimension
- general
- metric
- Average
- rank
- 15
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- OverallTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Average
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- MiniMax-M3
Original result ↗63%
- source id
- openCompass
- leaderboard name
- Average
- dimension
- general
- metric
- Average
- rank
- 15
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MathTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Average
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- MiniMax-M3
Original result ↗Published prices
1–20 / 33
$0.06
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
$0.30
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
$1.20
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
$0.04
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.22
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.88
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- mode
- batch
$0.06
- Inference provider
- siliconFlow
- Platform
- SiliconFlow
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- tier
- 0-512k-input
- label
- Input tokens within [0, 512k)
- Billing label
- Cached input tokens (per 1M)
$0.12
- Inference provider
- siliconFlow
- Platform
- SiliconFlow
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- tier
- over-512k-input
- label
- Input tokens over 512k
- Billing label
- Cached input tokens (per 1M)
$0.30
- Inference provider
- siliconFlow
- Platform
- SiliconFlow
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- tier
- 0-512k-input
- label
- Input tokens within [0, 512k)
- Billing label
- Input tokens (per 1M)
$0.60
- Inference provider
- siliconFlow
- Platform
- SiliconFlow
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- tier
- over-512k-input
- label
- Input tokens over 512k
- Billing label
- Input tokens (per 1M)
$1.20
- Inference provider
- siliconFlow
- Platform
- SiliconFlow
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- tier
- 0-512k-input
- label
- Input tokens within [0, 512k)
- Billing label
- Output tokens (per 1M)
$2.40
- Inference provider
- siliconFlow
- Platform
- SiliconFlow
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- tier
- over-512k-input
- label
- Input tokens over 512k
- Billing label
- Output tokens (per 1M)
$0.06
- Inference provider
- vercelAIGatewayCatalog
- Platform
- fireworks
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- fireworks | minimax/minimax-m3
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.30
- Inference provider
- vercelAIGatewayCatalog
- Platform
- fireworks
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- fireworks | minimax/minimax-m3
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$1.20
- Inference provider
- vercelAIGatewayCatalog
- Platform
- fireworks
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- fireworks | minimax/minimax-m3
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.10
- Inference provider
- vercelAIGatewayCatalog
- Platform
- gmicloud
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- gmicloud | minimax/minimax-m3
- model_type
- language
- quantization
- fp8
- billing_scope
- via Vercel AI Gateway
- context_tokens
- min_inclusive
- 512000
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.05
- Inference provider
- vercelAIGatewayCatalog
- Platform
- gmicloud
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- gmicloud | minimax/minimax-m3
- model_type
- language
- quantization
- fp8
- billing_scope
- via Vercel AI Gateway
- context_tokens
- max_exclusive
- 512000
- min_inclusive
- 0
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.48
- Inference provider
- vercelAIGatewayCatalog
- Platform
- gmicloud
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- gmicloud | minimax/minimax-m3
- model_type
- language
- quantization
- fp8
- billing_scope
- via Vercel AI Gateway
- context_tokens
- min_inclusive
- 512000
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.24
- Inference provider
- vercelAIGatewayCatalog
- Platform
- gmicloud
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- gmicloud | minimax/minimax-m3
- model_type
- language
- quantization
- fp8
- billing_scope
- via Vercel AI Gateway
- context_tokens
- max_exclusive
- 512000
- min_inclusive
- 0
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$1.92
- Inference provider
- vercelAIGatewayCatalog
- Platform
- gmicloud
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- gmicloud | minimax/minimax-m3
- model_type
- language
- quantization
- fp8
- billing_scope
- via Vercel AI Gateway
- context_tokens
- min_inclusive
- 512000
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
Provider specifications & access
1–3 / 3
- source model id
- MiniMaxAI/MiniMax-M3
- hosting
- siliconflow-hosted
- max output tokens
- 131072
- capabilities
- promptCaching
- reasoning
- structuredOutputs
- toolCalling
- source model id
- MiniMax-M3
- hosting
- minimax-hosted
- context length
- 1000000
- capabilities
- videoInput
- reasoning
- toolCalling
- streaming
- source model id
- minimax/minimax-m3
- hosting
- vercel-gateway
- context length
- 512000
- max output tokens
- 512000
- capabilities
- promptCaching
- reasoning
- structuredOutputs
- toolCalling
- visionInput
Source specification observations
1–9 / 9
- field
- context_length
- value
- 1000000
- normalized value
- 1000000
- scope
- source-model
- source id
- miniMax
- confidence
- 1
- field
- context_length
- value
- 1048576
- normalized value
- 1048576
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 524288
- normalized value
- 524288
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 1049K
- scope
- source-model
- source id
- siliconFlow
- confidence
- 1
- field
- context_length
- value
- 512000
- normalized value
- 512000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- max_output_tokens
- value
- 512000
- normalized value
- 512000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 512000
- normalized value
- 512000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 131K
- scope
- source-model
- source id
- siliconFlow
- confidence
- 1
- field
- max_output_tokens
- value
- 512000
- normalized value
- 512000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
Explore more models