MiniMax: MiniMax M3.1 Flash

MiniMax-M3.1-Flash is a multimodal model from MiniMax. Compared with M3, it delivers significant improvements across multiple benchmarks, particularly in complex agentic tasks, coding, and cybersecur…

minimax/minimax-m3.1-flash-20261019

MiniMax-M3.1-Flash is a multimodal model from MiniMax. Compared with M3, it delivers significant improvements across multiple benchmarks, particularly in complex agentic tasks, coding, and cybersecurity. It is built for complex, multi-step co-work automation, understanding real codebases, fixing bugs, and building features, and visual understanding and creation, including frontend and presentation creation. It is an open-weight mixture-of-experts model with 23B active / 428B total parameters.

Specifications & capabilities

Input
text, image, video
Output
text
Context window · tokens
1048576
Published model ID
MiniMax-M3.1-Flash
Capabilities
multimodal, promptCaching, reasoning, streaming, structuredOutputs, toolCalling, videoInput, visionInput
Description source ↗

Evaluations

21–35 / 35

OpenRouter Benchmarks

87.374%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Nebius
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
12
sample size
594
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
3
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Nebius
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T08:27:46.342Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
594
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.873737
accuracy_std_dev
0.007273551310513108
cost_per_task_usd
0.01830383333333333
output_tokens_per_task
30305.045454545456
latency_seconds_per_task
381.3050858585858
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
25
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

OpenRouter Benchmarks

84.906%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Fireworks
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
12
sample size
265
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Fireworks
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T08:20:07.444Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
265
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8490562452830188
accuracy_std_dev
0.004459999999999964
cost_per_task_usd
0.017200528301886793
output_tokens_per_task
28515.603773584906
latency_seconds_per_task
165.5359849056604
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
17
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

OpenRouter Benchmarks

72.644%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Nebius
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
12
sample size
145
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
3
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Nebius
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T12:11:53.396Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
145
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7264369310344827
accuracy_std_dev
0.006057869592521776
cost_per_task_usd
0.012712737931034484
output_tokens_per_task
8003.303448275862
latency_seconds_per_task
160.32086896551723
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
23
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

OpenRouter Benchmarks

71.333%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Fireworks
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
13
sample size
50
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
1
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Fireworks
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T12:42:39.534Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
50
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.713333
cost_per_task_usd
0.01617958
output_tokens_per_task
14742.64
latency_seconds_per_task
141.60067999999998
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
14
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

OpenRouter Benchmarks

68.667%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Wafer
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
13
sample size
100
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Wafer
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-24T12:06:50.408Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
100
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.6866665000000001
accuracy_std_dev
0.026666499999999982
cost_per_task_usd
0.01561806
output_tokens_per_task
14519.81
latency_seconds_per_task
117.25014
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
13
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

OpenRouter Benchmarks

85.129%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Parasail
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
15
sample size
594
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
3
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Parasail
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T08:56:30.449Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
594
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8512906666666668
accuracy_std_dev
0.00555530025191155
cost_per_task_usd
0.017986696969696972
output_tokens_per_task
29778.104377104377
latency_seconds_per_task
129.0369175084175
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
36
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

OpenRouter Benchmarks

71.556%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Together
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
16
sample size
150
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
3
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Together
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T13:08:15.957Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
150
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7155556666666666
accuracy_std_dev
0.03189478845969807
cost_per_task_usd
0.01325666
output_tokens_per_task
8966.793333333333
latency_seconds_per_task
86.09967333333334
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
22
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

OpenRouter Benchmarks

67.556%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · DigitalOcean
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
16
sample size
150
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
3
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
DigitalOcean
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T11:44:53.544Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
150
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.6755556666666667
accuracy_std_dev
0.00831485358994507
cost_per_task_usd
0.014157986666666667
output_tokens_per_task
13587.66
latency_seconds_per_task
117.42710000000001
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
20
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

OpenRouter Benchmarks

69.778%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Parasail
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
18
sample size
150
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
3
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Parasail
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T11:55:17.583Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
150
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.6977776666666667
accuracy_std_dev
0.011330936570096727
cost_per_task_usd
0.013071946666666667
output_tokens_per_task
11978.486666666666
latency_seconds_per_task
88.03678
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
28
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

OpenRouter Benchmarks

70%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · StreamLake
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
19
sample size
50
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
1
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
StreamLake
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T12:24:55.227Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
50
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7
cost_per_task_usd
0.0161093
output_tokens_per_task
15584.08
latency_seconds_per_task
215.05172
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
25
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

OpenRouter Benchmarks

66.8%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · GMICloud
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
22
sample size
250
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
5
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
GMICloud
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-11-10T06:31:54.090Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
250
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.668
accuracy_std_dev
0.08103784026983935
cost_per_task_usd
0.021783728
output_tokens_per_task
19729.836
latency_seconds_per_task
280.094124
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
23
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

OpenRouter Benchmarks

70.889%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Novita
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
35
sample size
150
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
3
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Novita
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T12:30:16.930Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
150
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.708889
accuracy_std_dev
0.0031423825355929936
cost_per_task_usd
0.017471633333333333
output_tokens_per_task
16040.473333333333
latency_seconds_per_task
219.75870666666665
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
52
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

OpenRouter Benchmarks

87.626%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · auto-routing
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
39
sample size
396
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
auto-routing
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T08:09:25.873Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
396
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.8762625
accuracy_std_dev
0.009259500000000032
cost_per_task_usd
0.014013469696969696
output_tokens_per_task
26009.79292929293
latency_seconds_per_task
171.31710353535354
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
132
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

OpenRouter Benchmarks

66.667%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · auto-routing
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
88
sample size
100
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
2
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
auto-routing
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T12:42:39.997Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
100
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.6666665
accuracy_std_dev
0.006666499999999964
cost_per_task_usd
0.013174700000000001
output_tokens_per_task
13269.31
latency_seconds_per_task
181.95026000000001
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
128
benchmark_evaluation
true
openrouter_permaslug
minimax/minimax-m3.1-flash-20261019
source model id
minimax/minimax-m3.1-flash-20261019
Original result ↗

Published prices

1–20 / 36

MiniMax-M3.1-Flash ↗

$0.02

Inference provider
miniMax
Platform
MiniMax
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
Billing label
Cache read / 1M tokens

MiniMax-M3.1-Flash ↗

$0.15

Inference provider
miniMax
Platform
MiniMax
Unit
input_tokens_per_million
Currency
USD
Billing conditions
Billing label
Input / 1M tokens

MiniMax-M3.1-Flash ↗

$0.60

Inference provider
miniMax
Platform
MiniMax
Unit
output_tokens_per_million
Currency
USD
Billing conditions
Billing label
Output / 1M tokens

minimax/minimax-m3.1-flash ↗

$0.02

Inference provider
vercelAIGatewayCatalog
Platform
digitalocean
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
digitalocean | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

minimax/minimax-m3.1-flash ↗

$0.15

Inference provider
vercelAIGatewayCatalog
Platform
digitalocean
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
digitalocean | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

minimax/minimax-m3.1-flash ↗

$0.60

Inference provider
vercelAIGatewayCatalog
Platform
digitalocean
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
digitalocean | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

minimax/minimax-m3.1-flash ↗

$0.02

Inference provider
vercelAIGatewayCatalog
Platform
fireworks
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
fireworks | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

minimax/minimax-m3.1-flash ↗

$0.15

Inference provider
vercelAIGatewayCatalog
Platform
fireworks
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
fireworks | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

minimax/minimax-m3.1-flash ↗

$0.60

Inference provider
vercelAIGatewayCatalog
Platform
fireworks
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
fireworks | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

minimax/minimax-m3.1-flash ↗

$0.01

Inference provider
vercelAIGatewayCatalog
Platform
gmicloud
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
gmicloud | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

minimax/minimax-m3.1-flash ↗

$0.11

Inference provider
vercelAIGatewayCatalog
Platform
gmicloud
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
gmicloud | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

minimax/minimax-m3.1-flash ↗

$0.45

Inference provider
vercelAIGatewayCatalog
Platform
gmicloud
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
gmicloud | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

minimax/minimax-m3.1-flash ↗

$0.01

Inference provider
vercelAIGatewayCatalog
Platform
inference-net
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
inference-net | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

minimax/minimax-m3.1-flash ↗

$0.10

Inference provider
vercelAIGatewayCatalog
Platform
inference-net
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
inference-net | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

minimax/minimax-m3.1-flash ↗

$0.50

Inference provider
vercelAIGatewayCatalog
Platform
inference-net
Unit
output_tokens_per_million
Currency
USD
Billing conditions
endpoint
inference-net | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

minimax/minimax-m3.1-flash ↗

$0.02

Inference provider
vercelAIGatewayCatalog
Platform
minimax
Unit
cache_read_tokens_per_million
Currency
USD
Billing conditions
endpoint
minimax | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Cached input / 1M
Pricing via
Vercel AI Gateway

minimax/minimax-m3.1-flash ↗

$0.15

Inference provider
vercelAIGatewayCatalog
Platform
minimax
Unit
input_tokens_per_million
Currency
USD
Billing conditions
endpoint
minimax | minimax/minimax-m3.1-flash
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Input tokens / 1M
Pricing via
Vercel AI Gateway

Provider specifications & access

1–3 / 3

minimax-m3.1-flash ↗

source model id
minimaxai/minimax-m3.1-flash
hosting
nvidia-catalog
platforms
  • NVIDIA Build / NIM
context length
262144
architecture
input_modalities
  • text
  • image
  • video
output_modalities
  • text
capabilities
  • toolCalling
  • structuredOutputs
  • reasoning

MiniMax-M3.1-Flash ↗

source model id
MiniMax-M3.1-Flash
hosting
minimax-hosted
platforms
  • MiniMax
context length
1000000
architecture
input_modalities
  • text
  • image
  • video
output_modalities
  • text
capabilities
  • videoInput
  • reasoning
  • toolCalling
  • streaming

MiniMax-M3.1-Flash ↗

source model id
minimax/minimax-m3.1-flash
hosting
vercel-gateway
platforms
  • Vercel AI Gateway
context length
1048576
max output tokens
1048576
architecture
input_modalities
  • text
  • image
output_modalities
  • text
capabilities
  • promptCaching
  • reasoning
  • structuredOutputs
  • toolCalling
  • visionInput

Source specification observations

1–6 / 6

miniMax ↗

field
context_length
value
1000000
normalized value
1000000
scope
source-model
source id
miniMax
confidence
1

nvidiaNim ↗

field
context_length
value
262144
normalized value
262144
scope
source-model
source id
nvidiaNim
confidence
1

openRouter ↗

field
context_length
value
1048576
normalized value
1048576
scope
source-model
source id
openRouter
confidence
1

vercelAIGatewayCatalog ↗

field
context_length
value
1048576
normalized value
1048576
scope
source-model
source id
vercelAIGatewayCatalog
confidence
1

openRouter ↗

field
max_output_tokens
value
524288
normalized value
524288
scope
source-model
source id
openRouter
confidence
1

vercelAIGatewayCatalog ↗

field
max_output_tokens
value
1048576
normalized value
1048576
scope
source-model
source id
vercelAIGatewayCatalog
confidence
1

Original sources

1–13 / 13

Hugging Face · MiniMaxAI/MiniMax-M3.1-Flash ↗

NVIDIA · Model page ↗

OpenRouter · Model page ↗

Vercel AI Gateway · Model page ↗

MiniMax · Model documentation ↗

MiniMax · Model documentation ↗

NVIDIA · Documentation ↗

Hugging Face · Catalog ↗

MiniMax · Catalog ↗

NVIDIA · Catalog ↗

OpenRouter · Catalog ↗

OpenRouter · Catalog ↗

Vercel AI Gateway · Catalog ↗

Source links

1–8 / 8

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace