Anthropic: Claude Sonnet 5.5

Claude Sonnet 5.5 is Anthropic's Sonnet-class model for well-scoped everyday work, succeeding Claude Sonnet 5 as a direct upgrade. It is especially strong at building features, fixing bugs, and produ…

anthropic/claude-sonnet-5.5-20260928

Claude Sonnet 5.5 is Anthropic's Sonnet-class model for well-scoped everyday work, succeeding Claude Sonnet 5 as a direct upgrade. It is especially strong at building features, fixing bugs, and producing polished documents, slides, and spreadsheets, and it writes and communicates more clearly than its predecessor.

Thinking is always on, so effort is the main lever for trading off depth, latency, and cost, and lower effort settings keep it responsive for everyday agentic loops.

Specifications & capabilities

Input
text, image, file
Output
text
Context window · tokens
1000000
Knowledge cutoff
2026-06
Published model ID
claude-sonnet-5-5
Capabilities
batch, computerUse, fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput, webSearch
Description source ↗

Evaluations

1–16 / 16

OpenRouter Benchmarks

92.985%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Claude Platform on AWS
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
1
sample size
1188
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
6
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Claude Platform on AWS
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T08:33:04.486Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1188
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.929854
accuracy_std_dev
0.006348890821762996
cost_per_task_usd
0.025367877946127944
output_tokens_per_task
2304.1734006734005
latency_seconds_per_task
20.15414898989899
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
12
benchmark_evaluation
true
openrouter_permaslug
anthropic/claude-sonnet-5.5-20260928
source model id
anthropic/claude-sonnet-5.5-20260928
Original result ↗

OpenRouter Benchmarks

78%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Amazon Bedrock
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
1
sample size
500
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
10
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Amazon Bedrock
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T12:10:32.453Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
500
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7800001
accuracy_std_dev
0.02108170349592273
cost_per_task_usd
0.174296886
output_tokens_per_task
6231.684
latency_seconds_per_task
72.081318
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
31
benchmark_evaluation
true
openrouter_permaslug
anthropic/claude-sonnet-5.5-20260928
source model id
anthropic/claude-sonnet-5.5-20260928
Original result ↗

OpenRouter Benchmarks

92.901%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Anthropic
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
2
sample size
1188
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
6
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Anthropic
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T09:02:13.238Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1188
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.9290121666666666
accuracy_std_dev
0.0044978590987515684
cost_per_task_usd
0.024844954545454545
output_tokens_per_task
2244.3215488215487
latency_seconds_per_task
19.502118686868684
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
16
benchmark_evaluation
true
openrouter_permaslug
anthropic/claude-sonnet-5.5-20260928
source model id
anthropic/claude-sonnet-5.5-20260928
Original result ↗

OpenRouter Benchmarks

78.333%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Azure
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
2
sample size
600
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
12
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Azure
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T12:38:55.501Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
600
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7833333333333333
accuracy_std_dev
0.011706202852429232
cost_per_task_usd
0.1729425
output_tokens_per_task
6203.445
latency_seconds_per_task
66.54135000000001
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
40
benchmark_evaluation
true
openrouter_permaslug
anthropic/claude-sonnet-5.5-20260928
source model id
anthropic/claude-sonnet-5.5-20260928
Original result ↗

OpenRouter Benchmarks

77.333%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Claude Platform on AWS
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
2
sample size
300
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
6
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Claude Platform on AWS
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T11:48:36.920Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
300
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7733333333333333
accuracy_std_dev
0.02309381831909905
cost_per_task_usd
0.16708652333333332
output_tokens_per_task
6314.02
latency_seconds_per_task
79.74864333333332
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
12
benchmark_evaluation
true
openrouter_permaslug
anthropic/claude-sonnet-5.5-20260928
source model id
anthropic/claude-sonnet-5.5-20260928
Original result ↗

OpenRouter Benchmarks

78%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Google
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
3
sample size
900
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
18
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Google
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T12:07:29.560Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
900
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.78
accuracy_std_dev
0.021081938910409114
cost_per_task_usd
0.18010515333333332
output_tokens_per_task
6325.823333333334
latency_seconds_per_task
64.53058666666666
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
36
benchmark_evaluation
true
openrouter_permaslug
anthropic/claude-sonnet-5.5-20260928
source model id
anthropic/claude-sonnet-5.5-20260928
Original result ↗

OpenRouter Benchmarks

77.667%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · Anthropic
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
3
sample size
300
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
6
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
Anthropic
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T12:24:45.929Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
300
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.7766666666666666
accuracy_std_dev
0.014782246611692315
cost_per_task_usd
0.17363205
output_tokens_per_task
6340.086666666667
latency_seconds_per_task
73.61957333333334
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
16
benchmark_evaluation
true
openrouter_permaslug
anthropic/claude-sonnet-5.5-20260928
source model id
anthropic/claude-sonnet-5.5-20260928
Original result ↗

OpenRouter Benchmarks

92.609%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Amazon Bedrock
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
4
sample size
1980
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
10
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Amazon Bedrock
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T08:17:29.639Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
1980
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.9260940999999999
accuracy_std_dev
0.00286181765491794
cost_per_task_usd
0.026339350505050502
output_tokens_per_task
2294.320202020202
latency_seconds_per_task
19.43303686868687
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
32
benchmark_evaluation
true
openrouter_permaslug
anthropic/claude-sonnet-5.5-20260928
source model id
anthropic/claude-sonnet-5.5-20260928
Original result ↗

OpenRouter Benchmarks

78.8%

source id
openRouterBenchmarks
leaderboard name
tau2-bench Verified Airline · Accuracy · auto-routing
dimension
agentic
metric
tau2-bench Verified Airline · Accuracy
rank
5
sample size
250
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
5
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
tau_bench_verified_airline
name
tau2-bench Verified Airline
record_kind
aggregate
provider_name
auto-routing
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T11:10:36.361Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
tau2-bench Verified Airline · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
250
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/tau2-bench-airline
measurements
accuracy
0.788
accuracy_std_dev
0.02246951515275753
cost_per_task_usd
0.15925035199999998
output_tokens_per_task
6245.168
latency_seconds_per_task
71.120884
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
128
benchmark_evaluation
true
openrouter_permaslug
anthropic/claude-sonnet-5.5-20260928
source model id
anthropic/claude-sonnet-5.5-20260928
Original result ↗

Vercel AI Gateway

5.447%

source id
vercelAIGateway
leaderboard name
AI Gateway Text Spend Share
dimension
popularity
metric
Spend
rank
5
evaluated at
2026-11-11T00:00:00.000Z
source model id
Claude Sonnet 5.5
Original result ↗

OpenRouter Benchmarks

93.013%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Google
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
7
sample size
3564
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
18
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Google
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T08:07:18.284Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
3564
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.9301345000000001
accuracy_std_dev
0.006832688313053163
cost_per_task_usd
0.026123152076318747
output_tokens_per_task
2221.0524691358023
latency_seconds_per_task
18.695293490460156
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
40
benchmark_evaluation
true
openrouter_permaslug
anthropic/claude-sonnet-5.5-20260928
source model id
anthropic/claude-sonnet-5.5-20260928
Original result ↗

OpenRouter Benchmarks

91.751%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Azure
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
9
sample size
2376
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
12
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Azure
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T08:20:35.966Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
2376
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.9175082499999999
accuracy_std_dev
0.003571399938516188
cost_per_task_usd
0.025937152356902356
output_tokens_per_task
2235.470117845118
latency_seconds_per_task
19.17419191919192
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
43
benchmark_evaluation
true
openrouter_permaslug
anthropic/claude-sonnet-5.5-20260928
source model id
anthropic/claude-sonnet-5.5-20260928
Original result ↗

Vercel AI Gateway

2.682%

source id
vercelAIGateway
leaderboard name
AI Gateway Text Requests Share
dimension
popularity
metric
Requests
rank
9
evaluated at
2026-11-11T00:00:00.000Z
source model id
Claude Sonnet 5.5
Original result ↗

OpenRouter Benchmarks

92.828%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · auto-routing
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
10
sample size
990
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
5
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
auto-routing
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-31T08:09:30.514Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
990
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.9282826
accuracy_std_dev
0.00626296053316642
cost_per_task_usd
0.025195250505050507
output_tokens_per_task
2281.29898989899
latency_seconds_per_task
19.63372121212121
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
132
benchmark_evaluation
true
openrouter_permaslug
anthropic/claude-sonnet-5.5-20260928
source model id
anthropic/claude-sonnet-5.5-20260928
Original result ↗

Vercel AI Gateway

2.363%

source id
vercelAIGateway
leaderboard name
AI Gateway Text Tokens Share
dimension
popularity
metric
Tokens
rank
10
evaluated at
2026-11-11T00:00:00.000Z
source model id
Claude Sonnet 5.5
Original result ↗

Published prices

81–83 / 83

anthropic/claude-sonnet-5.5 ↗

$11.00

Inference provider
vercelAIGatewayCatalog
Platform
vertexAnthropic
Unit
output_tokens_per_million
Currency
USD
Billing conditions
region
scope
zone
geo_region
eu
endpoint
vertexAnthropic | anthropic/claude-sonnet-5.5
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

anthropic/claude-sonnet-5.5 ↗

$11.00

Inference provider
vercelAIGatewayCatalog
Platform
vertexAnthropic
Unit
output_tokens_per_million
Currency
USD
Billing conditions
region
scope
zone
geo_region
us
endpoint
vertexAnthropic | anthropic/claude-sonnet-5.5
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Output tokens / 1M
Pricing via
Vercel AI Gateway

anthropic/claude-sonnet-5.5 ↗

$0.01

Inference provider
vercelAIGatewayCatalog
Platform
vertexAnthropic
Unit
request
Currency
USD
Billing conditions
charge
web_search
endpoint
vertexAnthropic | anthropic/claude-sonnet-5.5
model_type
language
billing_scope
via Vercel AI Gateway
Billing label
Web search
Pricing via
Vercel AI Gateway

Provider specifications & access

1–6 / 6

Claude Sonnet 5.5 ↗

source model id
anthropic.claude-sonnet-5-5
hosting
bedrock-managed
platforms
  • Amazon Bedrock
architecture
input_modalities
  • text
  • image
output_modalities
  • text
capabilities

    Claude Sonnet 5.5 ↗

    source model id
    anthropic/claude-sonnet-5.5
    hosting
    third-party
    platforms
    • Anthropic
    context length
    1000000
    max output tokens
    128000
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities
    • reasoning

    Claude Sonnet 5.5 ↗

    source model id
    anthropic/claude-sonnet-5.5
    hosting
    vercel-gateway
    platforms
    • Vercel AI Gateway
    context length
    1000000
    max output tokens
    128000
    architecture
    input_modalities
    • text
    • image
    • pdf
    output_modalities
    • text
    capabilities
    • promptCaching
    • reasoning
    • structuredOutputs
    • toolCalling
    • visionInput
    • webSearch
    regions
    • au
    • eu
    • us

    Claude Sonnet 5.5 · azureml-anthropic v1 ↗

    source model id
    azureml-anthropic/claude-sonnet-5-5@1
    hosting
    foundry-managed-compute
    platforms
    • Microsoft Foundry
    context length
    1000000
    max output tokens
    128000
    architecture
    input_modalities
    • text
    • image
    • code
    output_modalities
    • text
    capabilities
    • reasoning
    • toolCalling

    Claude Sonnet 5.5 · azureml-anthropic v2 ↗

    source model id
    azureml-anthropic/claude-sonnet-5-5@2
    hosting
    foundry-managed-compute
    platforms
    • Microsoft Foundry
    context length
    1000000
    max output tokens
    128000
    architecture
    input_modalities
    • text
    • image
    • code
    output_modalities
    • text
    capabilities
    • reasoning
    • toolCalling

    Claude Sonnet 5.5 on Google Cloud ↗

    source model id
    publishers/anthropic/models/claude-sonnet-5-5@default
    hosting
    vertex-managed
    platforms
    • Google Cloud Vertex AI
    max input tokens
    1000000
    max output tokens
    128000
    architecture
    input_modalities
    • file
    • image
    • text
    output_modalities
    • text
    capabilities
    • batch
    • computerUse
    • multimodal
    • promptCaching
    • toolCalling
    • visionInput
    • webSearch

    Safety assessments

    1–1 / 1

    Foundation Model Transparency Index 2025 ↗

    46 / 100

    source id
    stanfordFMTI
    canonical model id
    anthropic/claude-sonnet-5.5-20260928
    taxonomy
    transparency
    hazard category
    transparency
    hazard name
    Organization transparency
    policy area
    Anthropic
    assessment type
    organization-level disclosure
    metric
    disclosure_score
    result label
    46 / 100
    sample size
    100
    updated at
    2026-11-09T18:08:05.227Z

    Source specification observations

    1–19 / 19

    azureFoundry ↗

    field
    context_length
    value
    1000000
    normalized value
    1000000
    scope
    source-model
    source id
    azureFoundry
    confidence
    1

    azureFoundry ↗

    field
    context_length
    value
    1000000
    normalized value
    1000000
    scope
    source-model
    source id
    azureFoundry
    confidence
    1

    cloudflareWorkersAI ↗

    field
    context_length
    value
    1000000
    normalized value
    1000000
    scope
    source-model
    source id
    cloudflareWorkersAI
    confidence
    1

    openRouter ↗

    field
    context_length
    value
    1000000
    normalized value
    1000000
    scope
    source-model
    source id
    openRouter
    confidence
    1

    openRouter ↗

    field
    context_length
    value
    1000000
    normalized value
    1000000
    scope
    source-model
    source id
    openRouter
    confidence
    1

    openRouter ↗

    field
    context_length
    value
    1000000
    normalized value
    1000000
    scope
    source-model
    source id
    openRouter
    confidence
    1

    vercelAIGatewayCatalog ↗

    field
    context_length
    value
    1000000
    normalized value
    1000000
    scope
    source-model
    source id
    vercelAIGatewayCatalog
    confidence
    1

    vercelAIGatewayCatalog ↗

    field
    knowledge_cutoff
    reported field
    knowledge_cutoff
    value
    2026-06
    normalized value
    2026-06
    precision
    month
    scope
    source-model
    source id
    vercelAIGatewayCatalog
    confidence
    1

    vertexAI ↗

    field
    max_input_tokens
    value
    1000000
    normalized value
    1000000
    scope
    source-model
    source id
    vertexAI
    confidence
    1

    azureFoundry ↗

    field
    max_output_tokens
    value
    128000
    normalized value
    128000
    scope
    source-model
    source id
    azureFoundry
    confidence
    1

    azureFoundry ↗

    field
    max_output_tokens
    value
    128000
    normalized value
    128000
    scope
    source-model
    source id
    azureFoundry
    confidence
    1

    cloudflareWorkersAI ↗

    field
    max_output_tokens
    value
    128000
    normalized value
    128000
    scope
    source-model
    source id
    cloudflareWorkersAI
    confidence
    1

    openRouter ↗

    field
    max_output_tokens
    value
    128000
    normalized value
    128000
    scope
    source-model
    source id
    openRouter
    confidence
    1

    openRouter ↗

    field
    max_output_tokens
    value
    128000
    normalized value
    128000
    scope
    source-model
    source id
    openRouter
    confidence
    1

    openRouter ↗

    field
    max_output_tokens
    value
    128000
    normalized value
    128000
    scope
    source-model
    source id
    openRouter
    confidence
    1

    vercelAIGatewayCatalog ↗

    field
    max_output_tokens
    value
    128000
    normalized value
    128000
    scope
    source-model
    source id
    vercelAIGatewayCatalog
    confidence
    1

    vertexAI ↗

    field
    max_output_tokens
    value
    128000
    normalized value
    128000
    scope
    source-model
    source id
    vertexAI
    confidence
    1

    azureFoundry ↗

    field
    knowledge_cutoff
    reported field
    training_data_cutoff
    value
    June 2026
    normalized value
    2026-06
    precision
    month
    scope
    source-model
    source id
    azureFoundry
    confidence
    1

    azureFoundry ↗

    field
    knowledge_cutoff
    reported field
    training_data_cutoff
    value
    June 2026
    normalized value
    2026-06
    precision
    month
    scope
    source-model
    source id
    azureFoundry
    confidence
    1

    Original sources

    1–20 / 22

    Anthropic · Model reference ↗

    Google Cloud · Model page ↗

    Microsoft Foundry · Model page ↗

    Microsoft Foundry · Model page ↗

    OpenRouter · Model page ↗

    OpenRouter · Model page ↗

    Vercel AI Gateway · Model page ↗

    Google Cloud · Documentation ↗

    Microsoft Foundry · Model documentation ↗

    GitHub · Source snapshot ↗

    Amazon Web Services · Model page ↗

    Amazon Bedrock · Model documentation ↗

    Amazon Web Services · Catalog ↗

    Cloudflare AI · Catalog ↗

    Epoch AI · Catalog ↗

    GitHub · Catalog ↗

    Google Cloud · Catalog ↗

    Microsoft Foundry · Catalog ↗

    OpenRouter · Catalog ↗

    OpenRouter · Catalog ↗

    Source links

    1–11 / 11

    Explore more models

    Models

    Loading
    EVIDENCE / COMPARISON

    Benchmarks

    Explore every benchmark

    Loading

    These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

    Install TensorTrace