Anthropic: Claude Sonnet 5.5
Claude Sonnet 5.5 is Anthropic's Sonnet-class model for well-scoped everyday work, succeeding Claude Sonnet 5 as a direct upgrade. It is especially strong at building features, fixing bugs, and produ…
anthropic/claude-sonnet-5.5-20260928
Claude Sonnet 5.5 is Anthropic's Sonnet-class model for well-scoped everyday work, succeeding Claude Sonnet 5 as a direct upgrade. It is especially strong at building features, fixing bugs, and producing polished documents, slides, and spreadsheets, and it writes and communicates more clearly than its predecessor.
Thinking is always on, so effort is the main lever for trading off depth, latency, and cost, and lower effort settings keep it responsive for everyday agentic loops.
Specifications & capabilities
- Input
- text, image, file
- Output
- text
- Context window · tokens
- 1000000
- Knowledge cutoff
- 2026-06
- Published model ID
- claude-sonnet-5-5
- Capabilities
- batch, computerUse, fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput, webSearch
Description source ↗Evaluations
1–16 / 16
92.985%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · Claude Platform on AWS
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 1
- sample size
- 1188
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 6
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- Claude Platform on AWS
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T08:33:04.486Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 1188
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.929854
- accuracy_std_dev
- 0.006348890821762996
- cost_per_task_usd
- 0.025367877946127944
- output_tokens_per_task
- 2304.1734006734005
- latency_seconds_per_task
- 20.15414898989899
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 12
- benchmark_evaluation
- true
- openrouter_permaslug
- anthropic/claude-sonnet-5.5-20260928
- source model id
- anthropic/claude-sonnet-5.5-20260928
Original result ↗78%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · Amazon Bedrock
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 1
- sample size
- 500
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 10
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- Amazon Bedrock
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T12:10:32.453Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 500
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.7800001
- accuracy_std_dev
- 0.02108170349592273
- cost_per_task_usd
- 0.174296886
- output_tokens_per_task
- 6231.684
- latency_seconds_per_task
- 72.081318
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 31
- benchmark_evaluation
- true
- openrouter_permaslug
- anthropic/claude-sonnet-5.5-20260928
- source model id
- anthropic/claude-sonnet-5.5-20260928
Original result ↗92.901%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · Anthropic
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 2
- sample size
- 1188
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 6
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- Anthropic
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T09:02:13.238Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 1188
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.9290121666666666
- accuracy_std_dev
- 0.0044978590987515684
- cost_per_task_usd
- 0.024844954545454545
- output_tokens_per_task
- 2244.3215488215487
- latency_seconds_per_task
- 19.502118686868684
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 16
- benchmark_evaluation
- true
- openrouter_permaslug
- anthropic/claude-sonnet-5.5-20260928
- source model id
- anthropic/claude-sonnet-5.5-20260928
Original result ↗78.333%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · Azure
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 2
- sample size
- 600
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 12
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- Azure
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T12:38:55.501Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 600
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.7833333333333333
- accuracy_std_dev
- 0.011706202852429232
- cost_per_task_usd
- 0.1729425
- output_tokens_per_task
- 6203.445
- latency_seconds_per_task
- 66.54135000000001
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 40
- benchmark_evaluation
- true
- openrouter_permaslug
- anthropic/claude-sonnet-5.5-20260928
- source model id
- anthropic/claude-sonnet-5.5-20260928
Original result ↗77.333%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · Claude Platform on AWS
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 2
- sample size
- 300
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 6
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- Claude Platform on AWS
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T11:48:36.920Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 300
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.7733333333333333
- accuracy_std_dev
- 0.02309381831909905
- cost_per_task_usd
- 0.16708652333333332
- output_tokens_per_task
- 6314.02
- latency_seconds_per_task
- 79.74864333333332
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 12
- benchmark_evaluation
- true
- openrouter_permaslug
- anthropic/claude-sonnet-5.5-20260928
- source model id
- anthropic/claude-sonnet-5.5-20260928
Original result ↗78%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · Google
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 3
- sample size
- 900
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 18
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- Google
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T12:07:29.560Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 900
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.78
- accuracy_std_dev
- 0.021081938910409114
- cost_per_task_usd
- 0.18010515333333332
- output_tokens_per_task
- 6325.823333333334
- latency_seconds_per_task
- 64.53058666666666
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 36
- benchmark_evaluation
- true
- openrouter_permaslug
- anthropic/claude-sonnet-5.5-20260928
- source model id
- anthropic/claude-sonnet-5.5-20260928
Original result ↗77.667%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · Anthropic
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 3
- sample size
- 300
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 6
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- Anthropic
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T12:24:45.929Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 300
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.7766666666666666
- accuracy_std_dev
- 0.014782246611692315
- cost_per_task_usd
- 0.17363205
- output_tokens_per_task
- 6340.086666666667
- latency_seconds_per_task
- 73.61957333333334
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 16
- benchmark_evaluation
- true
- openrouter_permaslug
- anthropic/claude-sonnet-5.5-20260928
- source model id
- anthropic/claude-sonnet-5.5-20260928
Original result ↗92.609%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · Amazon Bedrock
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 4
- sample size
- 1980
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 10
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- Amazon Bedrock
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T08:17:29.639Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 1980
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.9260940999999999
- accuracy_std_dev
- 0.00286181765491794
- cost_per_task_usd
- 0.026339350505050502
- output_tokens_per_task
- 2294.320202020202
- latency_seconds_per_task
- 19.43303686868687
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 32
- benchmark_evaluation
- true
- openrouter_permaslug
- anthropic/claude-sonnet-5.5-20260928
- source model id
- anthropic/claude-sonnet-5.5-20260928
Original result ↗78.8%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · auto-routing
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 5
- sample size
- 250
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 5
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- auto-routing
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T11:10:36.361Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 250
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.788
- accuracy_std_dev
- 0.02246951515275753
- cost_per_task_usd
- 0.15925035199999998
- output_tokens_per_task
- 6245.168
- latency_seconds_per_task
- 71.120884
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 128
- benchmark_evaluation
- true
- openrouter_permaslug
- anthropic/claude-sonnet-5.5-20260928
- source model id
- anthropic/claude-sonnet-5.5-20260928
Original result ↗5.447%
- source id
- vercelAIGateway
- leaderboard name
- AI Gateway Text Spend Share
- dimension
- popularity
- metric
- Spend
- rank
- 5
- evaluated at
- 2026-11-11T00:00:00.000Z
- source model id
- Claude Sonnet 5.5
Original result ↗93.013%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · Google
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 7
- sample size
- 3564
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 18
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- Google
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T08:07:18.284Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 3564
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.9301345000000001
- accuracy_std_dev
- 0.006832688313053163
- cost_per_task_usd
- 0.026123152076318747
- output_tokens_per_task
- 2221.0524691358023
- latency_seconds_per_task
- 18.695293490460156
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 40
- benchmark_evaluation
- true
- openrouter_permaslug
- anthropic/claude-sonnet-5.5-20260928
- source model id
- anthropic/claude-sonnet-5.5-20260928
Original result ↗91.751%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · Azure
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 9
- sample size
- 2376
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 12
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- Azure
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T08:20:35.966Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 2376
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.9175082499999999
- accuracy_std_dev
- 0.003571399938516188
- cost_per_task_usd
- 0.025937152356902356
- output_tokens_per_task
- 2235.470117845118
- latency_seconds_per_task
- 19.17419191919192
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 43
- benchmark_evaluation
- true
- openrouter_permaslug
- anthropic/claude-sonnet-5.5-20260928
- source model id
- anthropic/claude-sonnet-5.5-20260928
Original result ↗2.682%
- source id
- vercelAIGateway
- leaderboard name
- AI Gateway Text Requests Share
- dimension
- popularity
- metric
- Requests
- rank
- 9
- evaluated at
- 2026-11-11T00:00:00.000Z
- source model id
- Claude Sonnet 5.5
Original result ↗92.828%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · auto-routing
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 10
- sample size
- 990
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 5
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- auto-routing
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T08:09:30.514Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 990
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.9282826
- accuracy_std_dev
- 0.00626296053316642
- cost_per_task_usd
- 0.025195250505050507
- output_tokens_per_task
- 2281.29898989899
- latency_seconds_per_task
- 19.63372121212121
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 132
- benchmark_evaluation
- true
- openrouter_permaslug
- anthropic/claude-sonnet-5.5-20260928
- source model id
- anthropic/claude-sonnet-5.5-20260928
Original result ↗2.363%
- source id
- vercelAIGateway
- leaderboard name
- AI Gateway Text Tokens Share
- dimension
- popularity
- metric
- Tokens
- rank
- 10
- evaluated at
- 2026-11-11T00:00:00.000Z
- source model id
- Claude Sonnet 5.5
Original result ↗54.5
- source id
- artificialAnalysis
- dimension
- intelligence
- metric
- Intelligence Index
Original result ↗Published prices
21–40 / 83
$10.00
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- alias_target
- name
- Anthropic: Claude Sonnet 5.5
- slug
- anthropic/claude-sonnet-5.5
- routing_alias
- true
$0.01
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- web_search
- Currency
- USD
- Billing conditions
- alias_target
- name
- Anthropic: Claude Sonnet 5.5
- slug
- anthropic/claude-sonnet-5.5
- routing_alias
- true
$0.10
- Inference provider
- vercelAIGatewayCatalog
- Platform
- anthropic
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- anthropic | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.11
- Inference provider
- vercelAIGatewayCatalog
- Platform
- anthropic
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- scope
- zone
- geo_region
- us
- endpoint
- anthropic | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$2.50
- Inference provider
- vercelAIGatewayCatalog
- Platform
- anthropic
- Unit
- cache_write_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- anthropic | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cache write / 1M
- Pricing via
- Vercel AI Gateway
$2.75
- Inference provider
- vercelAIGatewayCatalog
- Platform
- anthropic
- Unit
- cache_write_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- scope
- zone
- geo_region
- us
- endpoint
- anthropic | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cache write / 1M
- Pricing via
- Vercel AI Gateway
$2.00
- Inference provider
- vercelAIGatewayCatalog
- Platform
- anthropic
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- anthropic | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$2.20
- Inference provider
- vercelAIGatewayCatalog
- Platform
- anthropic
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- scope
- zone
- geo_region
- us
- endpoint
- anthropic | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$10.00
- Inference provider
- vercelAIGatewayCatalog
- Platform
- anthropic
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- anthropic | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$11.00
- Inference provider
- vercelAIGatewayCatalog
- Platform
- anthropic
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- scope
- zone
- geo_region
- us
- endpoint
- anthropic | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.01
- Inference provider
- vercelAIGatewayCatalog
- Platform
- anthropic
- Unit
- request
- Currency
- USD
- Billing conditions
- charge
- web_search
- endpoint
- anthropic | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Web search
- Pricing via
- Vercel AI Gateway
$0.10
- Inference provider
- vercelAIGatewayCatalog
- Platform
- bedrock
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- bedrock | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.11
- Inference provider
- vercelAIGatewayCatalog
- Platform
- bedrock
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- scope
- specific
- geo_region
- au
- provider_region
- ap-southeast-2
- endpoint
- bedrock | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.11
- Inference provider
- vercelAIGatewayCatalog
- Platform
- bedrock
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- scope
- specific
- geo_region
- eu
- provider_region
- eu-central-1
- endpoint
- bedrock | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.11
- Inference provider
- vercelAIGatewayCatalog
- Platform
- bedrock
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- scope
- zone
- geo_region
- us
- endpoint
- bedrock | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$2.50
- Inference provider
- vercelAIGatewayCatalog
- Platform
- bedrock
- Unit
- cache_write_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- bedrock | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cache write / 1M
- Pricing via
- Vercel AI Gateway
$2.75
- Inference provider
- vercelAIGatewayCatalog
- Platform
- bedrock
- Unit
- cache_write_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- scope
- specific
- geo_region
- au
- provider_region
- ap-southeast-2
- endpoint
- bedrock | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cache write / 1M
- Pricing via
- Vercel AI Gateway
$2.75
- Inference provider
- vercelAIGatewayCatalog
- Platform
- bedrock
- Unit
- cache_write_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- scope
- specific
- geo_region
- eu
- provider_region
- eu-central-1
- endpoint
- bedrock | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cache write / 1M
- Pricing via
- Vercel AI Gateway
$2.75
- Inference provider
- vercelAIGatewayCatalog
- Platform
- bedrock
- Unit
- cache_write_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- scope
- zone
- geo_region
- us
- endpoint
- bedrock | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cache write / 1M
- Pricing via
- Vercel AI Gateway
$2.00
- Inference provider
- vercelAIGatewayCatalog
- Platform
- bedrock
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- bedrock | anthropic/claude-sonnet-5.5
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
Provider specifications & access
1–6 / 6
- source model id
- anthropic.claude-sonnet-5-5
- hosting
- bedrock-managed
- source model id
- anthropic/claude-sonnet-5.5
- hosting
- third-party
- context length
- 1000000
- max output tokens
- 128000
- source model id
- anthropic/claude-sonnet-5.5
- hosting
- vercel-gateway
- context length
- 1000000
- max output tokens
- 128000
- capabilities
- promptCaching
- reasoning
- structuredOutputs
- toolCalling
- visionInput
- webSearch
- source model id
- azureml-anthropic/claude-sonnet-5-5@1
- hosting
- foundry-managed-compute
- context length
- 1000000
- max output tokens
- 128000
- source model id
- azureml-anthropic/claude-sonnet-5-5@2
- hosting
- foundry-managed-compute
- context length
- 1000000
- max output tokens
- 128000
- source model id
- publishers/anthropic/models/claude-sonnet-5-5@default
- hosting
- vertex-managed
- max input tokens
- 1000000
- max output tokens
- 128000
- capabilities
- batch
- computerUse
- multimodal
- promptCaching
- toolCalling
- visionInput
- webSearch
Safety assessments
1–1 / 1
46 / 100
- source id
- stanfordFMTI
- canonical model id
- anthropic/claude-sonnet-5.5-20260928
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Anthropic
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 46 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–19 / 19
- field
- context_length
- value
- 1000000
- normalized value
- 1000000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 1000000
- normalized value
- 1000000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 1000000
- normalized value
- 1000000
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- context_length
- value
- 1000000
- normalized value
- 1000000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 1000000
- normalized value
- 1000000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 1000000
- normalized value
- 1000000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 1000000
- normalized value
- 1000000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2026-06
- normalized value
- 2026-06
- precision
- month
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- max_input_tokens
- value
- 1000000
- normalized value
- 1000000
- scope
- source-model
- source id
- vertexAI
- confidence
- 1
- field
- max_output_tokens
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- max_output_tokens
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- max_output_tokens
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- cloudflareWorkersAI
- confidence
- 1
- field
- max_output_tokens
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- max_output_tokens
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- vertexAI
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- training_data_cutoff
- value
- June 2026
- normalized value
- 2026-06
- precision
- month
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- training_data_cutoff
- value
- June 2026
- normalized value
- 2026-06
- precision
- month
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
Explore more models