τ-bench

Source-qualified evaluations, report statistics and safety observations.

Grok 4.1 fast

MetricValueUnit
τ-bench · banking_knowledge · pass^10.13140000000000002percent
τ-bench · banking_knowledge · pass^20.07730000000000001percent
τ-bench · banking_knowledge · pass^30.0567percent
τ-bench · banking_knowledge · pass^40.051500000000000004percent

Grok 4.2

MetricValueUnit
τ-bench · banking_knowledge · pass^10.1804percent
τ-bench · banking_knowledge · pass^20.12369999999999999percent
τ-bench · banking_knowledge · pass^30.1005percent
τ-bench · banking_knowledge · pass^40.0825percent

Grok 4.5

MetricValueUnit
τ-bench · banking_knowledge · pass^10.4793814432989691percent
τ-bench · banking_knowledge · pass^20.39518900343642616percent
τ-bench · banking_knowledge · pass^30.3530927835051546percent
τ-bench · banking_knowledge · pass^40.31958762886597936percent

Grok 4 fast

MetricValueUnit
τ-bench · banking_knowledge · pass^10.1572percent
τ-bench · banking_knowledge · pass^20.0842percent
τ-bench · banking_knowledge · pass^30.0567percent
τ-bench · banking_knowledge · pass^40.0412percent

Inkling

MetricValueUnit
τ-bench · banking_knowledge · pass^10.25percent
τ-bench · banking_knowledge · pass^20.16666666666666663percent
τ-bench · banking_knowledge · pass^30.13402061855670103percent
τ-bench · banking_knowledge · pass^40.1134020618556701percent

Kimi K3

MetricValueUnit
τ-bench · banking_knowledge · pass^10.3711340206185567percent
τ-bench · banking_knowledge · pass^20.25257731958762886percent
τ-bench · banking_knowledge · pass^30.20103092783505155percent
τ-bench · banking_knowledge · pass^40.17525773195876287percent

Muse Spark 1.1

MetricValueUnit
τ-bench · banking_knowledge · pass^10.40463917525773196percent
τ-bench · banking_knowledge · pass^20.2955326460481099percent
τ-bench · banking_knowledge · pass^30.23969072164948454percent
τ-bench · banking_knowledge · pass^40.20618556701030927percent

Qwen3.5-397B-A17B

MetricValueUnit
τ-bench · airline · pass^10.815percent
τ-bench · airline · pass^20.7567percent
τ-bench · airline · pass^30.715percent
τ-bench · airline · pass^40.68percent
τ-bench · banking_knowledge · pass^10.09789999999999999percent
τ-bench · banking_knowledge · pass^20.0636percent
τ-bench · banking_knowledge · pass^30.0541percent
τ-bench · banking_knowledge · pass^40.051500000000000004percent
τ-bench · retail · pass^10.8443percent
τ-bench · retail · pass^20.7442percent
τ-bench · retail · pass^30.6645percent
τ-bench · retail · pass^40.5965percent
τ-bench · telecom · pass^10.9781percent
τ-bench · telecom · pass^20.9576percent
τ-bench · telecom · pass^30.9386percent
τ-bench · telecom · pass^40.9211percent

Qwen 3.8 Max

MetricValueUnit
τ-bench · banking_knowledge · pass^10.5515463917525774percent
τ-bench · banking_knowledge · pass^20.4518900343642611percent
τ-bench · banking_knowledge · pass^30.3969072164948454percent
τ-bench · banking_knowledge · pass^40.35051546391752575percent

RAFT-30B-A3B

MetricValueUnit
τ-bench · retail · pass^10.8245614035087719percent
τ-bench · retail · pass^20.7295321637426901percent
τ-bench · retail · pass^30.6622807017543859percent
τ-bench · retail · pass^40.6140350877192983percent

Ava Zero

MetricValueUnit
τ-bench · airline · pass^10.86percent
τ-bench · retail · pass^10.7543859649122807percent
τ-bench · telecom · pass^10.7982456140350878percent

gemini-3.1-flash-live-preview-thinking-high

MetricValueUnit
τ-bench · banking_knowledge · pass^10.1134020618556701percent

gemini-3.1-flash-live-preview-thinking-high

MetricValueUnit
τ-bench · airline · pass^10.64percent
τ-bench · retail · pass^10.45614035087719296percent
τ-bench · telecom · pass^10.21929824561403508percent

gemini-3.1-flash-live-preview-thinking-minimal

MetricValueUnit
τ-bench · airline · pass^10.42percent
τ-bench · retail · pass^10.2631578947368421percent
τ-bench · telecom · pass^10.17543859649122806percent

gemini-live-2.5-flash-native-audio

MetricValueUnit
τ-bench · airline · pass^10.3percent
τ-bench · retail · pass^10.298percent
τ-bench · telecom · pass^10.175percent

gpt-live-1

MetricValueUnit
τ-bench · banking_knowledge · pass^10.3711340206185567percent

gpt-live-1

MetricValueUnit
τ-bench · airline · pass^10.82percent
τ-bench · retail · pass^10.7894736842105263percent
τ-bench · telecom · pass^10.8421052631578947percent

gpt-live-1

MetricValueUnit
τ-bench · airline · pass^10.78percent
τ-bench · banking_knowledge · pass^10.31958762886597936percent
τ-bench · retail · pass^10.8421052631578947percent
τ-bench · telecom · pass^10.9649122807017544percent

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace