τ-bench
Source-qualified evaluations, report statistics and safety observations.
xai-realtime
| Metric | Value | Unit |
|---|
| τ-bench · banking_knowledge · pass^1 | 0.1649484536082474 | percent |
grok-voice-fast-1.0
| Metric | Value | Unit |
|---|
| τ-bench · airline · pass^1 | 0.36 | percent |
| τ-bench · retail · pass^1 | 0.386 | percent |
| τ-bench · telecom · pass^1 | 0.40399999999999997 | percent |
gemini-3.8-live-extended-thinking
| Metric | Value | Unit |
|---|
| τ-bench voice aggregate | 0.3384879725085911 | percent |
gemini-3.8-live-extended-thinking
| Metric | Value | Unit |
|---|
| τ-bench voice aggregate | 0.4375 | percent |
gpt-live-1
| Metric | Value | Unit |
|---|
| τ-bench voice aggregate | 0.3316151202749141 | percent |
gpt-live-1
| Metric | Value | Unit |
|---|
| τ-bench voice aggregate | 0.6033333333333333 | percent |
grok-voice-think-fast-2.0
| Metric | Value | Unit |
|---|
| τ-bench voice aggregate | 0.10996563573883161 | percent |
grok-voice-think-fast-2.0
| Metric | Value | Unit |
|---|
| τ-bench voice aggregate | 0.44166666666666665 | percent |
Ava Zero
| Metric | Value | Unit |
|---|
| τ-bench voice aggregate | 0.86 | percent |
gemini-3.8-live-extended-thinking
| Metric | Value | Unit |
|---|
| τ-bench voice aggregate | 0.6850793650793651 | percent |
gpt-live-1
| Metric | Value | Unit |
|---|
| τ-bench voice aggregate | 0.7991257816257816 | percent |
grok-voice-think-fast-2.0
| Metric | Value | Unit |
|---|
| τ-bench voice aggregate | 0.7136961451247166 | percent |
phonic-1
| Metric | Value | Unit |
|---|
| τ-bench voice aggregate | 0.8322222222222222 | percent |