Benchmarks · agentic
τ³-Banking
τ³-Bench banking domain: multi-turn tool-using agent tasks with a simulated user; pass rate.
99 models · 153 results · data as of 2026-11-06 · artificialanalysis.ai ↗
Leaderboard
Qwen3.8 Max
More from this benchmark
4 published measuresScore vs any published measure4 measures: sub-scores, splits, counts
73 more models under All models in settings.
Breakdown
darker is better within each column · click a column to sort| Model | ||||
|---|---|---|---|---|
| Qwen 3.8 Max | 163,504,611 | 280,112 | 639,858 | 153,624,134 |
| Grok 4.6 high | 223,199,893 | 271,025 | 725,954 | 211,127,195 |
| Muse Spark 1.3 max | 220,492,546 | 433,020 | 876,571 | 212,072,561 |
| GLM 5.3 max | 97,164,948 | 246,937 | 585,986 | 91,128,280 |
| Qwen 3.8 2.4T-A95B | 176,092,113 | 271,047 | 697,680 | 166,758,232 |
| Qwen 3.8 27B xhigh | 174,388,284 | 287,739 | 663,169 | 163,907,148 |
| Fable 5.1 max | 184,373,670 | 463,764 | 817,825 | 174,584,226 |
| GLM 5.3 Flash max | 109,485,999 | 251,107 | 876,436 | 102,690,607 |
| Kimi K3 max | 186,181,877 | 339,213 | 613,131 | 176,018,670 |
| Gemini 3.8 Flash medium | 193,079,993 | 264,978 | 1,293,412 | 184,926,397 |
| Qwen 3.8 Flash | 310,495,285 | 349,679 | 791,226 | 294,830,592 |
| Opus 5 high | 140,871,245 | 428,528 | 440,299 | 131,931,139 |
| GPT-5.6 Sol max | 152,870,950 | 233,300 | 598,528 | 144,354,495 |
| GPT-6 Astra xhigh | 101,158,757 | 213,112 | 294,593 | 94,673,688 |
| Grok 4.5 high | 166,158,355 | 271,718 | 417,610 | 157,039,057 |
| DeepSeek V4 Flash max | 122,775,680 | 296,180 | 1,077,180 | 114,976,062 |
| Inkling 2 Small | 179,393,379 | 333,389 | 452,326 | 172,515,169 |
| GPT-5.6 Terra max | 141,126,363 | 212,197 | 762,471 | 133,028,016 |
| DeepSeek V4 Pro 0813 max | 104,722,653 | 293,348 | 1,031,561 | 98,115,624 |
| GPT-5.4 xhigh | 232,905,320 | 280,312 | 1,706,592 | 212,352,600 |
| DeepSeek V4 Flash 0731 max | 106,840,997 | 297,498 | 974,687 | 99,629,598 |
| GPT-5.5 xhigh | 117,652,838 | 206,711 | 643,558 | 106,325,646 |
| Ling 3.0 Flash Fin | 201,296,570 | 432,128 | 1,033,995 | 189,687,069 |
| Fable 5 max, fallback | 136,245,311 | 430,891 | 1,161,993 | 127,678,510 |
| Sonnet 5 max | 212,691,482 | 438,184 | 2,079,412 | 198,759,795 |
All results
153 rows| # | Model | Effort | τ³-Banking |
|---|---|---|---|
| 1 | Qwen 3.8 Max | max | 51.3% |
| 2 | Grok 4.6 | high | 50.7% |
| 3 | Muse Spark 1.3 | max | 50.5% |
| 4 | GLM 5.3 | max | 50.3% |
| 5 | Qwen 3.8 2.4T-A95B | 49.1% | |
| 6 | Qwen 3.8 27B | xhigh | 48.0% |
| 7 | Qwen 3.8 27B | medium | 47.4% |
| 8 | Fable 5.1 | max | 47.2% |
| 9 | GLM 5.3 Flash | max | 47.2% |
| 10 | Muse Spark 1.3 | xhigh | 47.2% |
| 11 | Kimi K3 | max | 46.0% |
| 12 | Fable 5.1 | xhigh | 45.8% |
| 13 | Gemini 3.8 Flash | medium | 45.8% |
| 14 | Qwen 3.8 Flash | 45.4% | |
| 15 | Gemini 3.8 Flash | high | 44.9% |
| 16 | Opus 5 | high | 44.7% |
| 17 | GPT-5.6 Sol | max | 44.3% |
| 18 | Grok 4.6 | medium | 44.3% |
| 19 | Opus 5 | xhigh | 43.3% |
| 20 | Grok 4.6 | xhigh | 43.3% |
| 21 | Fable 5.1 | high | 43.1% |
| 22 | GPT-6 Astra | xhigh | 43.1% |
| 23 | Opus 5 | max | 42.1% |
| 24 | Grok 4.5 | high | 42.1% |
| 25 | Kimi K3 | low | 41.6% |
| 26 | GPT-6 Astra | max | 41.4% |
| 27 | Fable 5.1 | medium | 41.0% |
| 28 | DeepSeek V4 Flash | max | 41.0% |
| 29 | Inkling 2 Small | 40.4% | |
| 30 | GPT-5.6 Terra | max | 40.2% |