Benchmarks · agentic
Terminal-Bench 4.0
Resolution rate of agent+model systems on 66 professional computer-work tasks in a terminal (5 trials per task, 8-hour timeout). Rows are harness+model pairs.
23 models · 35 results · data as of 2026-11-05 · tbench.ai ↗
Leaderboard
Opus 5.5 max
Heavy line: best score at each price. Thin lines join one model's effort levels. Cost uses each model's median subscription plan, or API price with no plan data. 12 more models under All models in settings.
More from this benchmark
2 published measuresTime per task35 results · lower is better
13 more models under All models in settings.
Output tokens per task35 results · lower is better
All results
35 rows| # | Model | Effort | Terminal-Bench 4.0 | Subscription $ / task | API $ / task | Time | Output tokens | Harness |
|---|---|---|---|---|---|---|---|---|
| 1 | Opus 5.5 | max | 64.8% ±3.1 | $0.22 | $14 | 1.3 h | 269k | Claude Code |
| 2 | Sonnet 5.5 | max | 61.8% ±2.9 | $0.34 | $22 | 2.1 h | 565k | Claude Code |
| 3 | GPT-6 Astra | max | 58.2% ±2.8 | $0.42 | $9.90 | 47 min | 73k | Codex |
| 4 | GPT-6.1 Sol | max | 58.2% ±3.1 | $0.11 | $1.92 | 53 min | 95k | Codex |
| 5 | Fable 5.1 | max | 57.9% ±3.8 | $2.95 | $19 | 1.1 h | 191k | Claude Code |
| 6 | Fable 5.1 | xhigh | 57.9% ±3.4 | $2.30 | $15 | 53 min | 153k | Claude Code |
| 7 | GPT-6 Astra | high | 57.9% ±3.0 | $0.29 | $6.88 | 35 min | 42k | Codex |
| 8 | GPT-6 Astra | xhigh | 57.9% ±2.7 | $0.30 | $7.12 | 37 min | 45k | Codex |
| 9 | Fable 5.1 | high | 54.5% ±3.4 | $1.88 | $12 | 50 min | 113k | Claude Code |
| 10 | GPT-6 Astra | medium | 54.2% ±2.7 | $0.25 | $5.80 | 31 min | 33k | Codex |
| 11 | Fable 5.1 | medium | 53.9% ±3.4 | $1.34 | $8.58 | 42 min | 79k | Claude Code |
| 12 | Opus 5 | xhigh | 53.9% ±3.2 | $0.32 | $18 | 1.3 h | 179k | Claude Code |
| 13 | Opus 5 | max | 51.8% ±3.4 | $0.31 | $18 | 1.3 h | 200k | Claude Code |
| 14 | GPT-6 Astra | low | 50.6% ±2.8 | $0.20 | $4.72 | 28 min | 24k | Codex |
| 15 | Opus 5 | high | 50.3% ±3.7 | $0.24 | $14 | 1.1 h | 144k | Claude Code |
| 16 | GPT-6 Sol | max | 49.4% ±3.2 | $0.14 | $4.40 | 44 min | 93k | Codex |
| 17 | Opus 5 | medium | 44.9% ±3.8 | $0.17 | $9.67 | 55 min | 101k | Claude Code |
| 18 | Fable 5 | max | 44.5% ±3.9 | $2.48 | $22 | 1.2 h | 178k | Claude Code |
| 19 | Fable 5.1 | low | 43.3% ±3.6 | $1.11 | $7.15 | 38 min | 60k | Claude Code |
| 20 | GLM 5.3 | max | 41.8% ±3.2 | $0.86 | $8.27 | 1.6 h | 208k | Claude Code |
| 21 | Grok 4.7 | xhigh | 37.6% ±3.5 | $1.04 | $11 | 1.6 h | 70k | Grok Build |
| 22 | GPT-5.6 Sol | max | 37.3% ±3.8 | $0.21 | $7.70 | 40 min | 71k | Codex |
| 23 | GLM 5.3 Flash | none | 35.8% ±3.5 | free | $0.36 | 1.7 h | 135k | Claude Code |
| 24 | Opus 5 | low | 34.9% ±3.9 | $0.13 | $7.25 | 49 min | 72k | Claude Code |
| 25 | Qwen 3.8 Max | max | 27.0% ±3.8 | $1.66 | $14 | 2.8 h | 253k | Claude Code |
| 26 | Opus 4.8 | max | 23.6% ±3.6 | $0.34 | $20 | 1.4 h | 269k | Claude Code |
| 27 | GPT-5.6 Terra | max | 21.5% ±3.3 | $0.15 | $5.25 | 42 min | 101k | Codex |
| 28 | Grok 4.6 | high | 20.3% ±3.1 | $1.12 | $11 | 39 min | 99k | Grok Build |
| 29 | Gemini 3.8 Flash | high | 19.1% ±3.4 | $0.22 | $5.54 | 33 min | 206k | mini-SWE-agent |
| 30 | GPT-5.6 Luna | max | 17.3% ±2.9 | $0.049 | $1.05 | 1.1 h | 186k | Codex |