Benchmarks · math
ArXivMath 08/2026 (MathArena)
Research-level math problems with a checkable final answer, drawn from arXiv papers submitted in August 2026; each edition is restricted to papers published within the last month to reduce training-data contamination. Maintained by MathArena. Score: Accuracy (average performance on the competition) with a 95% confidence interval (normal approximation).
17 models · 19 results · data as of 2026-11-06 · matharena.ai ↗
Leaderboard
GPT-6.1 Sol max
All results
19 rows| # | Model | Effort | Score |
|---|---|---|---|
| 1 | GPT-6.1 Sol | max | 96.5% |
| 2 | GPT-6 Sol | max | 93.0% |
| 3 | GPT-6 Astra | max | 88.6% |
| 4 | Fable 5.1 | high | 87.7% |
| 5 | Opus 5.5 | high | 86.0% |
| 6 | GPT-6 Astra | low | 85.1% |
| 7 | Gemini 4 Argon | max | 82.5% |
| 8 | Fable 5.1 | low | 79.0% |
| 9 | Muse Wonder (Max) | max | 68.4% |
| 10 | Kimi K3.1 | max | 64.9% |
| 11 | Qwen 3.8 Max | max | 57.9% |
| 12 | DeepSeek V4.1 Flash 1017 | max | 56.1% |
| 13 | Grok 4.7 | xhigh | 46.5% |
| 14 | Muse Spark 1.3 | max | 45.6% |
| 15 | DeepSeek V4.1 Flash | max | 43.9% |
| 16 | Gemini 3.8 Flash | max | 40.4% |
| 17 | Kimi K3 | max | 38.6% |
| 18 | Muse Spark Open | xhigh | 29.8% |
| 19 | Mistral Large 4 | max | 24.6% |