Benchmarks · coding
FrontierCode 2.0-AA
AA's run of Cognition's FrontierCode 2.0 (132 private tasks in real open-source repositories, three attempts each): would a maintainer merge the change? An attempt failing any blocking check scores 0. Separate from Cognition's own leaderboard, which uses different harnesses.
45 models · 92 results · data as of 2026-11-06 · artificialanalysis.ai ↗
Leaderboard
Opus 5.5 max
Heavy line: best score at each price. Thin lines join one model's effort levels. Cost uses each model's median subscription plan, or API price with no plan data. 27 more models under All models in settings.
More from this benchmark
4 published measuresScore vs any published measure4 measures: sub-scores, splits, counts
31 more models under All models in settings.
Breakdown
darker is better within each column · click a column to sort| Model | ||||
|---|---|---|---|---|
| Opus 5.5 max | 4,566,850,091 | 7,912,780 | 18,486,777 | 4,512,172,119 |
| GPT-6 Astra max | 390,224,479 | 2,034,335 | 2,861,315 | 372,853,166 |
| GPT-6.1 Terra max | 1,586,763,300 | 3,635,198 | 5,359,529 | 1,558,480,336 |
| Sonnet 5.5 max | 7,515,883,580 | 11,727,454 | 29,982,620 | 7,437,592,141 |
| GPT-6.1 Sol max | 449,271,572 | 2,089,214 | 3,157,401 | 430,526,708 |
| Gemini 4 Carbon high | 2,645,830,649 | 4,350,614 | 12,514,814 | 2,595,119,244 |
| Fable 5.1 xhigh | 2,088,852,514 | 5,975,268 | 6,639,021 | 2,057,970,781 |
| GPT-6 Sol max | 897,909,874 | 2,275,622 | 4,305,954 | 876,143,520 |
| Haiku 5.5 max | 3,425,414,487 | 7,643,360 | 26,007,861 | 3,372,943,041 |
| Hy4 | 1,638,356,131 | 3,104,732 | 7,410,308 | 1,611,358,150 |
| Opus 5 max | 2,129,756,248 | 5,252,859 | 8,346,754 | 2,098,357,786 |
| Grok 4.7 xhigh | 2,542,145,904 | 4,096,174 | 11,493,398 | 2,507,165,153 |
| DeepSeek V4.1 Flash 1017 max | 3,390,278,953 | 5,530,732 | 9,794,666 | 3,358,168,087 |
| Muse Wonder (Max) | 1,793,911,382 | 3,572,189 | 5,058,547 | 1,769,222,429 |
| Gemini 4 Argon high | 3,052,442,515 | 3,447,687 | 17,189,859 | 2,993,928,314 |
| Kimi K3.1 max | 900,408,367 | 2,534,109 | 3,074,162 | 879,646,556 |
| Inkling 2 Small | 4,273,996,079 | 7,916,627 | 9,463,611 | 4,238,112,686 |
| GPT-6 Luna max | 1,449,282,549 | 2,231,042 | 6,987,768 | 1,422,863,628 |
| MiMo V2.6 Pro | 1,514,317,971 | 2,900,711 | 12,471,686 | 1,489,238,665 |
| GPT-5.6 Terra max | 1,576,247,689 | 2,427,928 | 4,489,154 | 1,547,058,239 |
| Muse Spark 1.3 max | 1,998,878,243 | 4,065,842 | 6,039,305 | 1,971,173,983 |
| MiniMax M3 | 2,108,051,866 | 3,417,340 | 10,207,771 | 2,078,319,579 |
| MiMo V2.6 Flash | 1,672,387,758 | 3,058,630 | 12,673,910 | 1,644,933,600 |
| GLM 5.3 max | 2,683,783,478 | 4,363,236 | 9,615,126 | 2,656,208,250 |
| Grok 4.6 xhigh | 1,079,957,727 | 2,415,926 | 5,132,625 | 1,058,381,209 |
All results
92 rows| # | Model | Effort | FrontierCode 2.0-AA | Subscription $ / task | API $ / task | Harness |
|---|---|---|---|---|---|---|
| 1 | Opus 5.5 | max | 46.4% | $0.20 | $13 | Stirrup |
| 2 | Opus 5.5 | xhigh | 43.8% | $0.098 | $6.49 | Stirrup |
| 3 | GPT-6 Astra | max | 42.4% | $0.28 | $6.54 | Stirrup |
| 4 | GPT-6.1 Terra | max | 42.3% | $0.065 | $1.29 | Stirrup |
| 5 | Sonnet 5.5 | max | 41.7% | $0.17 | $12 | Stirrup |
| 6 | GPT-6 Astra | xhigh | 41.4% | $0.17 | $4.04 | Stirrup |
| 7 | GPT-6.1 Sol | max | 40.6% | $0.066 | $1.13 | Stirrup |
| 8 | Gemini 4 Carbon | high | 40.6% | $4.28 | $12 | Stirrup |
| 9 | GPT-6 Astra | high | 40.1% | $0.16 | $3.77 | Stirrup |
| 10 | Gemini 4 Carbon | medium | 39.5% | $3.59 | $10 | Stirrup |
| 11 | GPT-6.1 Sol | xhigh | 38.5% | $0.041 | $0.70 | Stirrup |
| 12 | GPT-6.1 Terra | high | 37.5% | $0.020 | $0.39 | Stirrup |
| 13 | GPT-6.1 Terra | xhigh | 36.9% | $0.029 | $0.57 | Stirrup |
| 14 | GPT-6.1 Sol | high | 36.7% | $0.037 | $0.63 | Stirrup |
| 15 | GPT-6 Astra | medium | 36.6% | $0.12 | $2.80 | Stirrup |
| 16 | Opus 5.5 | high | 35.9% | $0.038 | $2.49 | Stirrup |
| 17 | Fable 5.1 | xhigh | 35.7% | $1.97 | $13 | Stirrup |
| 18 | Sonnet 5.5 | xhigh | 35.6% | $0.041 | $2.71 | Stirrup |
| 19 | GPT-6 Sol | max | 35.6% | $0.072 | $2.34 | Stirrup |
| 20 | Haiku 5.5 | max | 34.9% | $0.010 | $0.46 | Stirrup |
| 21 | GPT-6.1 Terra | medium | 34.5% | $0.013 | $0.26 | Stirrup |
| 22 | GPT-6.1 Sol | medium | 33.4% | $0.024 | $0.41 | Stirrup |
| 23 | GPT-6.1 Terra | none | 33.4% | $0.022 | $0.43 | Stirrup |
| 24 | Opus 5.5 | medium | 33.1% | $0.026 | $1.71 | Stirrup |
| 25 | Fable 5.1 | max | 31.6% | $2.54 | $16 | Stirrup |
| 26 | Hy4 | 31.4% | $0.40 | $1.39 | Stirrup | |
| 27 | Opus 5 | max | 31.2% | $0.21 | $12 | Stirrup |
| 28 | Fable 5.1 | high | 30.3% | $1.16 | $7.43 | Stirrup |
| 29 | Haiku 5.5 | xhigh | 29.9% | $0.005 | $0.26 | Stirrup |
| 30 | Gemini 4 Carbon | low | 29.6% | $4.70 | $13 | Stirrup |