Agents
An agent is a model inside a harness. Each one was asked to work for a set time on the same 200 tasks, a short and a long ask on each.
| Rank | Agent | 0.95× to 1.05× of the request | Where runs ended, from a tenth of the time asked to ten times it | Timing errorlower is better |
|---|---|---|---|---|
| 1 | GPT 6.1 SolCodex, max reasoning | 65%258 runs | 1.15×1.12 to 1.17 | |
| 2 | GPT 6 AstraCodex, max reasoning | 61%242 runs | 1.16×1.10 to 1.21 | |
| 3 | GPT 5.6 SolCodex, max reasoning | 37%149 runs | 1.97×1.76 to 2.16 | |
| 4 | Gemini 4 ArgonAntigravity CLI, high reasoning | 11%42 runs | 2.62×2.44 to 2.81 | |
| 5 | Claude Opus 5.5Claude Code, max reasoning | 6%22 runs | 2.13×2.03 to 2.24 | |
| 6 | Muse Wonder 1.0Muse Code, max reasoning | 5%16 runs | 9.07×7.70 to 10.26 | |
| 7 | Claude Fable 5.1Claude Code, max reasoning | 4%17 runs | 3.37×3.06 to 3.77 | |
| 8 | MiMo V2.6 ProMiMo Code, default reasoning | 4%15 runs | 3.93×3.63 to 4.23 | |
| 9 | MiMo V2.6 Pro UltraSpeedMiMo Code, default reasoning | 3%13 runs | 6.34×5.59 to 7.20 |
The ranges under timing error are 95% intervals. How it is measured