Agents

An agent is a model inside a harness. Each one was asked to work for a set time on the same 200 tasks, a short and a long ask on each.

Agents ranked by the share of their runs within 5% of the time asked, higher is better.
RankAgent0.95× to 1.05× of the requestWhere runs ended, from a tenth of the time asked to ten times itTiming errorlower is better
1 GPT 6.1 SolCodex, max reasoning 65%258 runs 1.15×1.12 to 1.17
2 GPT 6 AstraCodex, max reasoning 61%242 runs 1.16×1.10 to 1.21
3 GPT 5.6 SolCodex, max reasoning 37%149 runs 1.97×1.76 to 2.16
4 Gemini 4 ArgonAntigravity CLI, high reasoning 11%42 runs 2.62×2.44 to 2.81
5 Claude Opus 5.5Claude Code, max reasoning 6%22 runs 2.13×2.03 to 2.24
6 Muse Wonder 1.0Muse Code, max reasoning 5%16 runs 9.07×7.70 to 10.26
7 Claude Fable 5.1Claude Code, max reasoning 4%17 runs 3.37×3.06 to 3.77
8 MiMo V2.6 ProMiMo Code, default reasoning 4%15 runs 3.93×3.63 to 4.23
9 MiMo V2.6 Pro UltraSpeedMiMo Code, default reasoning 3%13 runs 6.34×5.59 to 7.20

The ranges under timing error are 95% intervals. How it is measured