AgentTime

Does an AI agent work for as long as it is asked?

222 tasks from 18 benchmarks, each asked at three durations.

Runs within 5% of the time asked

Higher is better. Lines are 95% intervals. How it is counted

Duration following

Agents ranked by timing error, lower is better. 1.00× means every run worked exactly as long as asked. Benchmark score is out of 100.
Rank	Agent	lower is better	Within 5%0.95× to 1.05× of the request	out of 100
1	GPT 6 AstraCodex, max reasoning	1.18×1.11 to 1.25	63%419 of 666 runs	61.955.2 to 66.7
2	GPT 5.6 SolCodex, max reasoning	1.77×1.59 to 1.95	39%259 of 666 runs	55.650.2 to 60.6
3	Claude Fable 5.1Claude Code, max reasoning	2.86×2.68 to 2.99	4%27 of 659 runs	54.649.8 to 59.3
	Muse Spark 1.3Partial, not ranked: 2 of 18 benchmarks	4.00×no interval	3%3 of 108 runs	No benchmark score

Small figures are 95% intervals. How it is measured

Hover a mark to read it, click to pin it. Choose one agent to see its runs as a list.

Timing error on each benchmark, highest average first. Grey values rest on fewer than 10 runs. All 18 benchmarks