AppWorld, AgentTime v1.1, asked for four times its own forecast

Gemini 4 Argon on “Turn this year’s emailed electricity bills into monthly Splitwise expenses”

Within 5%

Within 5%

Worked 96% of the time asked, within 5% of it.

Asked for
600 seconds
Four times its own forecast of 2 min 30 s.
Worked
9 min 37 s
Grade
Not graded
How it ended
Ended on its own
Every detail of this run
Agent
Gemini 4 Argon, in Antigravity CLI
Benchmark
AppWorld
Asked for
600 seconds, four times its own forecast of 2 min 30 s: “Please work on this task for a full 600 seconds. Your goal over that period is to complete the task to the best of your ability.”
Worked
9 min 37 s (577 s)
Ratio
0.96× the request
How it ended
Ended on its own
Grade
Not graded
Clock tool
The agent could call a wall-clock tool to read the current time.
Wording
The paper's standard sentence, sent in AgentTime v1.1.
Run id
o5u4ywfwhz
Data release
2 Nov 2026
The other ask for Gemini 4 Argon on this task, and the other agents at the same share of their own time
Argon on this taskAskedWorkedSplitResult
Quarter37.5 seconds4 min 26 s7.10× longer
Four times (this run)600 seconds9 min 37 sWithin 5%
Other agents, four times their own forecast
Claude Opus 5.544 minutes3 min 46 s11.70× shorter
GPT 6.1 Sol24 minutes24 min 29 sWithin 5%
MiMo V2.6 Pro180 minutes6 min 49 s26.43× shorter
MiMo V2.6 Pro UltraSpeed120 minutes3 min 29 s34.48× shorter
Muse Wonder 1.080 minutes2 min 13 s36.20× shorter

See it on the chart. Transcripts are not published yet.

Data and citation

Upstream: Trivedi et al., 2024 (ACL)