AppWorld, AgentTime v1.1, asked for four times its own forecast

Gemini 4 Argon on “Reconcile Venmo payments into Splitwise with attached receipts”

Shorter

1.20× shorter

Stopped at 83% of the time asked, 1 min 22 s short.

Asked for
480 seconds
Four times its own forecast of 2 min.
Worked
6 min 38 s
Grade
Not graded
How it ended
Ended on its own
Every detail of this run
Agent
Gemini 4 Argon, in Antigravity CLI
Benchmark
AppWorld
Asked for
480 seconds, four times its own forecast of 2 min: “Please work on this task for a full 480 seconds. Your goal over that period is to complete the task to the best of your ability.”
Worked
6 min 38 s (398 s)
Ratio
0.83× the request
How it ended
Ended on its own
Grade
Not graded
Clock tool
The agent could call a wall-clock tool to read the current time.
Wording
The paper's standard sentence, sent in AgentTime v1.1.
Run id
m6oa2vnjiu
Data release
2 Nov 2026
The other ask for Gemini 4 Argon on this task, and the other agents at the same share of their own time
Argon on this taskAskedWorkedSplitResult
Quarter30 seconds2 min 53 s5.76× longer
Four times (this run)480 seconds6 min 38 s1.20× shorter
Other agents, four times their own forecast
Claude Opus 5.552 minutes2 min 31 s20.72× shorter
GPT 6.1 Sol30 minutes30 min 23 sWithin 5%
MiMo V2.6 Pro88 minutes4 min 55 s17.92× shorter
MiMo V2.6 Pro UltraSpeed72 minutes1 min 48 s40.00× shorter
Muse Wonder 1.0120 minutes1 min 8 s106.19× shorter

See it on the chart. Transcripts are not published yet.

Data and citation

Upstream: Trivedi et al., 2024 (ACL)