AppWorld, AgentTime v1.1, asked for a quarter of its own forecast

Gemini 4 Argon on “Buy a requested item, forward its receipt, and recover the cost through Venmo”

Longer

32.00× longer

Worked 32.0 times as long as asked, 19 min 23 s over.

Asked for
37.5 seconds
A quarter of its own forecast of 2 min 30 s.
Worked
20 min
Grade
Not graded
How it ended
Stopped at AgentTime's time limit
Every detail of this run
Agent
Gemini 4 Argon, in Antigravity CLI
Benchmark
AppWorld
Asked for
37.5 seconds, a quarter of its own forecast of 2 min 30 s: “Please work on this task for a full 37.5 seconds. Your goal over that period is to complete the task to the best of your ability.”
Worked
20 min (1,200 s)
Ratio
32.00× the request
How it ended
Stopped at AgentTime's time limit
Grade
Not graded
Clock tool
The agent could call a wall-clock tool to read the current time.
Wording
The paper's standard sentence, sent in AgentTime v1.1.
Run id
ahsjh3homv
Data release
2 Nov 2026
The other ask for Gemini 4 Argon on this task, and the other agents at the same share of their own time
Argon on this taskAskedWorkedSplitResult
Quarter (this run)37.5 seconds20 min32.00× longer
Four times600 seconds20 min2.00× longer
Other agents, a quarter of their own forecast
Claude Opus 5.51.75 minutes3 min 37 s2.06× longer
GPT 6.1 Sol1.25 minutes1 min 26 s1.15× longer
MiMo V2.6 Pro4 minutes17 min 35 s4.40× longer
MiMo V2.6 Pro UltraSpeed7 minutes8 min 15 s1.18× longer
Muse Wonder 1.04 minutes10 s25.00× shorter

See it on the chart. Transcripts are not published yet.

Read before quoting. This run was stopped at AgentTime's time limit, so its time is a lower bound: the agent might have kept going. Details

Data and citation

Upstream: Trivedi et al., 2024 (ACL)