ProgramBench, AgentTime v1.1, asked for four times its own forecast

Gemini 4 Argon on “jesseduffield/lazygit”

Shorter

5.36× shorter

Stopped at 19% of the time asked, 4 h 37 min short.

Asked for
340 minutes
Four times its own forecast of 1 h 25 min.
Worked
1 h 3 min
Grade
Not graded
How it ended
Ended on its own
Every detail of this run
Agent
Gemini 4 Argon, in Antigravity CLI
Benchmark
ProgramBench
Asked for
340 minutes, four times its own forecast of 1 h 25 min: “Please work on this task for a full 340 minutes. Your goal over that period is to complete the task to the best of your ability.”
Worked
1 h 3 min (3,805 s)
Ratio
0.19× the request
How it ended
Ended on its own
Grade
Not graded
Clock tool
The agent could call a wall-clock tool to read the current time.
Wording
The paper's standard sentence, sent in AgentTime v1.1.
Run id
phkkquq3jb
Data release
2 Nov 2026
The other ask for Gemini 4 Argon on this task, and the other agents at the same share of their own time
Argon on this taskAskedWorkedSplitResult
Quarter21.25 minutes21 min 53 sWithin 5%
Four times (this run)340 minutes1 h 3 min5.36× shorter
Other agents, four times their own forecast
Claude Opus 5.5800 minutes26 h 40 min2.00× longer
GPT 6.1 Sol480 minutes8 h 1 minWithin 5%
MiMo V2.6 Pro160 hours2 h 6 min76.42× shorter
MiMo V2.6 Pro UltraSpeed60 hours54 min 44 s65.78× shorter
Muse Wonder 1.048 hours13 min 56 s206.60× shorter

See it on the chart. Transcripts are not published yet.

Data and citation

Upstream: Yang et al., 2026