GPQA Diamond, AgentTime v1.1, asked for four times its own forecast

Gemini 4 Argon on “GPQA Diamond closed-book question 4 (Chemistry)”

Longer

1.45× longer

Worked 45% past the request, 1 min 16 s over.

Asked for
168 seconds
Four times its own forecast of 42 s.
Worked
4 min 4 s
Grade
Not graded
How it ended
Ended on its own
Every detail of this run
Agent
Gemini 4 Argon, in Antigravity CLI
Benchmark
GPQA Diamond
Asked for
168 seconds, four times its own forecast of 42 s: “Please work on this task for a full 168 seconds. Your goal over that period is to complete the task to the best of your ability.”
Worked
4 min 4 s (244 s)
Ratio
1.45× the request
How it ended
Ended on its own
Grade
Not graded
Clock tool
The agent could call a wall-clock tool to read the current time.
Wording
The paper's standard sentence, sent in AgentTime v1.1.
Run id
s2im34rsbd
Data release
2 Nov 2026
The other ask for Gemini 4 Argon on this task, and the other agents at the same share of their own time
Argon on this taskAskedWorkedSplitResult
Quarter10.5 seconds1 min 19 s7.54× longer
Four times (this run)168 seconds4 min 4 s1.45× longer
Other agents, four times their own forecast
Claude Opus 5.5720 seconds22 min 16 s1.86× longer
GPT 6.1 Sol720 seconds12 min 13 sWithin 5%
MiMo V2.6 Pro48 minutes20 min 23 s2.35× shorter
MiMo V2.6 Pro UltraSpeed80 minutes5 min 31 s14.51× shorter
Muse Wonder 1.0480 seconds5 min 10 s1.55× shorter

See it on the chart. Transcripts are not published yet.

Data and citation

Upstream: Rein et al., 2024 (COLM)