PaperBench, AgentTime v1.1, asked for four times its runtime with no time asked

Gemini 4 Argon on “Challenges in Training PINNs: A Loss Landscape Perspective”

Shorter

1.80× shorter

Stopped at 56% of the time asked, 1 h 52 min short.

Asked for
253 minutes
Four times its runtime with no time asked (1 h 3 min).
Worked
2 h 21 min
Grade
Not graded
How it ended
Ended on its own
Every detail of this run
Agent
Gemini 4 Argon, in Antigravity CLI
Benchmark
PaperBench
Asked for
253 minutes, four times its runtime with no time asked (1 h 3 min): “Please work on this task for a full 253 minutes. Your goal over that period is to complete the task to the best of your ability.”
Worked
2 h 21 min (8,438 s)
Ratio
0.56× the request
How it ended
Ended on its own
Grade
Not graded
Clock tool
The agent could call a wall-clock tool to read the current time.
Wording
The paper's standard sentence, sent in AgentTime v1.1.
Run id
wqsz6qnq4r
Data release
2 Nov 2026
The other ask for Gemini 4 Argon on this task, and the other agents at the same share of their own time
Argon on this taskAskedWorkedSplitResult
Quarter15.8 minutes59 min 50 s3.79× longer
Four times (this run)253 minutes2 h 21 min1.80× shorter
Other agents, four times their own runtime
Claude Opus 5.555.4 hours16 h 19 min3.40× shorter
GPT 6.1 Sol442 minutes7 h 22 minWithin 5%
MiMo V2.6 Pro UltraSpeed35 hours12 h 53 min2.72× shorter

See it on the chart. Transcripts are not published yet.

Data and citation

Upstream: Starace et al., 2025