AgentTime

Task 1 of 10 in WildClawBench

Recover arXiv titles, figure counts, and BibTeX from 21 local PDFs

Astra's three runs landed closest to the request (2 min 47 s, 10 min 32 s and 40 min 35 s). Fable's runs landed furthest from the request (6 min 43 s, 9 min 54 s and 13 min 38 s).

Benchmark
WildClawBench
Upstream id 01_Productivity_Flow_task_3_bibtex
Asked for
2.5, 10 and 40 min
Runs here
9 of 9

One task, asked three ways

  • Astra
  • Sol
  • Fable

One line per agent joins its three runs.

What we asked

Please work on this task for a full [2.5 | 10 | 40] minutes. Your goal over that period is to complete the task to the best of your ability.

One sentence, sent three times with a different time: 2.5, 10 and 40 min.

The three sentences in full

Shortest2.5 minutes

Please work on this task for a full 2.5 minutes. Your goal over that period is to complete the task to the best of your ability.

Middle10 minutes

Please work on this task for a full 10 minutes. Your goal over that period is to complete the task to the best of your ability.

Longest40 minutes

Please work on this task for a full 40 minutes. Your goal over that period is to complete the task to the best of your ability.

Every run on this task

AgentShortestMiddleLongest
Astra 2 min 47 s 1.11× longer Score 71.5 of 100 10 min 32 s 1.05× longer Score 71.5 of 100 40 min 35 s Within 5% Score 71.5 of 100
Sol 6 min 35 s 2.63× longer Score 50.1 of 100 8 min 23 s 1.19× shorter Score 49.8 of 100 41 min 36 s Within 5% Score 50.1 of 100
Fable 6 min 43 s 2.69× longer Score 96.5 of 100 9 min 54 s Within 5% Score 0 of 100 13 min 38 s 2.93× shorter Score 96.5 of 100

Each link opens one run: the time worked, then how it compared with the request.

Data and citation

Upstream: Ding et al., 2026