AgentTime

Task 8 of 12 in TUA-Bench

Optimize cold plate

Astra's three runs followed the request (6 min 30 s, 25 min 33 s and 1 h 41 min). Fable's runs landed furthest from the request (17 min 47 s, 28 min 9 s and 35 min 45 s).

Benchmark
TUA-Bench
Upstream id 005-optimize-cold-plate
Asked for
6, 25 and 100 min
Runs here
9 of 9
See Read before quoting below

One task, asked three ways

  • Astra
  • Sol
  • Fable

One line per agent joins its three runs.

What we asked

Please work on this task for a full [6 | 25 | 100] minutes. Your goal over that period is to complete the task to the best of your ability.

One sentence, sent three times with a different time: 6, 25 and 100 min.

The three sentences in full

Shortest6 minutes

Please work on this task for a full 6 minutes. Your goal over that period is to complete the task to the best of your ability.

Middle25 minutes

Please work on this task for a full 25 minutes. Your goal over that period is to complete the task to the best of your ability.

Longest100 minutes

Please work on this task for a full 100 minutes. Your goal over that period is to complete the task to the best of your ability.

Every run on this task

AgentShortestMiddleLongest
Astra 6 min 30 s 1.08× longer Did not pass, 33 of 100 25 min 33 s Within 5% Passed, 100 of 100 1 h 41 min Within 5% Did not pass, 33 of 100
Sol 9 min 55 s 1.65× longer Did not pass, 33 of 100 25 min 59 s Within 5% Did not pass, 33 of 100 1 h 41 min Within 5% Did not pass, 33 of 100
Fable 17 min 47 s 2.96× longer Did not pass, 33 of 100 28 min 9 s 1.13× longer Did not pass, 33 of 100 35 min 45 s 2.80× shorter Ending not labelled yet

Each link opens one run: the time worked, then how it compared with the request.

Read before quoting. 1 run on this task has an ending not labelled yet. It is timed and counted like every other run. Details

Data and citation

Upstream: Chen et al., 2026