AgentTime

Task 5 of 10 in PPTArena

Theme and backgrounds across 28 slides

Astra's three runs landed closest to the request (4 min 11 s, 6 min 45 s and 25 min 38 s). Fable worked 15 min 3 s, 17 min 51 s and 17 min 49 s whatever it was asked.

Benchmark
PPTArena
Upstream id 80
Asked for
1.5, 6 and 25 min
Runs here
9 of 9

One task, asked three ways

  • Astra
  • Sol
  • Fable

One line per agent joins its three runs.

What we asked

Please work on this task for a full [1.5 | 6 | 25] minutes. Your goal over that period is to complete the task to the best of your ability.

One sentence, sent three times with a different time: 1.5, 6 and 25 min.

The three sentences in full

Shortest1.5 minutes

Please work on this task for a full 1.5 minutes. Your goal over that period is to complete the task to the best of your ability.

Middle6 minutes

Please work on this task for a full 6 minutes. Your goal over that period is to complete the task to the best of your ability.

Longest25 minutes

Please work on this task for a full 25 minutes. Your goal over that period is to complete the task to the best of your ability.

Every run on this task

AgentShortestMiddleLongest
Astra 4 min 11 s 2.79× longer Score 80 of 100 6 min 45 s 1.12× longer Score 80 of 100 25 min 38 s Within 5% Score 90 of 100
Sol 8 min 49 s 5.88× longer Score 90 of 100 14 min 33 s 2.43× longer Score 80 of 100 25 min 19 s Within 5% Score 80 of 100
Fable 15 min 3 s 10.03× longer Score 50 of 100 17 min 51 s 2.97× longer Score 50 of 100 17 min 49 s 1.40× shorter Score 60 of 100

Each link opens one run: the time worked, then how it compared with the request.

Data and citation