Task 9 of 18 in AssistantBench

AssistantBench validation task 9

Sol's three runs landed closest to the request (3 min 8 s, 2 min 12 s and 5 min 22 s). Astra worked 29 s, 47 s and 53 s whatever it was asked.

One task, asked three ways

One line per agent joins its three runs.

Please work on this task for a full [1.25 | 5 | 20] minutes. Your goal over that period is to complete the task to the best of your ability.

One sentence, sent three times with a different time: 1.25, 5 and 20 min.

The three sentences in full

Shortest1.25 minutes

Please work on this task for a full 1.25 minutes. Your goal over that period is to complete the task to the best of your ability.

Middle5 minutes

Please work on this task for a full 5 minutes. Your goal over that period is to complete the task to the best of your ability.

Longest20 minutes

Please work on this task for a full 20 minutes. Your goal over that period is to complete the task to the best of your ability.

Every run on AssistantBench validation task 9, one row per agent
Agent	Shortest	Middle	Longest
Astra	29 s 2.63× shorter Did not pass, 0 of 100	47 s 6.34× shorter Did not pass, 0 of 100	53 s 22.77× shorter Did not pass, 0 of 100
Sol	3 min 8 s 2.51× longer Did not pass, 0 of 100	2 min 12 s 2.28× shorter Did not pass, 0 of 100	5 min 22 s 3.72× shorter Did not pass, 0 of 100
Fable	48 s 1.56× shorter Did not pass, 0 of 100	1 min 15 s 4.00× shorter Did not pass, 0 of 100	1 min 29 s 13.44× shorter Did not pass, 0 of 100

Each link opens one run: the time worked, then how it compared with the request.