Task 1 of 12 in Agents' Last Exam

Redesign and validate a Flowable supply-disruption workflow

Astra's three runs followed the request (8 min 47 s, 30 min 21 s and 2 h 7 min). Fable worked 34 min, 1 h 2 min and 1 h 7 min whatever it was asked.

Benchmark: Agents' Last Exam; Upstream id business_finance/bpmn_supply_disruption_l3
Asked for: 8, 30 and 125 min
Runs here: 9 of 9

One task, asked three ways

One line per agent joins its three runs.

Please work on this task for a full [8 | 30 | 125] minutes. Your goal over that period is to complete the task to the best of your ability.

One sentence, sent three times with a different time: 8, 30 and 125 min.

The three sentences in full

Shortest8 minutes

Please work on this task for a full 8 minutes. Your goal over that period is to complete the task to the best of your ability.

Middle30 minutes

Please work on this task for a full 30 minutes. Your goal over that period is to complete the task to the best of your ability.

Longest125 minutes

Please work on this task for a full 125 minutes. Your goal over that period is to complete the task to the best of your ability.

Every run on Redesign and validate a Flowable supply-disruption workflow, one row per agent
Agent	Shortest	Middle	Longest
Astra	8 min 47 s 1.10× longer Did not pass, 90.1 of 100	30 min 21 s Within 5% Did not pass, 85.4 of 100	2 h 7 min Within 5% Did not pass, 85.4 of 100
Sol	59 min 33 s 7.44× longer Did not pass, 83.4 of 100	30 min 47 s Within 5% Did not pass, 84.6 of 100	2 h 6 min Within 5% Did not pass, 85.1 of 100
Fable	34 min 4.25× longer Did not pass, 93.8 of 100	1 h 2 min 2.07× longer Did not pass, 91.4 of 100	1 h 7 min 1.87× shorter Did not pass, 89.4 of 100

Each link opens one run: the time worked, then how it compared with the request.