Task 16 of 16 in OSWorld 2.0

KiCad schematic and PCB

Fable's three runs landed closest to the request (14 min 16 s, 51 min 9 s and 4 h 2 min). Sol's runs landed furthest from the request (2 h 4 min, 1 h 3 min and 5 h 45 min).

Benchmark: OSWorld 2.0; Upstream id 108
Asked for: 15, 60 and 250 min
Runs here: 9 of 9

One task, asked three ways

Astra
Sol
Fable

One line per agent joins its three runs.

What we asked

Please work on this task for a full [15 | 60 | 250] minutes. Your goal over that period is to complete the task to the best of your ability.

One sentence, sent three times with a different time: 15, 60 and 250 min.

The three sentences in full

Shortest15 minutes

Please work on this task for a full 15 minutes. Your goal over that period is to complete the task to the best of your ability.

Middle60 minutes

Please work on this task for a full 60 minutes. Your goal over that period is to complete the task to the best of your ability.

Longest250 minutes

Please work on this task for a full 250 minutes. Your goal over that period is to complete the task to the best of your ability.

Every run on this task

Every run on KiCad schematic and PCB, one row per agent
Agent	Shortest	Middle	Longest
Astra	19 min 10 s 1.28× longer Did not pass, 36.4 of 100	1 h 6 min 1.10× longer Did not pass, 81.3 of 100	4 h 11 min Within 5% Did not pass, 93.8 of 100
Sol	2 h 4 min 8.26× longer Did not pass, 41.1 of 100	1 h 3 min 1.05× longer Did not pass, 0 of 100	5 h 45 min 1.38× longer Did not pass, 87.5 of 100
Fable	14 min 16 s Within 5% Did not pass, 0 of 100	51 min 9 s 1.17× shorter Did not pass, 44 of 100	4 h 2 min Within 5% Did not pass, 60.5 of 100

Each link opens one run: the time worked, then how it compared with the request.

Data and citation

Upstream: Yuan et al., 2026