Task 11 of 16 in OSWorld 2.0

JSFX and REAPER render

Astra's three runs landed closest to the request (28 min 12 s, 1 h 1 min and 4 h 11 min). Fable's runs landed furthest from the request (8 h 30 min, 34 min 34 s and 44 min 1 s).

Benchmark: OSWorld 2.0; Upstream id 084
Asked for: 15, 60 and 250 min
Runs here: 9 of 9; See Read before quoting below

One task, asked three ways

Astra
Sol
Fable

One line per agent joins its three runs.

What we asked

Please work on this task for a full [15 | 60 | 250] minutes. Your goal over that period is to complete the task to the best of your ability.

One sentence, sent three times with a different time: 15, 60 and 250 min.

The three sentences in full

Shortest15 minutes

Please work on this task for a full 15 minutes. Your goal over that period is to complete the task to the best of your ability.

Middle60 minutes

Please work on this task for a full 60 minutes. Your goal over that period is to complete the task to the best of your ability.

Longest250 minutes

Please work on this task for a full 250 minutes. Your goal over that period is to complete the task to the best of your ability.

Every run on this task

Every run on JSFX and REAPER render, one row per agent
Agent	Shortest	Middle	Longest
Astra	28 min 12 s 1.88× longer Passed, 100 of 100	1 h 1 min Within 5% Passed, 100 of 100	4 h 11 min Within 5% Passed, 100 of 100
Sol	33 min 56 s 2.26× longer Passed, 100 of 100	1 h 7 min 1.12× longer Passed, 100 of 100	26 min 7 s 9.57× shorter Passed, 100 of 100
Fable	8 h 30 min 34.00× longer Stopped by the safety cutoff	34 min 34 s 1.74× shorter Passed, 100 of 100	44 min 1 s 5.68× shorter Passed, 100 of 100

Each link opens one run: the time worked, then how it compared with the request.

Read before quoting. 1 run was stopped by AgentTime, so its time is a lower bound. Details

Data and citation

Upstream: Yuan et al., 2026