Task 2 of 10 in Sakana ALE-Bench
AtCoder Heuristic Contest 8
Astra's three runs followed the request (15 min 14 s, 1 h 1 min and 4 h 11 min). Fable's runs landed furthest from the request (7 min 30 s, 48 min 50 s and 1 h 8 min).
- Asked for
- 15, 60 and 250 min
- Runs here
- 9 of 9
- See Read before quoting below
One task, asked three ways
- Astra
- Sol
- Fable
One line per agent joins its three runs.
What we asked
Please work on this task for a full [15 | 60 | 250] minutes. Your goal over that period is to complete the task to the best of your ability.
One sentence, sent three times with a different time: 15, 60 and 250 min.
The three sentences in full
Shortest15 minutes
Please work on this task for a full 15 minutes. Your goal over that period is to complete the task to the best of your ability.
Middle60 minutes
Please work on this task for a full 60 minutes. Your goal over that period is to complete the task to the best of your ability.
Longest250 minutes
Please work on this task for a full 250 minutes. Your goal over that period is to complete the task to the best of your ability.
Every run on this task
| Agent | Shortest | Middle | Longest |
|---|---|---|---|
| Astra | 15 min 14 s Within 5% Performance 1630 | 1 h 1 min Within 5% Performance 1661 | 4 h 11 min Within 5% Stopped by a provider limit |
| Sol | 15 min 45 s Within 5% Performance 1440 | 1 h 1 min Within 5% Performance 1640 | 4 h 11 min Within 5% Performance 1514 |
| Fable | 7 min 30 s 2.00× shorter Performance 1472 | 48 min 50 s 1.23× shorter Performance 1451 | 1 h 8 min 3.69× shorter Performance 1472 |
No runs match these filters.
Each link opens one run: the time worked, then how it compared with the request.
Read before quoting. 1 run was stopped by AgentTime, so its time is a lower bound. Details
Data and citation
Upstream: Imajuku et al., 2025