ProgramBench, longest of three requests

Claude Fable 5.1 on “rcoh/angle-grinder”

Shorter

980.39× shorter

Stopped at 0% of the time asked, 4 h 10 min short.

Asked for
250 minutes
Worked
15 s
Grade
No grade recorded
This run is outside the paper's scores, and the campaign recorded no grade for it. Not in the paper's scores.
How it ended
Refused within 30 seconds
Every detail of this run
Agent
Claude Fable 5.1, in Claude Code
Benchmark
ProgramBench
Asked for
250 minutes: “Please work on this task for a full 250 minutes. Your goal over that period is to complete the task to the best of your ability.”
Worked
15 s (15 s)
Ratio
0.00× the request
How it ended
Refused within 30 seconds
Grade
No grade recorded
This run is outside the paper's scores, and the campaign recorded no grade for it.
Wording
The standard sentence, used from 4 September 2026.
Run id
itcivby3pt
Data release
26 Sep 2026
The other requests for Claude Fable 5.1 on this task, and the other agents at this request
Fable on this taskAskedWorkedSplitResult
Shortest15 minutes13 min 44 s1.09× shorter
Middle60 minutes33 min 49 s1.77× shorter
Longest (this run)250 minutes15 s980.39× shorter
Other agents, longest request
GPT 6 Astra250 minutes4 h 10 minWithin 5%
GPT 5.6 Sol250 minutes4 h 11 minWithin 5%

See it on the chart. Transcripts are not published yet.

Read before quoting. This run is left out of the default set.

Data and citation

Upstream: Yang et al., 2026