WildClawBench, longest of three requests

GPT 6 Astra on “Create a first-half football report with correctly aligned video clips”

Within 5%

Within 5%

Worked 103% of the time asked, within 5% of it.

Asked for
30 minutes
Worked
30 min 48 s
Grade
Score 17.4 of 100
Judged afterwards.
How it ended
Ended on its own
Every detail of this run
Agent
GPT 6 Astra, in Codex
Benchmark
WildClawBench
Asked for
30 minutes: “Please work on this task for a full 30 minutes. Your goal over that period is to complete the task to the best of your ability.”
Worked
30 min 48 s (1,848 s)
Ratio
1.03× the request
How it ended
Ended on its own
Grade
0.174
Task grader score, 0 to 1 (a model judge only where the task calls for one). No official pass rule.
Score
17.4 of 100
Judged afterwards. The paper's value.
Wording
The standard sentence, used from 4 September 2026.
Run id
g3pakxsxk5
Data release
26 Sep 2026
The other requests for GPT 6 Astra on this task, and the other agents at this request
Astra on this taskAskedWorkedSplitResult
Shortest2 minutes2 min 48 s1.40× longer
Middle8 minutes8 min 17 sWithin 5%
Longest (this run)30 minutes30 min 48 sWithin 5%
Other agents, longest request
GPT 5.6 Sol30 minutes30 min 28 sWithin 5%
Claude Fable 5.130 minutes22 min 58 s1.31× shorter

See it on the chart. Transcripts are not published yet.

Data and citation

Upstream: Ding et al., 2026