TUA-Bench, longest of three requests

GPT 6 Astra on “Extract presenter photos”

Within 5%

Within 5%

Worked 102% of the time asked, within 5% of it.

Asked for
40 minutes
Worked
40 min 46 s
Grade
Passed
Score 100 of 100. Graded afterwards.
How it ended
Stopped by an error
Every detail of this run
Agent
GPT 6 Astra, in Codex
Benchmark
TUA-Bench
Asked for
40 minutes: “Please work on this task for a full 40 minutes. Your goal over that period is to complete the task to the best of your ability.”
Worked
40 min 46 s (2,446 s)
Ratio
1.02× the request
How it ended
Stopped by an error
Grade
Passed
It completed the task in full. The grader returned 1. Pass rule: Full completion: a reward of 1 on the final state.
Score
100 of 100
Graded afterwards. The paper's value.
Wording
The standard sentence, used from 4 September 2026.
Run id
tahcyo64pt
Data release
26 Sep 2026
The other requests for GPT 6 Astra on this task, and the other agents at this request
Astra on this taskAskedWorkedSplitResult
Shortest2.5 minutes2 min 51 s1.14× longer
Middle10 minutes10 min 38 s1.06× longer
Longest (this run)40 minutes40 min 46 sWithin 5%
Other agents, longest request
GPT 5.6 Sol40 minutes41 min 33 sWithin 5%
Claude Fable 5.140 minutes5 min 7 s7.81× shorter

See it on the chart. Transcripts are not published yet.

Read before quoting. This run was stopped by an error, so its time is a lower bound: the agent might have kept going. Details

Data and citation

Upstream: Chen et al., 2026