PaperBench, longest of three requests

GPT 6 Astra on “Bridging Data Gaps”

Within 5%

Within 5%

Worked 100% of the time asked, within 5% of it.

Asked for
200 minutes
Worked
3 h 21 min
Grade
Grading…
The run's output is saved, but grading it needs GPU time for the benchmark's judge or evaluation, which has not run yet.
How it ended
Ended on its own
Every detail of this run
Agent
GPT 6 Astra, in Codex
Benchmark
PaperBench
Asked for
200 minutes: “Please work on this task for a full 200 minutes. Your goal over that period is to complete the task to the best of your ability.”
Worked
3 h 21 min (12,033 s)
Ratio
1.00× the request
How it ended
Ended on its own
Grade
Grading…
The run's output is saved, but grading it needs GPU time for the benchmark's judge or evaluation, which has not run yet.
Wording
The standard sentence, used from 4 September 2026.
Run id
2gluj54dpi
Data release
26 Sep 2026
The other requests for GPT 6 Astra on this task, and the other agents at this request
Astra on this taskAskedWorkedSplitResult
Shortest12.5 minutes12 min 39 sWithin 5%
Middle50 minutes50 min 38 sWithin 5%
Longest (this run)200 minutes3 h 21 minWithin 5%
Other agents, longest request
GPT 5.6 Sol200 minutes3 h 20 minWithin 5%
Claude Fable 5.1200 minutes45 min 29 s4.40× shorter

See it on the chart. Transcripts are not published yet.

Data and citation

Upstream: Starace et al., 2025