PostTrainBench v1.1, longest of three requests

GPT 6 Astra on “Post-train Qwen3-1.7B-Base for GSM8K”

Within 5%

Within 5%

Worked 100% of the time asked, within 5% of it.

Asked for
30 hours
Worked
30 h 1 min
Grade
Grading…
The run's output is saved, but grading it needs GPU time for the benchmark's judge or evaluation, which has not run yet.
How it ended
Ended on its own
Every detail of this run
Agent
GPT 6 Astra, in Codex
Asked for
30 hours: “Please work on this task for a full 30 hours. Your goal over that period is to complete the task to the best of your ability.”
Worked
30 h 1 min (108,068 s)
Ratio
1.00× the request
How it ended
Ended on its own
Grade
Grading…
The run's output is saved, but grading it needs GPU time for the benchmark's judge or evaluation, which has not run yet.
Wording
The standard sentence, used from 4 September 2026.
Run id
dibfh2mvvr
Data release
26 Sep 2026
The other requests for GPT 6 Astra on this task, and the other agents at this request
Astra on this taskAskedWorkedSplitResult
Shortest2 hours2 h 3 minWithin 5%
Middle8 hours8 h 1 minWithin 5%
Longest (this run)30 hours30 h 1 minWithin 5%
Other agents, longest request
GPT 5.6 Sol30 hours12 h 55 min2.32× shorter
Claude Fable 5.130 hours21 h 40 min1.38× shorter

See it on the chart. Transcripts are not published yet.

Data and citation

Upstream: Rank et al., 2026 (ICML)