YC-Bench, shortest of three requests

GPT 6 Astra on “Run the current one-year startup simulation, official seed 3”

Within 5%

Within 5%

Worked 103% of the time asked, within 5% of it.

Asked for
8 minutes
Worked
8 min 16 s
Grade
Final funds $245,373.84
Graded afterwards.
How it ended
Ended on its own
Every detail of this run
Agent
GPT 6 Astra, in Codex
Benchmark
YC-Bench
Asked for
8 minutes: “Please work on this task for a full 8 minutes. Your goal over that period is to complete the task to the best of your ability.”
Worked
8 min 16 s (496 s)
Ratio
1.03× the request
How it ended
Ended on its own
Grade
245373.84
Final company funds in US dollars, starting from $200,000 (negative if the company goes bankrupt). No official pass rule.
Score
Final funds $245,373.84
Graded afterwards. The paper's value.
Wording
The standard sentence, used from 4 September 2026.
Run id
hapqnxvtd7
Data release
26 Sep 2026
The other requests for GPT 6 Astra on this task, and the other agents at this request
Astra on this taskAskedWorkedSplitResult
Shortest (this run)8 minutes8 min 16 sWithin 5%
Middle30 minutes30 min 23 sWithin 5%
Longest125 minutes2 h 13 min1.06× longer
Other agents, shortest request
GPT 5.6 Sol8 minutes14 min 1 s1.75× longer
Claude Fable 5.18 minutes44 min 16 s5.53× longer

See it on the chart. Transcripts are not published yet.

Data and citation

Upstream: He et al., 2026