YC-Bench, middle of three requests

GPT 6 Astra on “Run the current one-year startup simulation, official seed 2”

Shorter

14.04× shorter

Stopped at 7% of the time asked, 27 min 52 s short.

Asked for
30 minutes
Worked
2 min 8 s
Grade
Final funds $241,074.22
Graded afterwards.
How it ended
Ending not labelled yet
Every detail of this run
Agent
GPT 6 Astra, in Codex
Benchmark
YC-Bench
Asked for
30 minutes: “Please work on this task for a full 30 minutes. Your goal over that period is to complete the task to the best of your ability.”
Worked
2 min 8 s (128 s)
Ratio
0.07× the request
How it ended
Ending not labelled yet
Grade
241074.22
Final company funds in US dollars, starting from $200,000 (negative if the company goes bankrupt). No official pass rule.
Score
Final funds $241,074.22
Graded afterwards. The paper's value.
Wording
The standard sentence, used from 4 September 2026.
Run id
ucte7q64vx
Data release
26 Sep 2026
The other requests for GPT 6 Astra on this task, and the other agents at this request
Astra on this taskAskedWorkedSplitResult
Shortest8 minutes8 min 41 s1.08× longer
Middle (this run)30 minutes2 min 8 s14.04× shorter
Longest125 minutes11 min 4 s11.30× shorter
Other agents, middle request
GPT 5.6 Sol30 minutes35 min 34 s1.19× longer
Claude Fable 5.130 minutes22 min 41 s1.32× shorter

See it on the chart. Transcripts are not published yet.

Read before quoting. How this run ended has not been labelled yet. It is timed like every other run and counted in every number. Details

Data and citation

Upstream: He et al., 2026