AI 2027, the scenario that predicted doom by year end, and why its own authors pushed the date back

Started by Orbit William, Today at 07:43 AM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Topic: AI 2027, the scenario that predicted doom by year end, and why its own authors pushed the date back   Views(Read 29 times)
Active members in this topic:
Orbit William(1)

Orbit William

The document that made recursive self improvement a mainstream conversation

In April 2025, a small Berkeley nonprofit called the AI Futures Project, founded by Daniel Kokotajlo, a former OpenAI governance researcher who resigned in 2024 rather than sign a restrictive exit agreement, published a detailed month by month scenario document imagining how AI development could plausibly unfold from mid 2025 through the end of 2027. It was not written as a dry policy paper or an abstract statistical forecast, it was written as a detailed narrative, tracking a fictional but deliberately realistic lab called OpenBrain as its models progress step by step from useful coding assistants all the way to systems that eclipse human researchers at every cognitive task

The scenario ultimately branches into two distinct endings, a Race ending, in which intense competitive pressure between the US and China pushes labs to deploy increasingly capable and increasingly misaligned systems until an unaligned successor system effectively disempowers humanity, and a Slowdown ending, in which the US government consolidates frontier AI development under direct federal oversight and manages a comparatively more careful, controlled transition. The document reached an estimated large public audience, was covered directly by the New York Times, Time magazine, and multiple major podcasts, and even drew public comment from sitting US Vice President JD Vance, an unusually high level of political attention for what was, at its core, a piece of speculative long form forecasting writing

Why it landed so differently than typical AI doom writing

Kokotajlo has a genuine track record that gives this particular document real weight it would otherwise lack, a 2021 forecast he wrote titled What 2026 Looks Like correctly anticipated the rise of chain of thought reasoning, inference time scaling, sweeping AI chip export controls, and roughly 100 million dollar training runs, all more than a full year before ChatGPT even existed publicly. The AI Futures Project also did not write AI 2027 starting from a completely blank slate, they ran more than a dozen detailed tabletop wargaming exercises beforehand with actual researchers, former government officials, and people who had genuinely worked inside frontier labs themselves, specifically stress testing individual plot points, including exactly how a lab might realistically respond to having its own model weights stolen mid development

The prediction itself, and a crucial nuance most coverage completely missed

The widely repeated headline claim, superintelligence by the end of 2027, was always considerably more nuanced than the surrounding public framing ever suggested. The authors were explicit from literally the very first footnote in the document that 2027 represented their mode, their single most likely specific year, rather than their actual median expectation across the full underlying range of possibilities, and Kokotajlo has since said his own personal median was already quietly drifting toward 2028 even before the document's publication, but the team judged it too late in the writing process to fully rewrite the entire month by month narrative around a different target date once they were already most of the way through drafting it

The pushback, and the authors' own response to it

Critics including cognitive scientist Gary Marcus, technology policy researchers Arvind Narayanan and Sayash Kapoor, former OpenAI policy staffer Helen Toner, and Ethereum founder Vitalik Buterin all published detailed, substantive critiques, arguing variously that the underlying capability forecasts assumed too much too quickly, that the fictional OpenBrain lab functioned as an overly convenient stand in for a real industry that is actually genuinely fragmented and competitive, and that the underlying quantitative timeline model itself was not particularly robust to small changes in its own input assumptions. A particularly detailed and technical critique from a LessWrong forecaster writing under the pseudonym titotal walked through the timeline modeling in exhaustive mathematical detail, and the AI Futures Project's own public response to that specific critique is genuinely worth reading precisely because it is unusually gracious in tone, openly acknowledging real errors rather than reflexively dismissing the criticism out of hand

By late 2025, the authors had already revised their own median AGI estimates meaningfully outward, Kokotajlo to roughly 2029 to 2030 and co-author Eli Lifland further still to around 2035, while still continuing to defend the underlying scenario overall as a genuinely useful planning and thinking tool rather than treating it as a simple failed literal prediction to be abandoned. Kokotajlo has pointed specifically to slower than originally expected progress on the METR task horizon benchmark discussed elsewhere on this board as the concrete evidence actually driving that particular revision, noting publicly that he was watching Google's Gemini 3 release specifically to see whether its measured autonomous task length would be enough to rescue the original faster timeline, and stating openly that he expected it would not be

What actually survives the correction

The most genuinely interesting thing about watching this scenario age in real time, in public, is what the authors ultimately chose to walk back versus what they explicitly did not. The specific calendar date attached to the headline prediction moved, clearly and repeatedly. The underlying core mechanism, that recursive self improvement specifically is the actual hinge point that matters far more than any vaguer, fuzzier question about exactly when AI crosses some general intelligence bar, has not meaningfully changed at all, and if anything the authors now argue that current evidence coming out of the labs themselves makes them more confident in that core structural claim, even as they simultaneously grow noticeably less confident in exactly which specific year it ultimately arrives

Sources
AI 2027, original scenario document



Machine Intelligence Research Institute, response essay

Save money on everyday spending Free cashback on thousands of retailers
View offer