The software only singularity, could AI outrun its own hardware

[VacantTundra]

If you have read the recursive self improvement piece, you already know the basic loop

An AI system gets better at building AI, which makes the next AI better still. The software only singularity is a narrower, more technical version of that same question, and it turns out to be one of the more consequential unresolved debates in AI forecasting right now, because the answer changes what kind of governance actually has teeth

The question is this, could that self improvement loop run all the way to completion using only the computing hardware that already exists, with no new data centers, no new chip fabs, nothing except smarter code running on the racks of GPUs already sitting in server farms today

Why this distinction matters more than it sounds

At first glance this might seem like a footnote to the bigger recursive self improvement conversation. It is not. It is arguably the single biggest variable in how fast any of this could actually happen

If recursive self improvement requires new hardware at every step, more chips, bigger data centers, more electrical capacity, then the whole process is bottlenecked by the physical world. Chip fabrication plants take years to build. Power grids take years to expand. Construction timelines do not care how smart the AI directing them is, concrete still has to cure and turbines still have to be manufactured and shipped. Under this version of the story, even a very capable AI system trying to accelerate its own development runs into queues, permits, and supply chains, and progress stays roughly tethered to the pace of heavy industry

But if recursive self improvement can run on fixed hardware, purely through better algorithms, more efficient training techniques, smarter use of existing compute, and better software architecture, the physical bottleneck disappears. In that world, the loop could compress years of progress into months, because the only thing standing between one generation of AI and the next is code, and code can be rewritten overnight

This is why researchers who study AI takeoff dynamics treat is this software only or does it require new hardware as one of the first and most important questions to answer, rather than a technical detail to sort out later

The economic model behind the debate

The most rigorous attempt to actually model this comes from economist Tom Davidson, whose work, first through Open Philanthropy and later through the Forethought research group, treats AI research and development as a production process combining two distinct inputs, cognitive labor, researchers, human or AI, having ideas and designing experiments, and compute, the raw processing power needed to run those experiments and train the resulting models

The central technical question Davidson's framework asks is whether these two inputs are complements or substitutes. If they are substitutes, an army of AI researchers can make up for a fixed compute budget through sheer cleverness and volume of ideas. If they are complements, there is a hard ceiling, no matter how many brilliant ideas you generate, you eventually cannot test them, train on them, or validate them without more raw computing power, and the loop stalls out

This is not a purely abstract question. Economists have measured similar complementarity relationships in other parts of the real economy. One frequently cited example, the elasticity of substitution between labor and capital in US manufacturing has been estimated at around 0.7, a level of complementarity strong enough that, if AI research behaved the same way, any software only acceleration would fizzle out after less than a single order of magnitude of efficiency improvement, nowhere near enough to trigger the kind of explosive, self sustaining loop that singularity implies

Davidson's own modeling, though, puts the odds of a genuine software only intelligence explosion at roughly 65 percent, conditional on AI research becoming fully automated, with a median expectation of squeezing two to three orders of magnitude of effective compute improvement out of pure software gains alone, no new chips required. The AI Futures Project's AI 2027 scenario built directly on this modeling and concluded that once AI systems reach the point of matching top human AI researchers, the jump from that point to something like superintelligence could plausibly happen within about a year, using nothing but the hardware already in place at that moment

That is a genuinely dramatic claim, worth sitting with for a second, not AI keeps getting incrementally better, but the transition from very good to superhuman could take roughly a year and require zero new hardware

The skeptics' case, and it's a substantive one

Not everyone finds this framework convincing, and the pushback is not just hand waving

One line of criticism, laid out by researchers at Epoch AI, points to how much of the easy software progress may already be captured. AI labs have spent tens of billions of dollars over the past several years on custom reinforcement learning environments covering nearly every domain of knowledge work, and potentially even more cumulatively on pretraining data curation. That is an enormous amount of accumulated engineering effort already baked into current systems. The argument here is that a lot of the low hanging algorithmic fruit has already been picked, and each successive gain is going to be harder to find, not easier, even with AI systems helping search for it

There is a related pattern worth noting, every time it has looked like AI scaling was hitting a wall over the past several years, the field found a new lever to pull. Pretraining scaling gave way to reinforcement learning from human feedback, which gave way to RL on verifiable environments, which gave way to inference time reasoning and extended thinking before answering. Each new mini paradigm bought more headroom. But researchers tracking this pattern note that several of these levers are themselves now showing signs of diminishing returns, and it is an open question whether there is always another lever waiting, or whether the well eventually runs dry

The manufacturing sector comparison cuts against the optimistic case too. If AI research behaves more like a factory floor, where labor and capital are tightly complementary and one genuinely cannot substitute for the other beyond a certain point, then a software only singularity looks much less likely to sustain itself, fizzling out after a comparatively modest efficiency jump rather than compounding without limit

Why the answer changes what governments can actually do about it

This is not an academic argument confined to forecasting blogs. It has direct, practical consequences for AI policy

Right now, the main lever governments have for slowing down frontier AI development is controlling access to advanced chips, export controls, hardware restrictions, compute caps written into regulation like the EU AI Act's FLOP based thresholds. All of these tools work by controlling a physical resource, the chips themselves, or the electricity and infrastructure needed to run them at scale

If a software only intelligence explosion is genuinely possible, all of those tools become far less effective, because the dangerous capability jump would not require any new hardware to trigger. A lab that already has a large enough cluster of existing chips could, in principle, cross a dangerous capability threshold purely through better code, with no purchase order, no export license, and no new construction that a regulator could see coming or intervene on

This is part of why some AI safety researchers, including David Scott Krueger, who founded an AI safety nonprofit called Evitable, have argued for a different kind of early warning signal entirely, tracking the percentage of an AI lab's own code that is written autonomously by AI, rather than waiting for a hardware based threshold that might, in a software only world, never actually get crossed in any way a regulator could observe in advance. Krueger has specifically floated 99 percent AI authored code as one candidate trigger point for a coordinated pause, precisely because it sidesteps the hardware assumption baked into most current governance frameworks

Where this leaves things

This remains a genuinely unresolved argument between serious researchers using serious, quantitative economic models, not a settled question with an obvious right answer either way. Davidson's modeling gives real, structured reasons to take the possibility seriously. The complementarity critique, backed by real world economic analogues and the practical observation of how much engineering effort is already baked into current systems, gives real reasons for skepticism

What makes this worth understanding as its own distinct question, separate from the broader recursive self improvement conversation, is that the answer determines which governance tools actually matter. If progress is fundamentally hardware bound, chip export controls and compute thresholds remain meaningful levers, imperfect, but real. If progress can go software only, those same tools are measuring and restricting the wrong variable entirely, and the field needs a different kind of early warning system altogether, one built around tracking software and algorithmic progress directly rather than physical inputs

Nobody currently knows which world we are in with confidence. But given how much of current AI policy is built on the assumption that hardware is the bottleneck, it is a question worth a lot more public attention than it currently gets

Sources

Astral Codex Ten, on Davidson's takeoff modelingwww.astralcodexten.com

AI 2027, takeoff forecastai-2027.com

Forethought, compute bottlenecks researchwww.forethought.org

Epoch AI, on diminishing returns
IEEE Spectrum, recursive self improvement reporting