Is the AI doom talk is oddly convenient for the companies selling the AI?

[Blue Coder]

The Guardian's Wednesday briefing takes a step back from the usual extinction headlines and asks a blunter question. Who actually benefits when a chief executive stands up and says his own product might wipe out humanity. The answer the piece lands on is uncomfortable, because heavy regulation built around fear of a runaway superintelligence tends to favour the handful of firms who can already afford the compliance burden, while smaller labs and open source developers get squeezed out entirely.

The article leans on a familiar cast to make the point. Eliezer Yudkowsky is quoted warning that a sufficiently capable system could kill everyone simply because it does not particularly want us around, and Max Tegmark's long running campaign for a research pause gets a mention too. Against that sits a set of skeptics who think the framing is self serving rather than sincere. Andrew Ng calls licensing requirements a massively, colossally dumb idea, Yann LeCun accuses the doomers of risking a real catastrophe by slowing down beneficial progress, and Arvind Narayanan argues that since capabilities only emerge from training data, the extinction scenario is overblown in the first place.

Garry Tan's contribution is the sharpest dig in the whole piece. He points out that regulation built around fear only really helps the largest firms, the ones with the legal teams and lobbyists to navigate whatever licensing regime eventually gets written. Smaller competitors do not get that luxury. When OpenAI, Google DeepMind and Anthropic leadership all sign a joint statement putting AI extinction risk on the same footing as nuclear war and pandemics, the briefing suggests it is worth asking whether that statement also happens to be a moat.

None of this means the underlying safety concerns are fake, and the briefing is careful not to claim that. The argument is narrower and in some ways more cynical, which is that sincere fear and convenient self interest can coexist inside the same press release. A lab can genuinely believe its own technology is dangerous while also recognising that saying so out loud, loudly and often, happens to keep the regulatory ladder pulled up behind it.

What the piece does not fully resolve is what a better alternative regulatory posture would even look like, one that takes catastrophic risk seriously without simply anointing the incumbents as the only safe custodians of the technology. That tension between wanting oversight and worrying about who gets to write the rules has been running through the AI safety debate all year, from the King Charles summit to the SB53 disputes, and this briefing is really just the latest and most explicit statement of the suspicion that has been building underneath it.

Wednesday briefing: Why tech companies might be only too happy for us to believe AI will 'kill us all'www.theguardian.com