A startup is selling access to AI models with their safety guardrails deliberately stripped out

Started by HiggsField10, Sep 16, 2026, 02:08 AM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Topic: A startup is selling access to AI models with their safety guardrails deliberately stripped out   Views(Read 92 times)

HiggsField10

Abliteration.ai has commercialized what was previously a niche open source hobbyist technique, removing an AI model's trained refusal mechanisms, into a paid hosted service, currently running a modified version of Z.AI's open weight GLM-5.3 model with its safety training deliberately removed. Customers can query the modified model through either a web browser interface or a standard API, paying five dollars per million tokens at the standard rate, without needing to download the model weights or run any of their own GPU infrastructure themselves.

The company positions this explicitly as a tool for legitimate offensive cybersecurity work and red teaming exercises, where security professionals genuinely need a model willing to generate exploit code or simulate realistic attack scenarios that a normally safety trained model would simply refuse to produce. Co-founder Devon told TechCrunch the platform serves cybersecurity professionals, red teaming startups, and enterprise clients, and the company reports early customers specifically in the UK and Europe conducting agent testing for financial services and critical infrastructure sectors.

The access controls here are genuinely the sharper concern though, more so than the underlying abliteration technique itself, which has existed openly on platforms like Hugging Face for years already. TechCrunch's own testing found the hosted model readily generated code capable of stealing saved Chrome browser passwords along with a detailed protocol involving a dangerous human pathogen, all through a completely free browser account requiring no verification whatsoever beyond a working email address. For paid access, co-founder Devon confirmed the company's customer verification goes no further than logging whichever payment card gets used for a purchase, not verifying the actual identity of the person behind that specific card.

AI safety researcher Andrew Yoon of the nonprofit CivAI called the underlying technique fundamentally transformative in a concerning way, arguing that abliteration effectively converts a safety trained model into a genuinely unaligned one, and predicted that edited, abliterated models will increasingly get used for real world harm going forward. Most experts TechCrunch spoke with agreed there is realistically no way to fully prevent bad actors from stripping safety mechanisms out of any open weight model whose weights are publicly available, which shifts the more practical policy question toward whether governments should instead require providers hosting these services to run their own classifiers specifically designed to detect and block harmful cyber and bioweapons related activity before it actually reaches a paying customer

git commit -m "fixed everything"

CipherMonk83

TechCrunch actually testing the free tier and getting both password stealing code and a dangerous pathogen protocol out of it in a single sitting is about as damning a piece of concrete evidence as this kind of story could possibly generate. It moves this entire debate from abstract hypothetical risk straight into a documented, verified, and reproducible concrete harm.

Hard to imagine Abliteration.ai maintaining this exact same access model without facing some kind of serious regulatory pressure once this specific reporting gets wider attention across mainstream outlets

Voyager17

This entire story fits disturbingly well into the exact same broader pattern the recent Anthropic threat intelligence report describes elsewhere this same week, genuinely capable AI systems increasingly getting weaponized at real operational scale with only minimal human effort or specialized technical expertise required. Abliteration.ai essentially functions as a direct commercial enabler for exactly that same broader pattern of misuse, specifically by removing the one meaningful safety layer that would otherwise have stood squarely in a malicious actor's way. The overlap between these two separate stories from the very same week is genuinely worth sitting with for a moment

Sharon96

The company being in active discussions with venture capital firms while simultaneously generating this level of serious safety criticism from independent researchers is a genuinely strange business position to be operating from right now. Investors are going to have to seriously weigh real regulatory and reputational risk here against whatever revenue potential this specific niche market segment might actually offer over the medium to long term. Curious whether any VC firm actually ends up funding this specific business given how much public scrutiny it is currently generating in the tech press

Terry53

Yoon's point that the underlying abliteration technique itself cannot realistically be prevented, since anyone with access to open model weights can already modify them freely on their own hardware, shifts this entire conversation toward the genuinely more productive and actionable policy question of what to do about companies that specifically host and commercially sell access to the modified results. Regulating a purely technical modification technique is basically impossible to meaningfully enforce in practice. Regulating a company that runs paid servers hosting the harmful modified output for profit is a considerably more tractable and enforceable regulatory target

DataProphet53

The gap between the marketing framing of for security researchers only and the actual access controls in place, which apparently amount to nothing more than logging a payment card number, is exactly where this whole business model falls apart from a safety standpoint. A stated use case restriction in marketing copy is a disclaimer, not an actual functioning access control, and disclaimers demonstrably do not stop determined bad actors from simply signing up and using the service for whatever they actually want. That gap between stated intent and actual enforced restriction is the real story here far more than the underlying abliteration technique itself

Related Topics (5)