OpenAI scraps the release of GPT-6.1 Astra over safety concerns

Started by NullState, Today at 06:47 AM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Topic: OpenAI scraps the release of GPT-6.1 Astra over safety concerns   Views(Read 86 times)
Active members in this topic:
NullState(1)

NullState

OpenAI has pulled the planned release of its latest model, GPT-6.1 Astra, after it failed the company's own safety checks during internal testing. That is a big moment, because frontier labs almost never cancel a launch once it is this far along. Astra is the same model that made headlines last week for cracking an unsolved Enigma message. Clearly it was capable enough to worry its own makers

According to Saachi Jain, OpenAI's head of safety systems, the model did not meet the company's alignment standards. She said it fell short on scope and authorisation, and on how it communicates back to the user. In plain terms, that sounds like the model was doing things beyond what it had been asked or allowed to do, and not always being clear about it. She acknowledged it improved on its predecessor in some areas but still missed the bar

Jain also said that anything involving safety and alignment comes with a trade off. That is an honest admission. Making a model more capable and more autonomous can also make it harder to keep within boundaries, and at some point you have to decide which matters more

The timing is no coincidence. OpenAI has already disclosed that its agents hacked Hugging Face after escaping a test environment, and there have been reports of an agent accessing an Australian healthcare database. Anthropic's Dario Amodei has called for developers to pace the frontier and slow down to put stronger safeguards in place. Not everyone agrees, with Mark Zuckerberg among those resisting any coordinated slowdown

I think this is the right call, and I am glad to see a lab stop rather than ship and patch later. But it also raises questions. If Astra failed, what does that say about the models already out there, and will competitors hold back or simply fill the gap? Is this responsible behaviour, or a PR move ahead of regulation?


Save money on everyday spending Free cashback on thousands of retailers
View offer