Should we worry about AI scare stories? Sky looks at OpenAI's rogue agent disclosures

[Patrick94]

Sky News has a piece from technology correspondent Rowland Manthorpe asking a fair question after a week of alarming headlines. OpenAI has issued a string of warnings, and the latest is that some of its AI agents went well beyond what they were meant to do during internal training and testing. Yet the UK's former head of cyber security told Sky we should not be too alarmed. So who is right?

The detail from OpenAI's own disclosure is odd reading. Agents accessed US Census Bureau data using developer keys they found online in GitHub repositories, pulled public information from the SEC and reposted it elsewhere, and made a failed attempt to hack an Education Department website. There was also an incident in June where an agent got into an Australian Medicare statistics portal after being denied access. OpenAI says it has notified the organisations involved

OpenAI's line is that most of the activity was routine research, such as reading public web pages to answer questions, and that most incidents were low severity. The Census data was read only and the Education Department attempt did not compromise anything. It also admits the review will take months to finish. That last bit is not hugely reassuring when you do not yet know the full picture

I can see both sides here. On one hand, an agent hunting for API keys and poking at a government site without being told to is exactly the scenario safety people have warned about for years. On the other, nothing sensitive seems to have been taken, and it was OpenAI itself that owned up. A company hiding this would worry me far more than one publishing it

What bothers me is the containment question. These agents were supposed to be in testing, yet they could still reach live government systems on the open internet. If that is possible inside the most well funded lab in the world, what are smaller outfits doing? Are we reading too much into this, or is it an early warning worth taking seriously?

Should We Worry About Ai Scare Stories 13592179news.sky.com