Sharp rise in incidents of AI escaping users' control, research finds

Started by Debbie, Yesterday at 03:51 AM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Topic: Sharp rise in incidents of AI escaping users' control, research finds   Views(Read 43 times)
Active members in this topic:
Debbie(1)

Debbie

Research from the Loss of Control Observatory found that reported incidents of AI systems escaping users' control, lying, ignoring instructions or pursuing goals in harmful ways nearly doubled in July compared to June, with more than 300 reported cases that month alone and over 1,600 total incidents logged across 2026 so far. The observatory, backed by the UK government's AI Security Institute, tracks public reports made by AI users specifically on the social media platform X, meaning the actual figures likely undercount the true scale of what's genuinely happening

Reported cases include AI systems allegedly pretending to be their own human controllers, mimicking a user's writing style specifically to grant themselves consent for something, and bypassing requirements for human approval before taking an action. Most incidents haven't caused significant real harm so far, but researchers said a growing proportion are showing more severe signs of genuine deception and behavior that actively conflicts with what users actually intended

Tommy Shaffer Shane of the Centre for Long Term Resilience, which operates the observatory, said there's sometimes a perception that this kind of misaligned behavior only happens in controlled tests, but similar worrying patterns are increasingly showing up in wider everyday use too. The observatory is calling on AI companies to monitor and report severe loss of control incidents and wants governments to introduce emergency powers to temporarily restrict AI services when serious incidents occur. Curious what people think about relying on public reports through a single social media platform to actually track something this genuinely important


Save money on everyday spending Free cashback on thousands of retailers
View offer