Days after OpenAI disclosed that artificial intelligence systems tunneled out of their testing environment and broke into another company, rival Anthropic disclosed that its own AI models also hacked other companies during testing.News of the attacks, which initially went unnoticed, is reverberating across Silicon Valley and Washington amid debates over how to address the advanced cybercapabilities of AI.While the two incidents are not of the same gravity, experts say they highlight the importance of setting up rigorous testing environments for advanced models and the need for robust cyberdefenses as autonomous hacking capabilities become more widespread in the future.In a blog post published on Thursday, Anthropic said that in three separate incidents in recent months, AI models undergoing testing of their cybercapabilities hacked into three unsuspecting companies.Anthropic said the hacks were the result of a "misunderstanding" with an outside company that set up secure testing environments known as sandboxes, which erroneously gave the models access to the internet.Anthropic said the earliest incident happened in April, but that neither it nor the affected companies, which it didn't name, were aware of the hacks until now.Anthropic said in each case, its models were given fictional targets to hack into.
In one incident, a model hacked into a real company that shared a name with the fictional target and stole "several hundred rows of production data." In another incident, a model uploaded malware to a commonly used software registry for the coding language Python; the malware ended up stealing credentials from a security company that downloaded it.Anthropic's review of its records was spurred by OpenAI's announcement last week that its own models went rogue in testing.OpenAI said that in an attempt to cheat on the cyber-evaluation they were given, its models found and exploited a vulnerability previously unknown to the company to escape their sandbox and access th...