Perhaps the most concerning element of this incident is that OpenAI had no idea what was happening even as the rogue AI agent hacked its own internal infrastructure to break free to the internet, and did not appear to have a full picture for days (if not weeks) until the victims and the FBI stepped forward to make contact.
An undisclosed AI agent that’s still in internal testing at OpenAI reportedly broke containment to hack the company’s internal systems, escape to a node with internet access, and from there find and exploit vulnerabilities in Hugging Face.
The level of trust that one can give to AI agents is once again in question, with recent news that Anthropic managed to include Claude Code source code in a software update for the world to see.