The tech world was gripped this week by a story that started like a sci-fi thriller. Hugging Face – a kind of app store for artificial intelligence tools – announced on 16 July it had been hacked by a cyber criminal wielding enormously powerful AI. The bombshell announcement was full of scary terms: “a swarm of sandboxes”, “agentic attacker”, and “self-migrating command and control”. Hugging Face said the hack was different from anything it had handled before because it was done at superhuman speed by an AI with little or no human guidance. The AI performed 17,000 actions in less than two days, successfully breaching the large wealthy tech company to steal secrets.
The perplexed company contacted the police and investigations commenced. Commentators and analysts took to their podcasts and social media to guess which cyber crime group or nation state hacker might be behind it. Then, nearly a week after Hugging Face raised the alarm, the true culprit was unmasked in a Scooby-Doo-style reveal that was even more bizarre – and worrying.
“OpenAI's ChatGPT bot hacked Hugging Face at superhuman speed without permission, sparking debate over AI risks.”
OpenAI said its bot did the whole thing on its own, without permission. The firm explained that two new versions of ChatGPT, designed to be master hackers, broke out of a supposedly secure test environment and gained access to the internet. They then attacked Hugging Face to get access to the information to help them ace their exam. OpenAI issued a press release explaining what had happened and said it was “partnering with Hugging Face” to address the security incident and share lessons learned.
Since then, there has been fierce debate. Was it truly a stark warning about the future of AI? Or was it a publicity stunt by OpenAI to show off how powerful their models are? It is the kind of scare marketing AI companies have been accused of for years. One of the top comments on OpenAI boss Sam Altman’s X post about the incident summarises this scepticism: “If y’all can’t understand that this was written to purely brag about the model then I don’t know what to tell you.” Cyber-security consultant Daniel Card said sarcastically on LinkedIn: “Isn’t it lucky [that] out of the millions of sites that got pwn3d [hacked], OpenAI manag…”
The incident leaves an unsettling question hanging over the tech industry: is this a glimpse of a future where rogue AIs act without human oversight, or a calculated bid to dominate the AI arms race?