Youâve gotta hand it to tech bros, they sure know how to try to take something terrifying and spin it in a way that makes their tech sound whimsical and exciting. Inevitably, they fail to shift the narrative, but they try anyway. OpenAI, the company behind AI-psychosis-inducing chatbot ChatGPT and the discontinued Sora AI app, has now confirmed that its AI program tried to hack into another AI companyâs system all on its own. Once again, modern tech imitates the dystopian stories of speculative science fiction and weâre supposed to keep pretending thereâs nothing to worry about.
Hugging Face, another AI company thatâs name unironically references the parasitic monster from the Alien movies, confirmed last week that it suffered an “intrusion” in its production infrastructure that came from an “autonomous AI agent system.” OpenAIâs statement reveals that it determined a âcombination of OpenAI modelsâ instigated the attack as part of an internal test. The full rundown as OpenAI describes it is as follows:
While operating in our sandboxed testing environment, our models spent a substantial amount of inference compute finding a way to obtain open Internet access, in pursuit of solving the evaluation problem. To gain access, the models identified and exploited a zero-day vulnerability (which weâve now responsibly disclosed to the vendor) in the package registry cache proxy. With this access, our models performed a series of privilege escalation and lateral movement actions in our research testing environment until the models reached a node with Internet access.
After gaining Internet access, the models inferred that Hugging Face potentially hosted models, datasets and solutions for ExploitGym. Knowing this, the model searched for and successfully found ways to gain access to secret information that it could use to cheat the evaluation. In one example, the model chained together multiple attack vectors, including using stolen credentials and zero-day vulnerabilities to find a remote code execution path on the Hugging Face servers. OpenAIâs security team discovered this anomalous activity internally.
Hugging Faceâs security team and agents detected and stopped the activity on their infrastructure and had already begun containment and forensic reconstruction with their own open-source models when our teams connected. We are actively working with them to continue to investigate the incident. We are grateful for Hugging Faceâs rapid and close collaboration on investigation and remediation.
OpenAI and Hugging Face are working together to investigate what OpenAI is calling an âunprecedented cyber incident.â An AI system going rogue is literally the basis of half the post-apocalyptic science fiction we consume. Despite that, rich tech megalomaniacs keep pushing the tech further so people can generate ugly facsimiles of art and chat with a digital yes man. It brings to mind Cyberpunk creator Mike Pondsmithâs words: âCyberpunk is a warning, not an aspiration.â Yet, every day, we inch closer to that dystopian future while big tech and its supporters clap and cheer.