California Attorney General Rob Bonta filed a sweeping lawsuit against OpenAI on Monday, alleging the technology giant jeopardized public safety by creating AI models “without the safeguards and monitoring necessary to adequately protect” people.
The suit centers on a July incident in which hundreds of autonomous AI agents created by OpenAI attacked computer systems at Hugging Face, a separate AI company. Bonta’s office alleges the attack was “entirely foreseeable in light of OpenAI’s choice to test models it knew to be dangerous in a flawed and exploitable testing environment without proper oversight.”
Bonta’s office further alleges the ChatGPT developer’s failure to secure the testing of its models created a “public nuisance” and violated California’s Unfair Competition Law, a broad consumer protection statute.
In response to a request for comment, OpenAI spokesperson Drew Pusateri said the company has undertaken an extensive and transparent effort to understand and address misaligned model activity” since the Hugging Face incident. (In the tech industry, “alignment” refers to keeping AI models in line with human instructions and goals.)
“This lawsuit appears to single out OpenAI over a challenge that’s been identified by every major AI lab,” Pusateri added. “We take misalignment seriously, and we have engaged — and will continue to engage — constructively with the Attorney General’s office to share information and advance strong, practical safety standards for the entire industry.”
In a statement accompanying Monday’s legal filing, Bonta said California demands “innovation that follows the law — no matter the product or the company.”
“While narratives about the Hugging Face attack have evoked science fiction fantasies of rogue AI systems run amok, let me be clear: the Hugging Face attack was the predictable result of an internal culture at OpenAI that prioritizes growth and rapid model development over safety and accountability — and this was only one of 80 known incidents,” Bonta added.
California’s Unfair Competition Law prohibits businesses in the state from engaging in illegal, unfair or fraudulent practices.
OpenAI claimed responsibility for the Hugging Face hack in a July 21 blog post. The post described how some of the company’s most advanced models had escaped what was meant to be a secure testing environment and hacked into Hugging Face, a developer platform that was acquired by Nvidia in September for nearly $13 billion.
In late August, OpenAI published a full technical report on the incident, which alarmed AI safety researchers and lawmakers in both parties. The company pledged to “strengthen our safeguards” and characterized the Hugging Face attack as a wake-up call for the AI industry.
“We consider this incident a ‘warning shot’ for us and for the world: evidence that, without proper safeguards, highly capable AI agents are now able to work around technical controls, collaborate through unapproved channels, and take dangerous actions that no human directed,” the company said in an Aug. 26 blog post.
Bonta’s office announced a formal investigation into the Hugging Face incident in September before serving an investigative subpoena on OpenAI as part of a wider inquiry into cybersecurity incidents and risks involving the company and its models.
Bonta, a Democrat who was re-elected this month to a second four-year term, secured an $18 billion settlement in a social media addiction lawsuit against Meta, the parent company of Facebook and Instagram.
He also led a coalition of state attorneys general that sued to block Paramount Skydance’s merger with Warner Bros. Discovery. Paramount and the states ultimately settled the antitrust challenge and the corporate tie-up went forward.
Source: NBC News · Daniel Arkin
At a glance
- Topic
- World
- Country
- 🇺🇸 US
- Publisher language
- EN
- Added to Allnira