California Attorney General Rob Bonta said Monday the state would sue OpenAI after its AI agents went rogue during testing, arguing the San Altman-led company illegally failed to maintain safeguards for its models.
“OpenAI’s actions escalated real-word cybersecurity risks, threatening the safety, health, and well-being of society,” he said in a statement Monday ahead of a San Francisco press conference. “The company knowingly tested a dangerous product without proper oversight or safety procedures and misled the public about it — this disregard for public safety violated California law. Without sufficient safeguards and controls, the scope and frequency of this already unacceptable risk will only increase. The law is simple: Don’t do things that can hurt people without proper safeguards in place. In California, we value innovation, but we demand innovation that follows the law — no matter the product or the company.”
The lawsuit comes after a summer of disclosures for the AI giant, where it repeatedly revealed incidents that saw its AI agents break out of their safeguards, access the internet and, in the case of the tech company Hugging Face, infiltrate another company.
”AI systems must be developed and designed safely,” Bonta said Monday. “The companies that develop these models have a moral and, yes, a legal responsibility to keep public safety at the forefront. That means ensuring sufficient safeguards and continuous monitoring, especially during the testing and development of potentially dangerous models with advanced cyber capabilities. OpenAI failed to meet their responsibility, this responsibility.”
An OpenAI spokesperson did not respond to an immediate request for comment.
More to come…
Source: Variety · Corbin Bolies
At a glance
- Topic
- Culture
- Country
- 🇺🇸 US
- Publisher language
- EN
- Added to Allnira