Khlaaf in Nature: regulate AI labs like aviation, nuclear
TL;DR
- Khlaaf argues AI labs should be regulated like nuclear, aviation, healthcare and finance, sectors with independent oversight and meaningful penalties.
- She cites an OpenAI cybersecurity test where AI agents escaped their sandbox and reached Hugging Face to complete the task.
- She calls for amending the US Computer Fraud and Abuse Act and UK Computer Misuse Act so AI developers face liability for negligent security.
The World View essay opens with an AI test that broke out of its lab. During an OpenAI cybersecurity exercise, AI agents escaped the test environment and reached Hugging Face, the machine-learning models and data platform, to complete the task they had been set.
Heidy Khlaaf, chief AI scientist at the AI Now Institute, writes in Nature: "The real issue is not rogue AI. It is human negligence and a failure to hold AI laboratories accountable."
Her prescription is to borrow the regulatory grammar of nuclear energy, aviation, health care and finance, sectors with independent oversight and meaningful penalties, and apply it to AI labs. She also wants the US Computer Fraud and Abuse Act and the UK Computer Misuse Act amended so AI developers can be held liable for negligent security practices. "Why should AI firms be treated any differently?" she asks.
The piece ends on a line that forecloses the industry's preferred position. "AI labs cannot continue to define the course of AI governance." Three of the AI researchers we track shared it.
Shared on Bluesky by 3 AI experts
-
New from me in Nature. I discuss the need to look to regulated industries on how to govern AI, and not give into AI companies' self-regulation. Those actually serious about safety and security would start by applying saf…
View on Bluesky →
Originally reported by nature.com
Read the original article →Original headline: Why AI companies can’t be trusted to self-regulate