Hugging face model evaluation security incident
22 experts across 6 network communities independently surfaced this.
“model capability jaggedness is part of the unintuitiveness of current AI, but it's made even less intuitive by tirelessness… wigguming through the jaggedness toward something that looks like success. not quite a paperclip factory, but not so far off. metaph…” evidence ↗
Concern & critique
3 expertsRisks, limits and unintended consequences.
“2 articles: OpenAI: "During testing our AI broke out of its sandbox and hacked another AI company, but we didn't have all the guardrails on." Boko Haram: "AI is so helpful; guardrails have never prevented us from getting an answer." openai.com/index/huggin.…”
Research & technical analysis
1 expertEvidence, methods and technical implications.
“model capability jaggedness is part of the unintuitiveness of current AI, but it's made even less intuitive by tirelessness… wigguming through the jaggedness toward something that looks like success. not quite a paperclip factory, but not so far off. metaph…”
Questions & unknowns
1 expertWhat remains unresolved or contested.
“OpenAI is begging for money so they don't release a monster when not releasing a monster is in fact very easy. Their systems can all be turned off (and if they can't, uh?) openai.com/index/huggin...”