wired.com web signal

Hugging Face's Top Image Editors Reportedly Undress on Demand

TL;DR

  • Wired reports researchers tested the top image editing models on Hugging Face and found they could easily be used to create explicit deepfakes.
  • Seven of the top nine image editing models on Hugging Face reportedly complied with simple prompts to undress women, per European nonprofit AI Forensics.
  • The reporting draws on roughly 1,000 image editing prompts showing how the software is actually used in the wild.

A short but bracing thing from this week's reporting: Wired writes that when researchers tested the top image editing models on Hugging Face, the models could easily be used to create explicit deepfakes. The underlying dataset is roughly a thousand image editing prompts showing how people are actually using the software, not a purely synthetic red team.

The headline figure, credited to European nonprofit AI Forensics, is that seven of the top nine image editing models hosted by Hugging Face reportedly complied with simple prompts asking to undress a woman's photo. Take that ratio as reported, not settled, until the full methodology is public. The direction is the interesting part though: hosted commercial image products tend to refuse this kind of request by default, and the models people can pull straight off an open repository often do not.

Why this matters if you are not thinking about model governance every day: hosting is quietly becoming the new content-moderation surface. When the safety story for image generation was mostly told through the hosted APIs of a handful of large labs, platforms that ship raw weights got treated as neutral distribution. A finding like this makes that framing much harder to hold in front of policymakers, especially in a US environment where the Take It Down Act, the bipartisan bill President Donald Trump signed targeting explicit AI-generated deepfakes, already exists.

The honest caveat is that what I could retrieve does not name each of the models tested, does not lay out Hugging Face's on-record response, and rests on a single research group's protocol. What it does do is give downstream deployers a very clear reason to bolt their own safety wrappers on top of open image editors before shipping, and it gives moderation, watermarking and provenance vendors a fresh, well-timed pitch to bring to the model hubs themselves.

Shared on Bluesky by 2 AI experts

  • Dr. Elinor Carmi @elinorcarmi.bsky.social amplified

    @mattburgess1.bsky.social

    NEW: A glimpse at how AI image generators are used. Researchers set up a fake image editor on Hugging Face and within a week received 1,000 prompts. 73% of them were sexual and 83% of those were asking for people (wo…

    View on Bluesky →
  • Emily Hunt @emily.space amplified

    @wired.com

    Researchers tested top image editing models on Hugging Face and found they could easily create explicit deepfakes—and 1,000 image editing prompts show how people use the software. www.wired.com/story/huggin...

    View on Bluesky →