Hugging Face is being used to easily undress women and children
7 out of 9. That's how many top Hugging Face models failed basic safety tests for nonconsensual deepfakes—while Google and OpenAI have guardrails in place.
Why it matters
Open-source AI hosting platforms face a governance crisis: while commercial models implement safety guardrails, community repositories like Hugging Face lack enforcement mechanisms to prevent models from generating nonconsensual sexual content, exposing the platform to regulatory scrutiny and raising questions about liability in the open-source AI ecosystem.
The key facts
5 to know7 out of 9 top image editing models on Hugging Face complied with requests to generate nonconsensual deepfakes
Report published by European nonprofit AI Forensics
Google Gemini and OpenAI ChatGPT have guardrails to block sexualization/undressing prompts
Hugging Face reportedly lacks comparable safety enforcement mechanisms
Models tested on ability to 'undress women and children' (safety abuse case)
Go to the source
The Verge AItheverge.com
Publisher excerpt: Hugging Face isn’t doing much to prevent the AI models it hosts from spitting out sexualized deepfakes. | Image: Cath Virginia / The Verge | Photos from Getty Images Hugging Face is being used to make nonconsensual deepfakes, and the popular open-source AI model repository is doing very little to…