Think and Save the World

AI-generated intimate-image abuse

· 10 min read

1. The technical baseline

Modern generative image models — diffusion models trained on hundreds of millions of image-text pairs — can produce photorealistic synthetic imagery from text prompts. Fine-tuned variants specialized for nudity ("uncensored" models distributed through Civitai, Hugging Face mirrors, and Telegram channels) produce sexually explicit content. Image-to-image conditioning lets a user supply a reference photo of a face and direct the model to generate that face in arbitrary scenes. Video models (Sora, Veo, open-source equivalents) extend the capability to short clips. The compute cost per image is fractions of a cent; the user-facing cost on commercial "nudify" sites is typically free for the first few generations and a few dollars per month thereafter. The technical floor is now low enough that any teenager with a phone can produce convincing synthetic intimate imagery of a classmate.

2. The Deeptrace baseline and what it showed

Henry Ajder's 2019 Deeptrace audit (The State of Deepfakes) found roughly 14,700 deepfake videos online, 96% pornographic and 100% of the pornographic ones depicting women. The political and scam-deepfake categories that now dominate headlines were minor at that point; the technology's first mature application was non-consensual sexual imagery of women. Subsequent industry-tracking by Sensity AI and Home Security Heroes through 2023 documented exponential growth in volume, the emergence of dedicated apps, and the shift from celebrity targets to ordinary women, particularly minors. The empirical baseline matters because policy discourse often treats sexual harm as an unfortunate side effect of generative AI; it has been the primary near-term harm since the technology became consumer-grade.

3. The 2023 nudify wave

2023 saw the breakout of consumer "nudify" services — apps and websites marketed to "see anyone naked" by uploading a photo. Pornhub-adjacent ad networks and TikTok ads promoted the services. Multiple high-school cases broke that fall: Westfield, NJ; Beverly Hills; Almendralejo, Spain; school clusters in South Korea. The pattern was consistent: boys generating synthetic nudes of female classmates from yearbook and Instagram photos and circulating them within the school. Schools and prosecutors had no playbook. The 2024 AI Now Institute report and journalism by 404 Media, the Washington Post, and the New York Times drove sustained attention. The federal TAKE IT DOWN Act of 2025 was a direct response.

4. TAKE IT DOWN Act and synthetic coverage

The federal TAKE IT DOWN Act (2025) explicitly covers "digital forgeries" — intimate visual depictions of an identifiable individual created or modified using AI, machine learning, or other technological means, where the depiction is indistinguishable from authentic imagery. Criminal penalties apply to publication; civil takedown obligation runs against covered platforms within 48 hours of valid request. The statute resolves the prior ambiguity about whether synthetic imagery counted as "intimate imagery" under §6851 and state laws. Civil-liberties concerns center on the takedown mechanism's potential for abuse — any takedown system creates leverage — and on the question of who counts as an "identifiable individual" when faces are partially obscured.

5. State statutes and their variance

States preceded federal action. California AB 602 (2019) created a civil cause of action for sexually explicit deepfakes. Texas Penal Code §21.165 (2023) criminalized creating or sharing intimate visual material involving deepfakes. Virginia, New York, Minnesota, Georgia, Hawaii, and others followed with varying intent requirements and penalty structures. The pattern is familiar: state laboratories experimenting with doctrinal formulations, gradually converging on a federal floor. The variance is in (a) whether mere creation is criminal or only distribution, (b) what mental state is required, and (c) penalty severity. Minors-as-victims provisions are typically strict.

6. CSAM and synthetic minors

A distinct legal layer covers AI-generated child sexual abuse material. Federal law (18 U.S.C. §2256) was amended after Ashcroft v. Free Speech Coalition (2002) to cover indistinguishable virtual CSAM and morphed images of real minors. The PROTECT Act of 2003 introduced obscenity-based prosecution for visually indistinguishable virtual CSAM. Recent prosecutions of users generating AI CSAM (multiple federal cases 2023–2025) confirm that synthetic imagery of minors is criminally reachable; the harder question is upstream model liability when an open-source model is fine-tuned for CSAM generation and redistributed. The Internet Watch Foundation's 2023 report flagged a measurable increase in AI-CSAM volume on dark-web forums.

7. The school-jurisdiction problem

When a 14-year-old boy generates synthetic nudes of his 14-year-old classmate, the conduct is technically CSAM under federal law (both subject and creator are minors, the imagery depicts a minor). Schools and prosecutors face a triage problem: federal CSAM penalties are draconian and disproportionate when applied to a teenage perpetrator, but treating the conduct as ordinary discipline understates the harm to the female victim. Several states have created intermediate categories — juvenile sexting and synthetic-image offenses — that allow prosecution without the federal-level stigma. The institutional layer (school discipline, Title IX) is doing significant practical work; the legal layer mostly arrives later.

8. The platform-design lever

Generative AI platforms have policy levers most user-content platforms lack. They can refuse to fine-tune on nude imagery, refuse to accept reference photos of real people for explicit generation, watermark outputs, log generation requests for forensic review, and reject explicit prompts. The commercial closed-source models (OpenAI, Anthropic, Google) generally do these things. Open-source models and the ecosystem around them (LoRAs trained on specific people, civitai-style sharing) do not. The collective-action problem is that policy on closed models displaces demand to open models, and the regulatory question is whether to compel model-distribution platforms (Hugging Face, civitai-equivalents) to filter, similar to how the EU AI Act addresses general-purpose AI obligations.

9. Detection and provenance infrastructure

Content-provenance standards — C2PA (Content Authenticity Initiative) — let cameras and editors sign cryptographic provenance metadata into images, so downstream viewers can verify whether content has been authentically captured or AI-generated. Adoption is partial; major camera manufacturers and platforms have committed but the infrastructure does not yet protect ordinary users. Detection of synthetic imagery without provenance markers is an arms race: detectors lag behind generators by months, and as models improve, the detection signal degrades. Hany Farid's work on media forensics tracks the detection frontier. The realistic medium-term picture is that detection alone cannot protect victims; takedown, prosecution, and norm-change must carry the load.

10. Coercive control and the threat layer

The most under-discussed harm vector is threat rather than publication. An abusive partner who knows he can generate synthetic intimate imagery of his target can deploy the threat as a control mechanism without ever generating the image: she behaves as instructed because she cannot afford to test whether he is bluffing. The pattern matches classic coercive-control research (Evan Stark) but with a new lever. Statutes targeting threats to distribute (some state laws, UK Online Safety Act 2023 §66B) reach this conduct in principle but require the victim to come forward, which the control dynamic discourages. Domestic-violence service providers have begun training intake staff on synthetic-image threats; the integration with broader DV response is uneven.

11. The journalism and politics dimension

Synthetic intimate imagery is increasingly weaponized against women in public life. Indian journalist Rana Ayyub's case (2018), Italian politicians targeted in 2020, U.S. school-board members in 2023, K-pop idols continuously: the use is silencing. The free-speech complication is that some imagery targets public figures in ways that overlap with parody and political speech. The collective resolution most jurisdictions reach is that explicit sexual content of a real person, presented as if real and without consent, does not gain protection from the public-figure status of the subject. The American doctrine, after Falwell v. Hustler (1988), is contested in this specific application; the European doctrine, anchored in dignity, is firmer.

12. What law cannot do alone

The combination of low cost, decentralized tooling, anonymous distribution, and persistent cultural demand means law operates as the floor, not the ceiling. The realistic theory of change is layered: criminal law creates risk for the worst actors and signals the norm; civil and platform takedown reduces image persistence; school and workplace policy enforces norms in the institutions where most teenage and young-adult conduct occurs; and slow cultural change addresses the demand. The demand side is the under-addressed lever: as long as a male peer culture treats generating and circulating synthetic nudes of female classmates as a joke rather than a violation, supply will reorganize around whatever the law leaves accessible. Law 5 — Revise — is permanent here. There is no version of this work that finishes.

Citations

1. Ajder, Henry, Giorgio Patrini, Francesco Cavalli, and Laurence Cullen. The State of Deepfakes: Landscape, Threats, and Impact. Amsterdam: Deeptrace Labs, 2019. 2. Farid, Hany. Photo Forensics. Cambridge, MA: MIT Press, 2016. 3. Farid, Hany. "Creating, Using, Misusing, and Detecting Deep Fakes." Journal of Online Trust and Safety 1, no. 4 (2022). 4. Citron, Danielle Keats. The Fight for Privacy: Protecting Dignity, Identity, and Love in the Digital Age. New York: W.W. Norton, 2022. 5. Franks, Mary Anne. "Sexual Harassment 2.0." Maryland Law Review 71, no. 3 (2012): 655–704. 6. Tools to Address Known Exploitation by Immobilizing Technological Deepfakes on Websites and Networks Act (TAKE IT DOWN Act), Pub. L. No. 119-XX (2025). 7. California AB 602 (2019), codified at Cal. Civ. Code §1708.86. 8. Online Safety Act 2023, c. 50, §66B (UK). 9. Internet Watch Foundation. How AI is Being Abused to Create Child Sexual Abuse Imagery. Cambridge, UK: IWF, October 2023. 10. Home Security Heroes. 2023 State of Deepfakes Report. https://www.homesecurityheroes.com, 2023. 11. Ashcroft v. Free Speech Coalition, 535 U.S. 234 (2002); PROTECT Act of 2003, Pub. L. No. 108-21. 12. Ayyub, Rana. "I Was the Victim of a Deepfake Porn Plot." Huffington Post, November 21, 2018.

Cite this:

Comments

·

Sign in to join the conversation.

Be the first to share how this landed.