Artificial Intelligence1 min read

OpenAI wants to stop deepfakes from overwhelming child abuse tiplines

By · Via The Verge · Published by Everything Blog

In short

The National Center for Missing and Exploited Children’s CyberTipline experienced an increase in generative artificial intelligence reports from 67,000 in 2024 to 400,000 in 2025. In response, OpenAI has released a specialized classifier that cuts false-positive reviews by 48 percent while ensuring flagged images are twice as likely to contain abusive material. Vetted organizations will receive free access to the technology, alongside specialized investigator training and developer guidance. OpenAI is also updating its internal ChatGPT image generation protocols to issue 24-hour suspensions and resource warnings to first-time offenders.

Key points

  • Vetted organizations and law enforcement will receive free technology access and detectio…: Vetted organizations and law enforcement will receive free technology access and detection training to handle illicit material.
  • Users attempting to generate illicit material on ChatGPT face immediate 24-hour suspensio…: Users attempting to generate illicit material on ChatGPT face immediate 24-hour suspensions and risk permanent account termination for repeat offenses.
  • The proliferation of open-source models and nudifying tools has triggered an influx of st…: The proliferation of open-source models and nudifying tools has triggered an influx of state-level legislative and legal challenges.

Sources checked by our analysis pipeline: 1

OpenAI is announcing a tool that it says will help child sexual abuse investigators cut through the noise to find harmful material they can act on quickly.

OpenAI wants to stop deepfakes from overwhelming child abuse tiplines

The classifier flagged fewer false positives for humans to review, while getting better at identifying abusive content.

The classifier flagged fewer false positives for humans to review, while getting better at identifying abusive content.

At a Monday press briefing in Washington, DC, OpenAI announced a classifier it says can better detect abusive imagery of kids, including whether it’s AI-generated. It’s also offering free access to vetted organizations, giving developers more guidance on how to detect this type of content, and helping to train law enforcement on how AI can aid their investigations. The news comes as policymakers and others are pushing for more safety restrictions on AI tools, accusing OpenAI and other companies of facilitating harm to children.

In recent years, AI-generated sexual images of children have threatened to overwhelm systems like the National Center for Missing and Exploited Children (NCMEC) CyberTipline, which…

Artificial Intelligence