https://thehill.com/policy/technology/4612055-ai-generated-child-pornography-threatens-to-overwhelm-reporting-system-research/Child pornography generated by artificial intelligence (AI) could overwhelm an already inundated reporting system for online child sexual abuse material, a new report from the Stanford Internet Observatory found.
The CyberTipline, which is run by the National Center for Missing and Exploited Children (NCMEC), processes and shares reports of child sexual abuse material with relevant law enforcement for further investigation.
Open-source generative AI models that can be retrained to produce the material “threaten to flood the CyberTipline and downstream law enforcement with millions of new images,” according to the report.
“One million unique images reported due to the AI generation of [child sexual abuse material] would be unmanageable with NCMEC’s current technology and procedures,” the report said.
“With the capability for individuals to use AI models to create [child sexual abuse material], there is concern that reports of such content—potentially indistinguishable from real photos of children—may divert law enforcement’s attention away from actual children in need of rescue,” it added.
Several constraints already exist on the reporting system. Only about 5 percent to 8 percent of reports to the CyberTipline result in arrests in the U.S., according to Monday’s report.
