AI Is Creating An Influx Of Child Sex Abuse Images, Data Shows

🌈 Abstract

The article discusses the growing problem of artificial child sexual abuse imagery (CSAM) generated by AI image generators, as reported by the National Center for Missing and Exploited Children (NCMEC). It highlights the significant increase in CSAM reports received by NCMEC, with a notable portion attributed to generative AI models.

🙋 Q&A

[01] The mainstreaming of AI image generators and CSAM

1. What is the key issue discussed in the article?

• The article discusses the influx of artificial child sexual abuse imagery (CSAM) being generated by AI image generators, which is a growing concern according to the National Center for Missing and Exploited Children (NCMEC).

2. What data is provided about the increase in CSAM reports received by NCMEC?

• NCMEC received 36.2 million CSAM reports to its "CyberTipline" in 2023, up from over 32 million the previous year and more than double the pre-pandemic volume in 2019.
• Of the 36.2 million reports, NCMEC determined almost 5,000 to be the result of generative AI, though the actual count is likely considerably higher.

3. What are the concerns expressed about the potential growth of AI-generated CSAM?

• NCMEC's director, Fallon McNulty, expressed concern that the volume of AI-generated CSAM, though currently small, could "explode" as the technology develops and proliferates rapidly.
• She also noted that it is becoming increasingly difficult to distinguish fake AI-generated CSAM from the real thing, posing a challenge for law enforcement.

[02] Cooperation between NCMEC and AI companies

1. Which AI companies have started cooperating with NCMEC to track and flag apparent CSAM?

• OpenAI (creator of ChatGPT and DALL-E), Anthropic, and Stability AI have started engaging with NCMEC to help track and flag AI-generated CSAM.

2. What is the significance of these companies' cooperation with NCMEC?

• The cooperation is starting to provide a clearer picture of how most of the AI-generated CSAM content is being created, whether through text prompts or by using AI to manipulate photos of children or known CSAM.
• However, some smaller platforms that are often reported to NCMEC, such as apps that can "nudify" a photo, have not yet joined the effort.

[03] Challenges for law enforcement

1. What challenges does the growing problem of AI-generated CSAM pose for law enforcement?

• The scale of the issue is expected to "explode" as AI technology develops and proliferates rapidly, further inundating an already struggling law enforcement system.
• It is becoming increasingly difficult to distinguish fake AI-generated CSAM from the real thing, posing a challenge for law enforcement.