AI is overpowering efforts to catch child predators, experts warn

🌈 Abstract

The article discusses the growing problem of AI-generated sexually explicit images of children, which is overwhelming law enforcement's ability to identify and rescue real-life victims. It covers the following key points:

🙋 Q&A

[01] The Proliferation of AI-Generated CSAM

1. What are the key concerns around AI-generated child sexual abuse material (CSAM)?

• The volume of AI-generated CSAM is overwhelming law enforcement's capabilities to identify and rescue real-life victims.
• AI-generated images have become so lifelike that it is difficult to determine whether real children have been subjected to real harms for their production.
• A single AI model can generate tens of thousands of new CSAM images in a short time, flooding the dark web and mainstream internet.
• Predators are using AI to alter previously uploaded CSAM files, making it harder to detect.
• Existing laws often do not prohibit the possession of AI-generated CSAM, and the act of creating the images is not covered by existing laws.

2. How are AI-generated CSAM impacting law enforcement and child safety efforts?

• The influx of AI-generated content is draining the resources of the NCMEC CyberTipline, which acts as a clearinghouse for reports of child abuse.
• Hash matching, a crucial tool for law enforcement to identify known CSAM, is less effective against AI-generated content, as each new image has a different hash value.
• The expected surge in reports of AI-generated CSAM will further burden an already under-resourced and overwhelmed area of law enforcement.

[02] The Role of Tech Companies and Lawmakers

1. What are the concerns around tech companies' response to AI-generated CSAM?

• Only five generative AI platforms sent reports of AI-generated CSAM to the NCMEC last year, while over 70% of the reports came from social media platforms.
• Major social media companies have cut resources deployed towards scanning and reporting child exploitation by slashing jobs among their child and safety moderator teams.
• There are concerns that tech companies are not actively trying to prevent or detect the production of CSAM using their AI platforms.

2. What are the calls for action from lawmakers and child safety experts?

• Lawmakers have introduced bills to criminalize the production of AI-generated CSAM, which have been endorsed by the National Association of Attorneys General.
• Child safety experts emphasize the need for tech companies to design their AI tools safely and allocate more resources to detection and reporting of AI-generated CSAM.
• There are calls for stronger regulation and oversight to ensure tech companies take responsibility for the downstream effects of their AI platforms.