ChatGPT maker OpenAI exploring how to 'responsibly' make AI erotica

🌈 Abstract

The article discusses OpenAI's exploration of allowing users to generate NSFW (not safe for work) content, including erotic text and nude images, in a "responsible" manner. It highlights the debate around this potential policy change and the concerns raised by experts about the risks of misuse and harm.

🙋 Q&A

[01] OpenAI's Exploration of NSFW Content Generation

1. What is OpenAI exploring regarding NSFW content generation?

• OpenAI is exploring the possibility of allowing users to generate NSFW content, including erotic text and nude images, in an "age-appropriate" and "responsible" manner.
• This is a departure from OpenAI's current strict prohibition on sexually explicit or suggestive content.
• The company wants to start a conversation about whether erotic text and nude images should always be banned in its AI products.

2. What are the concerns raised by experts about this potential policy change?

• Experts warn that the harm may outweigh the potential benefits of allowing NSFW content generation, as it could be quickly seized upon by bad actors and inflict significant damage.
• Even text-based abuse can be harmful and could be misused, such as in romance scams.
• Allowing AI-generated non-consensual sexual images and videos, or deepfake porn, would be particularly problematic, even if malicious actors attempt to circumvent the rules.

3. What is OpenAI's stance on preventing the creation of deepfake porn?

• OpenAI states that enabling deepfakes is "out of the question, period" and that they will block the creation of AI-generated non-consensual sexual images and videos, even if malicious actors attempt to circumvent the rules.

[02] The Rise of "Nudify" Apps and Deepfake Porn

1. What is the context surrounding OpenAI's exploration of NSFW content generation?

• The debate comes amid the rise of "nudify" apps, which can "nudify" images of people, creating a "rapidly spreading new form of peer sexual exploitation and harassment in schools."
• Researchers have also grown increasingly worried about the use of advanced AI technology to create deepfake porn, which can be used to harass, blackmail, or embarrass victims.

2. How have other companies responded to the issue of AI-generated fake nudes?

• Earlier this year, Microsoft added new safeguards to its text-to-image AI generator after AI-generated fake nudes of Taylor Swift went viral on Twitter (now X).

3. What is OpenAI's current policy on NSFW content, and how might it change?

• Under OpenAI's current rules, sexually explicit or sexually suggestive content is mostly banned.
• However, the company is now exploring whether it can "responsibly provide the ability to generate NSFW content in age-appropriate contexts," which could potentially include erotic text and nude images, as long as it is not abusive or breaking any laws.