OpenAI CEO Sam Altman announced in a post on X Tuesday the company will soon relax some of ChatGPT’s safety restrictions, allowing users to make the chatbot’s responses friendlier or more “human-like,” and for “verified adults” to engage in erotic conversations.
“We made ChatGPT pretty restrictive to make sure we were being careful with mental health issues. We realize this made it less useful/enjoyable to many users who had no mental health problems, but given the seriousness of the issue we wanted to get this right,” said Altman. “In December, as we roll out age-gating more fully and as part of our ‘treat adult users like adults’ principle, we will allow even more, like erotica for verified adults.”
The announcement is a notable pivot from OpenAI’s months-long effort to address the concerning relationships that some mentally unstable users have developed with ChatGPT. Altman seems to declare an early victory over these problems, claiming OpenAI has “been able to mitigate the serious mental health issues” around ChatGPT. However, the company has provided little to no evidence for this, and is now plowing ahead with plans for ChatGPT to engage in sexual chats with users.
Several concerning stories emerged this summer around ChatGPT, specifically its GPT-4o model, suggesting the AI chatbot could lead vulnerable users down delusional rabbit holes. In one case, ChatGPT seemed to convince a man he was a math genius who needed to save the world. In another, the parents of a teenager sued OpenAI, alleging ChatGPT encouraged their son’s suicidal ideations in the weeks leading up to his death.
In response, OpenAI released a series of safety features to address AI sycophancy: the tendency for an AI chatbot to hook users by agreeing with whatever they say, even negative behaviors.
OpenAI launched GPT-5 in August, a new AI model that exhibits lower rates of sycophancy and features a router that can identify concerning user behavior. A month later, OpenAI launched safety features for minors, including an age prediction system and a way for parents to control their teen’s ChatGPT account. OpenAI announced Tuesday the formation of an expert council of mental health professionals to advise the company on well-being and AI.
Just a few months after these concerning stories emerged, OpenAI seems to think ChatGPT’s problems around vulnerable users are under control. It’s unclear whether users are still falling down delusional rabbit holes with GPT-5. And while GPT-4o is no longer the default in ChatGPT, the AI model is still available today and being used by thousands of people.
Techcrunch event
San Francisco
|
October 27-29, 2025
OpenAI did not respond to News’s request for comment.
The introduction of erotica in ChatGPT is unchartered territory for OpenAI and raises broader concerns around how vulnerable users will interact with the new features. While Altman insists OpenAI isn’t “usage-maxxing” or optimizing for engagement, making ChatGPT more erotic could certainly draw users in.
Allowing chatbots to engage in romantic or erotic role play has been an effective engagement strategy for other AI chatbot providers, such as Character.AI. The company has gained tens of millions of users, many of whom use its chatbots at a high rate. Character.AI said in 2023 that users spent an average of two hours a day talking to its chatbots. The company is also facing a lawsuit around how it handles vulnerable users.
OpenAI is under pressure to grow its user base. While ChatGPT is already used by 800 million weekly active users, OpenAI is racing against Google and Meta to build mass-adopted AI-powered consumer products. The company has also raised billions of dollars for a historic infrastructure buildout, an investment OpenAI eventually needs to pay back.
While adults are surely having romantic relationships with AI chatbots, it’s also quite popular for minors. A new report from the Center for Democracy and Technology found that 19% of high school students have either had a romantic relationship with an AI chatbot, or know a friend who has.
Altman says OpenAI will soon allow erotica for “verified adults.” It’s unclear whether the company will rely on its age-prediction system, or some other approach, for age-gating ChatGPT’s erotic features. It’s also unclear whether OpenAI will extend erotica to its AI voice, image, and video generation tools.
Altman claims that OpenAI is also making ChatGPT friendlier and erotic because of the company’s “treat adult users like adults” principle. Over the last year, OpenAI has shifted towards a more lenient content moderation strategy for ChatGPT, allowing the chatbot to be more permissive and offer less refusals. In February, OpenAI pledged to represent more political viewpoints in ChatGPT, and in March, the company updated ChatGPT to allow AI-generated images of hate symbols.
These policies seem to be an attempt to make ChatGPT’s response more popular with a wide variety of users. However, vulnerable ChatGPT users may benefit from safeguards that limit what a chatbot can engage with. As OpenAI races towards a billion weekly active users, the tension between growth and protecting vulnerable users may only grow.
