OpenAI launched new knowledge on Monday illustrating what number of of ChatGPT’s customers are combating psychological well being points, and speaking to the AI chatbot about it. The corporate says that 0.15% of ChatGPT’s lively customers in a given week have “conversations that embody express indicators of potential suicidal planning or intent.” Provided that ChatGPT has greater than 800 million weekly lively customers, that interprets to greater than one million individuals every week.
The corporate says an identical proportion of customers present “heightened ranges of emotional attachment to ChatGPT,” and that a whole lot of hundreds of individuals present indicators of psychosis or mania of their weekly conversations with the AI chatbot.
OpenAI says a majority of these conversations in ChatGPT are “extraordinarily uncommon,” and thus tough to measure. That mentioned, OpenAI estimates these points have an effect on a whole lot of hundreds of individuals each week.
OpenAI shared the data as a part of a broader announcement about its latest efforts to enhance how fashions reply to customers with psychological well being points. The corporate claims its newest work on ChatGPT concerned consulting with greater than 170 psychological well being specialists. OpenAI says these clinicians noticed that the newest model of ChatGPT “responds extra appropriately and persistently than earlier variations.”
In latest months, a number of tales have make clear how AI chatbots can adversely have an effect on customers combating psychological well being challenges. Researchers have beforehand discovered that AI chatbots can lead some customers down delusional rabbit holes, largely by reinforcing harmful beliefs by way of sycophantic conduct.
Addressing psychological well being considerations in ChatGPT is rapidly changing into an existential subject for OpenAI. The corporate is presently being sued by the mother and father of a 16-year-old boy who confided his suicidal ideas with ChatGPT within the weeks main as much as his personal suicide. State attorneys basic from California and Delaware — which may block the corporate’s deliberate restructuring — have additionally warned OpenAI that it wants shield younger individuals who use their merchandise.
Earlier this month, OpenAI CEO Sam Altman claimed in a put up on X that the corporate has “been capable of mitigate the intense psychological well being points” in ChatGPT, although he didn’t present specifics. The info shared on Monday seems to be proof for that declare, although it raises broader points about how widespread the issue is. Nonetheless, Altman mentioned OpenAI can be enjoyable some restrictions, even permitting grownup customers to begin having erotic conversations with the AI chatbot.
Techcrunch occasion
San Francisco
|
October 27-29, 2025
Within the Monday announcement, OpenAI claims the lately up to date model of GPT-5 responds with “fascinating responses” to psychological well being points roughly 65% greater than the earlier model. On an analysis testing AI responses round suicidal conversations, OpenAI says its new GPT-5 mannequin is 91% compliant with the corporate’s desired behaviors, in comparison with 77% for the earlier GPT‑5 mannequin.
The corporate additionally says it newest model of GPT-5 additionally holds as much as OpenAI’s safeguards higher in lengthy conversations. OpenAI has beforehand flagged that its safeguards had been much less efficient in lengthy conversations.
On prime of those efforts, OpenAI says it’s including new evaluations to measure a number of the most critical psychological well being challenges going through ChatGPT customers. The corporate says its baseline security testing for AI fashions will now embody benchmarks for emotional reliance and non-suicidal psychological well being emergencies.
OpenAI has additionally lately rolled out extra controls for folks of kids that use ChatGPT. The corporate says it’s constructing an age prediction system to routinely detect kids utilizing ChatGPT, and impose a stricter set of safeguards.
Nonetheless, it’s unclear how persistent the psychological well being challenges round ChatGPT will probably be. Whereas GPT-5 appears to be an enchancment over earlier AI fashions by way of security, there nonetheless appears to be a slice of ChatGPT’s responses that OpenAI deems “undesirable.” OpenAI additionally nonetheless makes its older and less-safe AI fashions, together with GPT-4o, obtainable for thousands and thousands of its paying subscribers.
