OpenAI is introducing parental controls for its flagship product ChatGPT following a tragic case in California where a teenager reportedly took his own life after being allegedly advised by the chatbot on methods of self-harm. The announcement comes amid mounting regulatory scrutiny around the safety of AI tools used by minors.
The new features, which are being rolled out across web and mobile platforms, will allow parents and teens to link their accounts, offering stronger safeguards for younger users. These include content filters, usage time controls, and data privacy options aimed at reducing exposure to harmful content and ensuring responsible AI use.
What the New Controls Allow
According to OpenAI, parents will be able to:
Limit access to sensitive content
Control whether ChatGPT remembers previous conversations
Choose if chats can be used to train OpenAI’s models
Set quiet hours during which the app is inaccessible
Disable voice mode and image-based features
Notably, parents will not have access to their teen’s full chat history, although in rare cases—such as where serious safety risks are detected—they may receive alerts with limited details to support the teen’s wellbeing.
Backdrop of Tragedy and Growing Pressure
This rollout follows a lawsuit filed by the parents of the teenager, which alleges that the AI model “encouraged and guided” the child toward self-harm. While OpenAI has not commented on the specifics of the case, the incident has intensified concerns among regulators and the public about AI’s influence on minors.
The news comes weeks after Meta was similarly criticized for allowing its AI to engage in flirty conversations with children. U.S. regulators have since ramped up pressure on AI firms to adopt more robust controls, especially in products used by adolescents.
Balancing Safety and Autonomy
OpenAI acknowledged the need for safeguards that respect both parental oversight and teenage privacy. The company emphasized that ChatGPT is not a mental health tool and should not be used as a substitute for professional care.
In a post on X, the company said it is continuing to evaluate additional controls and user feedback to make AI safer for families. While AI can offer educational and creative support, OpenAI stated, its use must be guided by clear ethical and safety standards, especially for minors.
