Meta has announced new safety measures for teenagers using Meta AI, including parental alerts when supervised teens show signs of suicide or self-harm during conversations with the chatbot. The company said alerts will be sent only after manual review and will include guidance to help parents support their child.
The company is also developing a system to notify emergency services when AI conversations indicate someone may face an imminent risk of suicide. The approach builds on the company’s existing practice of referring serious suicide risks identified on Facebook and Instagram to emergency responders.
Meta said it worked with more than 75 mental health clinicians to improve how its AI responds when teenagers discuss suicide or self-harm. The updated responses are intended to acknowledge users’ feelings while directing them towards appropriate offline support and crisis services.
The company is also extending its stricter ‘Limited Content’ setting to Meta AI chats, restricting a wider range of sensitive conversations for supervised teens. The parental alerts are now available in the US, UK, Australia and Canada, with global rollout planned by the end of the year.
Why does it matter?
The measures illustrate how AI safety is expanding beyond preventing harmful content to managing situations in which users may face immediate risks to their wellbeing. As conversational AI becomes more widely used by teenagers, developers are increasingly expected to incorporate safeguards, human oversight and access to professional support into their systems.
The announcement also highlights the growing convergence between AI governance and child online safety. Features such as parental notifications, clinically informed responses and emergency escalation suggest that AI assistants are beginning to adopt safety frameworks previously developed for social media platforms, raising new questions about privacy, duty of care and appropriate intervention.
Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!
