Meta has introduced new features to notify parents when their teenagers discuss suicide or self-harm with the Meta AI chatbot. The company’s chatbot across Meta platforms like Instagram, WhatsApp, and Facebook Messenger will trigger alerts for parents who have enabled supervision for their teens on Instagram. Previously, the chatbot would redirect teens expressing thoughts of self-harm to crisis help lines and advise them to contact a trusted individual. Additionally, repeated searches related to self-harm and suicide on Instagram’s regular search function would already prompt notifications to parents.
This initiative by Meta, the parent company of Instagram and Facebook, is currently active in Canada, the U.K., the U.S., and Australia. Meta had announced plans to implement this alert system in February. The company is also developing a tool to alert emergency services when conversations with the chatbot, involving both adults and teens, suggest potential self-harm.
While acknowledging the positive impact of these tools, experts emphasize the need for further enhancements. Technology analyst Carmi Levy from London, Ont., appreciates the added safety measures for teens online but cautions that the system may not always accurately identify risks. Meta plans to err on the side of caution, notifying parents even in cases of ambiguous intentions by teens.
Hanna Grover, a youth advocate at Children First Canada, highlights the potential for teenagers to circumvent these measures, such as using fake birthdates to avoid restrictions on teen accounts. Sara Austin, the CEO of Children First Canada, stresses that parental controls alone are insufficient. She advocates for stricter regulations in the tech industry to safeguard young individuals.
Regarding legislation, the Canadian federal government introduced the Safe Social Media Act in June to enforce safety requirements for AI chatbots regarding expressions of self-harm or harm to others. This bill is pending approval. Meta’s implementation of these tools coincides with increased scrutiny on AI’s role in mental health crises among youth.
OpenAI’s involvement in similar incidents, such as the Tumbler Ridge mass shooting and the suicide of Adam Raine, has led to legal actions and prompted the addition of parental controls to their chatbot. The company has also integrated parental alert systems akin to Meta’s to notify parents of concerning conversations.
In conclusion, the evolving landscape of online safety for teenagers underscores the importance of continuous improvements and regulatory measures to protect vulnerable individuals.
