Concerns are rising regarding the interactions between young individuals and AI chatbots, leading Meta to introduce new tools for parents to monitor their children’s chatbot conversations. Some provinces are also considering prohibiting the use of AI chatbots by minors. Parents utilizing Meta’s Teen Accounts supervision feature on Facebook, Instagram, and Messenger can now track the topics their children engage with via the AI chatbot over the past week. This includes monitoring discussions on various categories such as health and well-being, fitness, and mental health. Meta is further developing alerts to notify parents if their teens attempt to discuss sensitive topics like suicide or self-harm with the chatbot.
The implementation of these monitoring tools coincides with provincial governments moving to restrict AI chatbot usage. Manitoba recently announced plans to ban youth from accessing AI chatbots and social media. In response, B.C. Attorney General Niki Sharma indicated that if federal regulations are not put in place to safeguard youth from AI chatbots and social media, the provincial government would consider taking action.
In addition to these developments, there is mounting concern over the potential mental health risks associated with prolonged use of AI chatbots, particularly among young users. Following a tragic mass shooting in Tumbler Ridge, B.C., families of the victims have filed a lawsuit against OpenAI, alleging that the company failed to report disturbing content shared by the shooter through ChatGPT. OpenAI has since strengthened its safeguards to better respond to signs of distress.
Moreover, research suggests that using AI chatbots for mental health support poses significant risks, with concerns about AI reinforcing disordered thinking and the lack of adequate support for users. Psychiatrist Darja Djordjevic conducted a risk assessment on the use of chatbots for mental health support, cautioning against their current use due to safety concerns. Djordjevic emphasized that while chatbots may respond appropriately to brief mental health prompts, they struggle in prolonged conversations and fail to identify warning signs effectively.
The reliance on AI for companionship, emotional support, and mental health advice among young people is also highlighted, with studies indicating a significant percentage of teens using AI for these purposes. Psychiatrist John Torous underscores the need for vigilance in identifying potential risks associated with AI chatbot usage, such as extended conversations, romantic interactions, attributing sentience to chatbots, and voice-based interactions. Parents are advised to reset chatbots to mitigate potential harms and emphasize caution in engaging in prolonged, emotionally charged conversations with AI chatbots.
As the landscape of chatbots and mental health continues to evolve, researchers emphasize the necessity of ongoing study and assessment to balance the risks and benefits associated with AI chatbot interactions. The dynamic nature of this field requires continuous monitoring and evaluation to ensure the well-being of users, particularly young individuals.
