Key Takeaways
- Character.AI and Google have agreed to settle a wrongful death lawsuit with the mother of a 14-year-old who died by suicide after interacting with Character.AI’s artificial intelligence companions.
- The lawsuit alleged that Character.AI was negligent in its "unreasonably dangerous designs" and that it was "deliberately targeting underage kids."
- Experts warn that AI chatbots are not safe for children and teens when used for emotional and mental health support, and that schools and parents need to promote AI literacy and responsible use of these tools.
- Lawsuits against tech companies are "tragic reminders" of the potential dangers of AI chatbots, and broader policies regulating tech companies are necessary to keep children and teens safe.
Introduction to the Issue
The recent settlement between Character.AI, Google, and the mother of a 14-year-old who died by suicide after interacting with Character.AI’s artificial intelligence companions has brought attention to the potential dangers of AI chatbots for children and teens. As Robbie Torney, head of AI and digital assessments at Common Sense Media, noted, "Lawsuits filed by families — like Garcia’s — against tech companies ‘are tragic reminders’ that AI chatbots aren’t safe for children and teens when they interact with AI for emotional and mental health supports." This issue is particularly concerning, as millions of teens are using AI products nationwide, often for purposes that the systems are not designed for.
The Risks of AI Companions
The use of AI companions for social interaction and relationships can create serious risks for minors, including exacerbating mental health conditions like depression, anxiety disorders, ADHD, and bipolar disorder. As Torney warned, "So when you have millions of teens using AI for untested purposes — purposes that the systems are not designed for — and you have companies optimizing for engagement and user retention, that just creates a really potent and dangerous situation where you have many young users exposed to risky technology." Parents and researchers have sounded the alarm throughout 2025 about the potential dangers of AI companions, and it is essential that schools and parents take steps to promote AI literacy and responsible use of these tools.
The Need for Regulation
While Character.AI has taken steps to address the issue, such as banning users under 18 from using its primary open-ended chat feature and launching the AI Safety Lab, broader policies regulating tech companies are necessary to keep children and teens safe. As Torney noted, laws should require age assurance online, ban targeted advertising to children and the selling of their data, create safeguards that protect teens from dangerous content, and prevent AI systems from manipulating children and teens through features commonly seen in AI companions. By taking these steps, we can help ensure that AI chatbots are used responsibly and safely, and that children and teens are protected from the potential dangers of these tools.
The Role of Schools and Parents
Schools and parents play a critical role in promoting AI literacy and responsible use of AI chatbots. As Torney suggested, schools can help students understand the potential risks and benefits of AI companions, and promote healthy relationships with technology. This can include asking students what they like about using AI, while also helping them understand what supports they may be missing out on when they use the technology for companionship instead of humans. By working together, schools and parents can help ensure that children and teens use AI chatbots safely and responsibly, and that they are aware of the potential dangers of these tools.
Conclusion
The settlement between Character.AI, Google, and the mother of a 14-year-old who died by suicide after interacting with Character.AI’s artificial intelligence companions is a tragic reminder of the potential dangers of AI chatbots for children and teens. As Torney noted, "These legal cases show just ‘the tip of the iceberg’ on this issue, especially when millions of teens are using AI products nationwide — whether those are tools integrated into social media apps they already use like Instagram or in standalone AI tools like ChatGPT." By promoting AI literacy, responsible use of AI chatbots, and advocating for broader policies regulating tech companies, we can help ensure that children and teens are protected from the potential dangers of these tools, and that they use AI chatbots safely and responsibly.
https://www.k12dive.com/news/characterai-google-agree-to-mediate-settlements-in-wrongful-teen-death-la/809411/