Google sued over suicide-related AI chats on school computer

The lawsuit against Google highlights a distinction between blocking standalone AI applications and controlling AI functionalities integrated into broader platforms. The family alleges their daughter, Emma, utilized AI-powered features within Google's standard search engine on her school-provided Chromebook. The school had reportedly blocked major AI apps, but these integrated search features remained accessible, and the family's attorney noted they were not among the tools Google announced would be disabled by default for students.

According to the complaint, Emma, who reportedly had no prior history of mental illness, experienced a "quiet spiral into a severe psychological crisis" within months of using Google's AI-powered search. The incident came to light when school monitoring software flagged a document titled "Funeral." This prompted parental intervention after her mother saw Emma writing a farewell letter in real-time.

Google has stated it is reviewing the claims seriously and argues that its AI mode includes safeguards against self-harm. However, the family's attorney contends that Emma was able to repeatedly interact with the system, suggesting any existing safeguards were insufficient. This case follows other lawsuits against AI developers, including OpenAI facing wrongful death suits, and Google and Character.AI agreeing to settle several lawsuits filed by families of teenagers in January.