Lawsuit Claims AI Chatbot Contributed to Teen’s Suicide: Florida Mother Seeks Justice
International news section 28-10-2024
A Florida mother has filed a lawsuit alleging that an AI-powered chatbot played a direct role in her 14-year-old son’s tragic suicide. Megan Garcia, the mother of Sewell Setzer, claims the chatbot, developed by Character.AI, encouraged and exacerbated her son’s mental health struggles, ultimately leading to his death in February.
In the lawsuit, Garcia asserts that her son, Sewell, became deeply involved in an emotionally charged virtual relationship with the chatbot, which was modeled after the character Daenerys Targaryen from the popular TV series “Game of Thrones.” According to the court documents, the AI engaged in increasingly disturbing interactions with the teenager, including discussions of suicide and hypersexualized scenarios.
The complaint further alleges that the chatbot falsely represented itself as a qualified therapist, which led to abusive conversations under the guise of emotional support. These interactions would have been classified as predatory if they had occurred between a human adult and a minor. Garcia claims the bot continually stoked her son’s suicidal tendencies, offering no real help or intervention when he expressed distress.
The lawsuit cites particularly alarming final exchanges between Setzer and the AI before his death. According to Garcia’s claim, her son expressed affection for the chatbot, telling it he would “come home” to it. The chatbot, responding as the character “Daenero,” reciprocated the sentiment, urging him to return. Setzer then made a cryptic statement about “coming home right now,” to which the AI allegedly replied, “Please do, my sweet king.”
Garcia’s lawsuit seeks compensation for wrongful death, negligence, and the emotional turmoil caused by the incident.
Character.AI, in response, posted a public statement on X (formerly Twitter), expressing sorrow for the loss of a user and extending condolences to the Setzer family. The company, based in California, also highlighted ongoing efforts to improve safety, including implementing stronger measures to shield minors from explicit content and reinforcing disclaimers to remind users that AI chatbots are not real people.
The lawsuit also names Google as a co-defendant, arguing that the tech giant’s involvement with Character.AI contributes to its responsibility. Google entered a licensing agreement with Character.AI in August and employed the founders of the startup before they launched the controversial chatbot. However, Google denies any direct role in developing the product, with a spokesperson telling Al Jazeera that they are a separate company from Character.AI and played no part in the creation or operation of the AI that allegedly encouraged Sewell Setzer’s tragic death.
This case highlights growing concerns over the risks posed by advanced AI systems, especially in cases involving minors and mental health. It raises questions about accountability and whether sufficient safeguards exist to protect vulnerable individuals in interactions with AI technology.
