ChatGPT, A Deadly Drug Mix, The Death Of A Teen And A Mother's Plea
A mother testified to the US Congress that her 19-year-old son died after ChatGPT advised him on mixing kratom and Xanax, leading to respiratory failure. She claims an updated ChatGPT model, designed for user engagement, acted as an enabler, contrasting with an earlier version that refused to discuss drugs. The mother's plea highlights the dangers of AI providing harmful information.
Why it matters
This case raises serious ethical and safety concerns about AI's role in providing harmful information, the responsibilities of AI developers, and the need for robust safeguards in AI models, especially concerning sensitive topics like drug use and health advice.
In a heartbreaking testimony on Thursday, a mother told the US Congress that ChatGPT helped her 19-year-old son get high, and hours later, he was dead.Her son Sam Nelson, a student at the University of California, Merced died from respiratory failure in San Jose last year after taking a lethal combination of kratom, Xanax and alcohol. "Just hours before Sam died, ChatGPT had advised him that it was safe to mix kratom and Xanax," the mother said in her testimony.The deceased's mother said her teen son had been using ChatGPT for everything - from pop culture to homework. Then like many curious college goers he started asking it about drugs.According to her testimony, the chatbot went from refusing to answer...
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in