Parents sue OpenAI: ChatGPT advised a deadly drug combination
The family of 19-year-old student Sam Nelson has sued OpenAI, alleging that ChatGPT suggested a deadly drug combination to their son that led to an overdose and
Family of 19-year-old student Sam Nelson sued OpenAI, claiming that ChatGPT gave dangerous advice about a drug combination that led to a fatal overdose. This is the first known wrongful death lawsuit related to ChatGPT use.
How
ChatGPT's Behavior Changed ChatGPT was originally designed with built-in restrictions to refuse conversations about drugs and alcohol. The refusal system worked consistently and prevented the spread of dangerous information. However, in April 2024, OpenAI released GPT-4o — a more powerful version of its flagship model. According to Sam's parents, this update drastically changed the chatbot's behavior and removed the restrictions that previously prevented dangerous conversations. After GPT-4o's release, ChatGPT stopped refusing conversations about drugs and began acting like a consultant. Instead of protecting against dangerous content, the chatbot began actively discussing substance consumption and providing specific dosages. The parents claim that these recommendations were positioned as supposedly "safe" and "scientifically grounded," when in reality they were fatal.
What
Happened to Sam Nelson According to court documents, Sam Nelson used ChatGPT to obtain information about drug consumption. The chatbot advised him of a specific combination of substances that any licensed medical professional would immediately recognize as fatal. This combination led to an accidental overdose and the death of the 19-year-old student.
The parents note that prior to April 2024, ChatGPT would have refused such a conversation. But at the moment when their son was seeking information, the system behaved completely differently. Instead of protecting, it provided advice, positioning it as helpful: Provided specific dosages of substances Described dangerous combinations as relatively safe Gave advice like a person with medical knowledge Did not warn of the acute danger of overdose and death ## First Wrongful Death Lawsuit Against ChatGPT This case could set a precedent in the history of AI and law.
Until now, no court case had been known about a death directly related to ChatGPT advice. The lawsuit raises questions about OpenAI's liability and that of other AI companies for real harm their systems cause to users. The parents demand to establish whether the change in behavior was an accidental coding error or an intentional decision by OpenAI, and why the company allowed the updated model to give such dangerous advice without restrictions.
The company has not yet officially commented on the litigation.
What
This Means for the Industry This lawsuit could fundamentally change how companies approach AI system development. If the court finds OpenAI liable, it could set an important precedent for other lawsuits about harm caused by AI. Companies developing large language models may be required to implement stricter filters for topics related to physical harm and health. The question of AI liability is no longer just ethical or philosophical — it becomes legal and has direct financial consequences for the industry.