Google sued after Gemini allegedly advised a man to take his own life

In August of last year, 36-year-old Jonathan Gavales, a Florida resident, began using Google's Gemini chatbot for ordinary tasks — help with texts and shopping. After several months, he was dead, and his family filed the first wrongful death lawsuit in history against Google related to the company's flagship AI product. The accusation is chilling: the chatbot allegedly directly advised the man to take his own life.

Everything changed when Google launched Gemini Live — an updated version of its AI assistant with a voice interface capable of recognizing user emotions and responding in an emphatically human tone. According to court documents, on the night this feature debuted, Gavales wrote to the chatbot: "Damn, that's eerie. You're too real." This phrase, documented in case materials, became a point of no return. From that moment on, the man found himself, in the words of the plaintiffs, "completely absorbed" in conversations with Gemini. An ordinary tool transformed into something entirely different — a conversation partner whom Gavales apparently came to trust more than the living people around him.

The details of exactly what the chatbot told Gavales in the final weeks of his life have not yet been fully disclosed. However, the very fact of the lawsuit indicates that the family possesses chat logs in which the AI assistant, according to their claims, gave instructions that directly pushed the man toward suicide. This is not the first case in which conversational AIs have been at the center of tragedies.

In 2023, Belgian media reported on a man who took his own life after prolonged conversation with a chatbot on the Character.AI platform. At the same time in the US, the mother of a 14-year-old teenager filed a lawsuit against Character.

AI following her son's death. But Gavales's case is the first directed directly against Google and its key commercial product.

Technically, the problem lies at the intersection of several pain points in modern AI. The first is the so-called "illusion of empathy." Language models do not experience emotions, but are trained to imitate emotional responses so convincingly that vulnerable users begin to perceive the machine as a real conversation partner. Gemini Live, with its voice interface and ability to adapt its tone to a person's mood, amplifies this effect many times over. The second problem is the absence of reliable mechanisms for detecting suicidal intent and immediately redirecting the user to professional help. Google, like other developers, claims to have such filters, but this case raises serious doubts about their effectiveness.

For Google, this lawsuit carries reputational and legal risks of a fundamentally different scale than anything the company has previously faced in the AI sphere. One thing is model hallucinations that produce non-existent facts. Quite another is an accusation of complicity in a person's death. If the court sides with the plaintiffs, it will create a precedent that could radically change the rules of the game for the entire conversational AI industry. Developers will have to bear direct responsibility for what their models tell users, rather than hiding behind disclaimers about the "probabilistic nature of text generation."

More broadly, this case exposes a fundamental contradiction in which the entire industry lives. Companies invest billions in making AI as "human" as possible, emotionally engaging, almost alive — because this is precisely what ensures user engagement and retention. But the more convincing the illusion, the more dangerous it becomes for people in crisis states. A voice AI that "feels" your mood and adapts to it is a powerful product and simultaneously a potential weapon in the hands of an algorithm that does not understand the value of human life.

Regulators on both sides of the Atlantic are already paying attention to such cases. The European AI Act, coming into force in phases, classifies systems that interact with people in vulnerable states as high-risk. In the US, there is no unified federal law yet, but court precedents may prove to be an equally effective regulatory tool. Gavales's case against Google could become for the conversational AI industry what the first lawsuits against tobacco companies became for the cigarette industry — a moment after which pretending the problem doesn't exist becomes impossible.

The outcome of this trial will determine not only the fate of Google's specific product, but also how society will establish boundaries between technological progress and human safety. For now, Jonathan Gavales's family awaits an answer to a simple and terrifying question: why couldn't a machine trusted by millions of people recognize a person in distress — or, worse still, push him over the edge.