MIT Technology Review→ original

Кризис правды в эпоху LLM: почему ваш ИИ-помощник — патологический лжец

Проблема галлюцинаций ИИ перешла из разряда забавных багов в системную угрозу. Пока одни компании пытаются выжать остатки никеля из старых шахт Мичигана для «зе

AI-processed from MIT Technology Review; edited by Hamidun News
Кризис правды в эпоху LLM: почему ваш ИИ-помощник — патологический лжец
Source: MIT Technology Review. Collage: Hamidun News.
◐ Listen to article

Imagine your smartest and most well-read friend suddenly, with absolute confidence, starts telling you that the Moon is made of Swiss cheese, or that Napoleon won at Waterloo. Moreover, he does this so persuasively that you begin to doubt your own knowledge. This is precisely the situation the modern artificial intelligence industry now faces. We have encountered what experts call a "crisis of truth," and this is far more serious than mere errors in school essays.

For a long time, we viewed neural network hallucinations as a temporary growing pain. It seemed that if we just added more parameters, fed the model higher-quality texts, it would stop lying. But reality proved harsher. The very nature of large language models (LLMs) excludes the concept of "truth" in the human sense. These systems are statistical calculators that skillfully juggle tokens. They don't know what gravity or history is; they only know which words most frequently appear next to each other. As a result, we get a tool that prioritizes plausibility over truth.

This crisis is compounded by the physical constraints of our world. In the forests of Upper Michigan, the only operating nickel mine in the US is reaching its final days. Nickel is critically important for battery production and the infrastructure that powers the very data centers where neural networks live. We are literally squeezing the planet dry to maintain systems that increasingly serve us digital garbage instead of real facts. The contrast between scarce real resources and an abundance of questionable content is becoming alarming.

Why does this matter now? Because AI has ceased to be a toy in a chatbot. Google is integrating AI Overviews directly into search, OpenAI is launching SearchGPT, and corporations are entrusting neural networks with writing legal documents and medical certificates. When AI gets a cake recipe wrong—it's funny. When it hallucinates a legal precedent or a patient's diagnosis—it's a disaster. We are delegating reality-checking functions to algorithms that by definition cannot distinguish truth from fiction.

Developers are trying to fix the situation with RAG (Retrieval-Augmented Generation), forcing AI to cross-reference external sources. But there's a trap here too: the internet is rapidly filling with texts generated by other AIs. A snake-biting-its-own-tail effect emerges. Models start learning from the hallucinations of their predecessors, leading to quality degradation and ultimate erosion of the factual foundation. If before we feared fake news from human propagandists, now we fear systemic distortion of reality at the code level.

Ultimately, the crisis of truth compels us to reconsider our relationship with technology. We've grown accustomed to computers being calculators that always deliver "2+2=4." But LLMs are not calculators; they are improvisers. And until the industry finds a way to instill neural networks with a mechanism for objective verification, we'll have to return to an old-fashioned habit: not believing anything on mere word, even if that word is spoken by the most perfect algorithm in human history.

Key point: Hallucinations are not a technical error but a fundamental feature of current AI architecture. Can we trust search that generates answers based on probability rather than facts, or are we headed for a return to the age of manually checking every word?

ZK
Hamidun News
AI news without noise. Daily editorial selection from 400+ sources. A product by Zhemal Khamidun, Head of AI at Alpina Digital.

Want to stop reading about AI and start using it?

AI News is a curated feed of AI/tech news. Hamidun Academy teaches you to use AI systematically in your work.

What do you think?
Loading comments…