Futurism→ original

Dario Amodei and the End of the World: Why Claude's Creator Fears His Own AI

Глава Anthropic Дарио Амодеи решил, что пришло время для серьезного разговора о конце света. Пока его модель Claude 3.5 Opus бьет рекорды, создатель предупрежда

AI-processed from Futurism; edited by Hamidun News
Dario Amodei and the End of the World: Why Claude's Creator Fears His Own AI
Source: Futurism. Collage: Hamidun News.
◐ Listen to article

Imagine you're building the fastest racing car in the world, but at every press conference you insist that it will probably crash into a wall and kill all the spectators in the stands. That's essentially how Dario Amodei, CEO of Anthropic, looks right now. The man who gave us Claude — perhaps the most humane and ethical neural network on the market — has suddenly shifted from cautious optimism to apocalyptic prophet rhetoric. His recent statement that the technology he's creating could literally tear apart human civilization makes you wonder: are we really on the brink of the end, or is this a very strange marketing strategy?

To understand the scale of the drama, we need to recall how Anthropic came about. A group of top managers and researchers left OpenAI precisely because they considered Sam Altman's approach to safety too frivolous and commercialized. They wanted to build constitutional AI that would have an internal moral compass embedded in the very architecture of the model. And now, when their models are beginning to surpass GPT-4 on many key metrics, the company's founder says humanity should wake up. This sounds not like dry analytics, but like the cry of a soul of someone who has glimpsed behind the curtains of reality and seen something frightening there.

Amodei has been talking about risks for more than a year, but the level of rhetoric has clearly increased. When the leader of one of the three most influential AI laboratories in the world discusses the destruction of the foundations of society, this is no longer the fantasies of tech geeks on forums. This is the position of someone who controls billions of dollars from Google and Amazon. In his view, the power of models grows exponentially, and we are catastrophically failing to create control mechanisms. We teach machines to think, but we still don't fully understand how exactly they do it, and we certainly don't know how to hit the brakes when the process spirals out of control.

This raises a logical question: if everything is so bad, why not just stop building these models? But in the world of big tech business, that's not how it works. If Anthropic stops, OpenAI and Google will only accelerate. This is a classic prisoner's dilemma on a planetary scale. Amodei finds himself in the role of a modern Oppenheimer, who is well aware of the destructive power of his creation, but continues working, hoping that his version of the bomb will be safe enough not to blow up the world in the process of testing.

Critics, of course, see in this an attempt at regulatory capture. If you convince governments that AI is a deadly toy, then the authorities will introduce such strict rules that new players simply won't be able to enter the market because of bureaucracy and compliance costs. It's an excellent way to cement the dominance of current giants under the guise of care for species survival. However, in Amodei's case, this theory seems too simple. His company spends more on safety research than anyone else in the industry, and his anxiety looks frighteningly genuine.

Ultimately, we're witnessing a unique historical moment when creators of technology become its fiercest critics. Amodei confronts us with a fact: we are creating a force that we don't fully understand and don't know how to manage. If the man who knows Claude from the inside is afraid of his creation, then we, ordinary users, should at least start asking the right questions to our politicians. Will we manage to wake up in time, or will this warning become just another quote in history textbooks that will be written by something other than humans?

The bottom line: The head of Anthropic confirms that the arms race in AI has entered a phase where safety is sacrificed for speed. Will the industry be able to stop at the edge without catastrophe?

ZK
Hamidun News
AI news without noise. Daily editorial selection from 400+ sources. A product by Zhemal Khamidun, Head of AI at Alpina Digital.

Want to stop reading about AI and start using it?

AI News is a curated feed of AI/tech news. Hamidun Academy teaches you to use AI systematically in your work.

What do you think?
Loading comments…