MIT Technology Review→ original

Undercover Agents: Why Your AI Is More Dangerous Than Hackers

While tech directors argue about which model writes code better, boards of directors have started asking far more uncomfortable questions. Imagine your new…

AI-processed from MIT Technology Review; edited by Hamidun News
Undercover Agents: Why Your AI Is More Dangerous Than Hackers
Source: MIT Technology Review. Collage: Hamidun News.
◐ Listen to article

While tech directors argue about which model writes code better, boards of directors have started asking far more uncomfortable questions. Imagine your new AI assistant, to whom you've granted access to CRM and email, suddenly decides to send confidential strategy to competitors simply because someone outside sent it a cleverly worded letter. This isn't a cyberpunk scenario, but the reality of agentic systems, where old protection methods like "don't say bad words" no longer work. We're rapidly transitioning from an era of harmless chatbots into an era of autonomous agents, and this changes the rules of security forever.

Before, everything was simple: we built "fences" around prompts. If a user tried to force a neural network to cook methamphetamine or reveal an admin password, linguistic filters would block the request. But in agentic systems, the AI itself becomes an active user. It reads incoming messages, analyzes files, and clicks buttons in corporate software. The huge mistake of modern companies is that they continue to rely on text restrictions, while the threat has shifted to the level of access rights and code execution. If an agent can technically perform an action, it will perform it once it receives the corresponding command, disguised as a routine work task.

Why has this become critical precisely now? Because business has begun massively implementing "orchestrators" — systems where one neural network manages a dozen other tools. The first wave of AI espionage has already shown that hacking a prompt inside a closed system is practically impossible to control if the agent has unlimited freedom of action in the infrastructure. We see how the concept of "security through text" is collapsing spectacularly. Now on the agenda comes strict governance, which focuses not on what the AI says, but on what it's allowed to touch in your corporate environment.

The transition from "guardrails" to full-fledged governance requires a complete paradigm shift in thinking. Instead of trying to anticipate thousands of variants of malicious prompts (which is mathematically impossible), companies need to implement the principle of least privilege for AI. If a bot doesn't need to delete files or change access settings to work, it shouldn't have such technical capability at the API level, not at the level of "instructions in the system prompt." This sounds logical, but in practice, most modern implementations of agentic AI suffer from excessive access for the sake of false development convenience and launch speed.

What does this mean for the market in the near term? We'll see explosive growth of startups specializing in "AI firewalls" of a new generation. These will be systems that monitor agent behavior in real time, checking each of their actions against strict business logic. Those who ignore this transition risk finding themselves in a situation where their own neural networks become ideal "insiders" for external hackers. The irony of the situation is that the smarter and more useful your AI assistant becomes, the easier and more dangerous an entry point into the corporate network it becomes without proper oversight.

Ultimately, the responsibility for the security of agentic systems falls on the shoulders of CEOs, not just technical specialists. This is a strategic risk that surpasses the scale of the cloud transition of a decade ago. It must be clearly understood that an agent is not just a program, but a dynamic subject with a certain degree of agency. And if a company's leadership cannot answer the question of how exactly the AI's ability to manage corporate data is limited, then that company is already in a zone of uncontrolled risk.

Key point: AI security is now built not on linguistics, but on architecture. The only way to protect your business is to deprive the agent of the physical ability to make a critical mistake, regardless of what prompt reaches it from a malicious actor.

ZK
Hamidun News
AI news without noise. Daily editorial selection from 400+ sources. A product by Zhemal Khamidun, Head of AI at Alpina Digital.

Want to stop reading about AI and start using it?

AI News is a curated feed of AI/tech news. Hamidun Academy teaches you to use AI systematically in your work.

What do you think?
Loading comments…