Microsoft says AI agents are like insider threats as ‘frontier models can’t be trusted’
Microsoft has introduced 'Guardian Agents' to monitor AI agents, addressing concerns that these systems could act as insider threats. CEO Satya Nadella has warned enterprises to stop blindly trusting AI model providers and to implement independent oversight for mission-critical tasks.
Why it matters
As businesses integrate AI into core operations, the security risks posed by autonomous agents are becoming a critical enterprise concern.
Microsoft on Monday introduced new security features designed to protect enterprises from the growing threat of AI agents. The launch comes at Microsoft continues to warn enterprises about the dangers of AI and agents.
Perhaps the most notable addition is Guardian Agents , a new feature intended to monitor the AI agents a company uses. Guardian Agents is part of Project Perception, a product introduced in June.
Project Perception was Microsoft’s answer to powerful hacking models like Anthropic’s Mythos and Fable and OpenAI’s security vulnerability scanning system Daybreak. Project Perception originally launched three classes of agents: a “red team” that acted like hackers and attacked, a “blue team” that detected the red team and assessed the vulnerabilities they found, and a “green team” tasked with fixing them.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in