CNBC Daily Open: AI’s creators sound the alarm - while others keep building the infrastructure

Major AI companies are increasingly implementing safety guardrails and pausing model releases due to existential risk concerns, even as infrastructure investment continues to surge. Nvidia has launched a new safety platform to contain AI agents, while Anthropic has warned investors about potential catastrophic risks.
Why it matters
The tension between rapid AI development and the need for safety protocols is shaping the future of the tech industry and investor confidence.
Hello, this is Hui Jie writing to you from Singapore. Welcome to another edition of CNBC's Daily Open.
In the early days of the AI boom, companies were competing to see what their AI models could do. Now, they seem increasingly worried and are warning investors of what their models might be able to do. Nvidia has rolled out a software platform to prevent models from misbehaving, while OpenAI has abandoned the launch of its GPT-6.1 Astra model.
That does not mean the AI boom is slowing. Samsung is investing $1 billion in an infrastructure company backed by Nvidia and KKR. In other words, the sector is still building, just with more guardrails.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in