Nvidia, Microsoft launch open AI security alliance – without OpenAI, Google, or Anthropic

Nvidia has partnered with Microsoft, IBM, and other tech firms to launch the Open Secure AI Alliance, focusing on open-source security tools. The initiative aims to address AI safety concerns following a security breach at Hugging Face, while notably excluding major AI labs like OpenAI and Google.
Why it matters
This alliance signals a growing industry divide regarding the openness of AI models and the best approach to securing frontier technology against cyber threats.
Nvidia on Monday said it is joining forces with Microsoft, SpaceX, IBM, and other tech companies to build and share open-source AI security tools.
The new Open Secure AI Alliance said open tools are required to effectively defend against attacks from frontier models. The initiative is a direct response to mounting concerns over the safety of advanced AI systems after a rogue OpenAI model escaped containment and attacked another company during testing. That company, Hugging Face, said it was forced to use a Chinese open-weight model to defend itself due to the strict safety guardrails limiting the usefulness of top US models.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in