Inkling: Our Open-Weights Model
Hugging Face has released 'Inkling,' a new open-weights AI model designed for customization and interactive collaboration. The model is a Mixture-of-Experts transformer capable of multimodal reasoning and is available for fine-tuning on the company's Tinker platform.
Why it matters
The release of high-parameter open-weights models democratizes access to advanced AI capabilities, allowing developers to build specialized applications without relying solely on closed-source providers.
Hugging Face Our mission is to build AI that extends human will and judgment. We have developed a platform that lets anyone customize models, previewed an AI system built for interactive collaboration, and published novel research . Today we are advancing our mission by releasing a model we trained from scratch with the full weights available, so that people can make it their own.
Our model, called Inkling, is a Mixture-of-Experts transformer with 975B total parameters, 41B active. It supports a context window of up to 1M tokens. It was pretrained on 45 trillion tokens of text, images, audio and video. It is the first in a family of models of different sizes: alongside it we are sharing a preview of Inkling-Small, a lighter-weight model with 12B active parameters, trained with a similar recipe, that achieves strong performance with even lower cost and latency.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in