Article may be outdated

This article is 16 days old. Some details may have changed since publication.

Hacker News·4 min read·hard

Unsloth Dynamic 3.0 GGUFs

J
jonesy827
Unsloth Dynamic 3.0 GGUFs
AI Summary

Unsloth has released Dynamic 3.0 GGUF quantization for Qwen3.8-27B models, claiming over 10% better accuracy at the same size compared to competitors. The update utilizes a new imatrix calibration dataset and refined quantization techniques to improve performance for coding and multilingual tasks.

Why it matters

This release provides developers with more efficient, high-quality model compression tools, enabling better performance for large language models on consumer hardware.

Dive DeeperCreate a free account to unlock

Copy On this page Basics 🦥 Unsloth Dynamic 3.0 GGUFs Unsloth Dynamic v3.0 is the next iteration of our Dynamic quantization and a major improvement over Dynamic v2.0.

Today, we’re releasing Qwen3.8-27B Dynamic v3.0 quants that deliver >10% top-1% better accuracy at the same size compared to every other provider . This is an update of our first shared early preview version of Dynamic v3.0. The new 3.0 GGUFs work with most inference engines including llama.cpp and Unsloth Desktop .

Dynamic v3.0 overall preserves more model quality while keeping the same size, with stronger results across metrics like Divergence-300 @32 and KL Divergence .

Also a huge thanks to all your support! We saw over 5.1 million Unsloth Qwen3.8 downloads in just 5 days!

Continue reading on Headlinne

Create a free account to read the full article.

Read full article →
technologyscience

Get smarter about the news

Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.

Create free account

Already have an account? Sign in