Artificial Intelligence1 min read

Unsloth Qwen3.8-27B Quantizations – Dynamic v3.1 Update

By · Published by Everything Blog

In short

The updated 27-billion-parameter dense model uses the Dynamic V3.1 algorithm to deliver accuracy improvements across 2-bit to 6-bit quantizations, excluding unaffected 3-bit UD3 quants. It features a native 256K context window expandable to 1M via YaRN, alongside specialized support for nested object parsing and developer role tools like Codex. Local deployment is accessible on macOS, Windows, and Linux via tools like llama.cpp and the Unsloth Desktop application. Additionally, 4-bit versions need just 16GB to 19GB of memory, fitting comfortably on hardware like RTX 4090 or RTX 5080 cards.

Key points

  • Multi-token prediction and developer role integration enhance inference speed and compati…: Multi-token prediction and developer role integration enhance inference speed and compatibility with agentic tools like Codex.
  • A configurable hybrid thinking engine provides reasoning levels up to "xhigh" and preserv…: A configurable hybrid thinking engine provides reasoning levels up to "xhigh" and preserves reasoning traces across extended conversations.
  • Local environments automate system setup by handling multi-GPU detection, memory offloadi…: Local environments automate system setup by handling multi-GPU detection, memory offloading, code execution, and web searching directly through desktop software.

Sources checked by our analysis pipeline: 1

Qwen3.8 - How to Run Locally

Guide to running Qwen3.8 quants including Qwen3.8-27B on your local setup.

Qwen3.8-27B is a 27B parameter dense model Qwen, featuring vision and reasoning capabilities, a 256K context window, and runs locally on 17GB RAM/VRAM setups. Qwen3.8 excels at agentic coding, vision and chat tasks, and can now run via Unsloth GGUFs, NVFP4 and Unsloth Desktop.

Nov 11 Update: Qwen3.8-27B GGUFs now use Unsloth Dynamic V3.1 which improves average accuracy by 5-10% accuracy at comparable sizes including Terminal Bench, DeepSWE and more benchmarks. We're working on an even better version of Dynamic quants which will be applied to Qwen4 and future models.

Thank you Qwen for day zero access. Unsloth quants also include:

Developer Role Support for agentic tools like Codex

MTP enabled for fast inference

Tool calling: Improved parsing nested objects to make tools succeed more

Unsloth quants: Qwen3.8-27B-GGUF

Dynamic V3.1 Update (November 11th 2026)

We're excited to release new Qwen3.8-27B GGUFs using our updated Unsloth Dynamic V3.1 (preview) algorithm which improves Unsloth quants by 5-10% accuracy at the same size on most benchmarks…

Artificial Intelligence