Artificial Intelligence1 min read

Inkling 2 Mini

By · Published by Everything Blog

In short

The model features 26.4 billion total parameters with 3.4 billion active parameters, cycling middle layers to produce 5.4 billion weight activations. While this looping design boosts serial problem-solving, it does not expand underlying factual storage, prompting the system to rely heavily on search tools to match larger competitors. Native deployment utilizes NVFP4 quantization, while its final four layers operate in MXFP8. Developers can also evaluate a variable-loop experimental version to explore deeper multi-pass computation.

Key points

  • Looped transformers can drastically boost serial reasoning and agentic coding performance…: Looped transformers can drastically boost serial reasoning and agentic coding performance without expanding active memory requirements.
  • Because layer looping does not improve internal factual storage, the system compensates b…: Because layer looping does not improve internal factual storage, the system compensates by leveraging external search and tool integration.
  • Hardware efficiency is achieved through NVFP4 deployment with the final four layers runni…: Hardware efficiency is achieved through NVFP4 deployment with the final four layers running in MXFP8, enabling offline execution on consumer laptops.

Sources checked by our analysis pipeline: 1

Today we are releasing Inkling 2 Mini, a fast, powerful model that’s small enough to run on your laptop.

Inkling 2 Mini is a looped transformer, running the middle layers of the model three times for every token. This allows the model to apply more reasoning and reach the right answer with fewer tokens, especially on tasks such as agentic coding that depend on reasoning quality. Inkling 2 Mini leads every open-weights model with less than 100B total parameters on benchmarks such as DeepSWE v1.1 (48.2%) and Vals Index v2.2 (46.5%). It runs faster than similarly performing models as well.

Inkling 2 Mini is a Mixture-of-Experts model with 26.4B total parameters, 3.4B active, and 5.4B weight activations per token to account for looping. Looping allows the model to reason longer without writing its reasoning down, which matters for monitoring: our ability to oversee and understand what the model does by reading its chain of thought (CoT).

We measured the impact of looping on both performance and monitorability with Inkling 2 Mini and a research-specific variable-loop variant we are releasing alongside…

Artificial Intelligence