Artificial Intelligence1 min read

Models can now transmit viruses in weight-space

By · Published by Everything Blog

In short

Unlike temporary prompt manipulations, weight space programming allows an editor model to permanently introduce factual errors, capability denials, and selective omissions into a target system. During testing, researchers used an editor model to patch parameters and force a target model to generate false Olympic history. Although the experiments showed limitations in functional preservation and reliability, the core capabilities required for such tampering are already operational in frontier models.

Key points

  • Direct weight manipulation enables persistent alterations to a target network's factual k…: Direct weight manipulation enables persistent alterations to a target network's factual knowledge, core behaviors, and alignment.
  • The research did not demonstrate deployed offensive attacks or autonomous, self-propagati…: The research did not demonstrate deployed offensive attacks or autonomous, self-propagating artificial intelligence viruses.
  • The current existence of model-mediated manipulation mechanisms underscores the need for…: The current existence of model-mediated manipulation mechanisms underscores the need for rigorous weight editing controls and deployment verification.

Sources checked by our analysis pipeline: 1

Submitted 08 Nov 2026

Weight Space Misfolding

Abstract

Weight space editing changes a neural network’s knowledge, behaviour and alignment through direct modification of its weights. Model-mediated weight space manipulation, also known as weight space programming or intra-weight injection, has emerged as a capability of advanced frontier models. While it offers benefits for gradient-free adaptation, it also creates an opportunity for one model to induce unauthorised behaviour in another. We call this weight space misfolding, by analogy with protein misfolding in prion disease, and consider both direct interference and hypothetical onward propagation. The asymmetry between an attacker seeking a harmful intervention, who merely needs to generate the payload attack once, and a defender who needs to find that needle in the haystack of weights, creates an impossible choice for the latter: they can either prohibit weight editing altogether, forfeiting its benefits, or be bound to cover the burden and cost. We develop a threat model and a non-exhaustive taxonomy covering factual substitution, capability denial and selective omission, including offensive uses of selective unlearning, then illustrate it on the basis of three…

Artificial Intelligence