Artificial Intelligence1 min read

Anthropic's models improving nearly twice as fast with help from AI, study finds

By · Published by Everything Blog

In short

A safety evaluation by nonprofit METR reveals that autonomous tools now drive the majority of recent performance gains, rather than traditional hardware compute scaling. This accelerated technical evolution raises urgent concerns that recursive development could quickly outpace risk assessments, monitoring tools, and human alignment efforts. The trend also threatens to disrupt the broader industry, which has directed hundreds of billions of dollars toward massive physical training infrastructure. Researchers based these conclusions on an 11-week assessment that examined confidential research, interviews, and unreleased model data.

Key points

  • Software-driven acceleration is beginning to eclipse physical infrastructure investments…: Software-driven acceleration is beginning to eclipse physical infrastructure investments as a primary engine of progress.
  • Current systems cannot yet make fully autonomous contributions to the most critical model…: Current systems cannot yet make fully autonomous contributions to the most critical model training stages.
  • Faster development cycles risk outpacing existing safety assessments, making alignment an…: Faster development cycles risk outpacing existing safety assessments, making alignment and control far more difficult.

Sources checked by our analysis pipeline: 1

Nov 5 : Anthropic's AI models are improving nearly twice as fast as before as the technology plays a bigger role in developing more powerful versions of itself, an independent study found, fanning concerns that advances could outpace efforts to assess risks.

The findings from AI safety nonprofit METR, published on Thursday, offer some of the clearest evidence yet that AI is accelerating its own development, potentially paving the way for recursive self-improvement (RSI), when AI systems can build more powerful versions of themselves without human intervention.

METR estimated AI accounted for perhaps 80 per cent of the current acceleration, though it cautioned that the figure was uncertain. The researchers found no convincing evidence of major bottlenecks that could slow progress over the next year.

"We are confident that the acceleration was not due to an acceleration in the scaling of training compute," METR, also known Model Evaluation and Threat Research, said.

But it cautioned that AI was not yet capable of making highly significant, fully autonomous contributions to the most important stages of model training.

The prospect of recursive…

Artificial Intelligence