Artificial Intelligence1 min read

METR: Anthropic redacted much of the "most informative" evidence from METR's 100-page report, so readers "must rely on our judgment more than we consider ideal" (@metr_evals)

By · Published by Everything Blog

In short

METR released a 100-page evaluation report but noted that critical supporting material was heavily redacted by Anthropic prior to publication. The evaluation group shared this disclosure publicly through its official account to highlight the restrictions placed on the findings. Because key data was withheld, the public cannot independently inspect the evidence behind the assessment. Readers are ultimately forced to trust the evaluators' judgment far more than the organization prefers.

Key points

  • Readers must rely on the evaluation group's judgment rather than verifying the actual evi…: Readers must rely on the evaluation group's judgment rather than verifying the actual evidence themselves.
  • Anthropic chose to redact what the evaluation group described as the most informative evi…: Anthropic chose to redact what the evaluation group described as the most informative evidence.
  • The transparency and independent utility of METR's safety findings were significantly com…: The transparency and independent utility of METR's safety findings were significantly compromised by the omissions.

Sources checked by our analysis pipeline: 1

Dina Bass / Bloomberg: |

Wall Street Journal: |

Emma Roth / The Verge: |

Djohnson / CyberScoop: |

Andrew E. Freedman / Tom's Hardware: |

Jaron Schneider / PetaPixel: |

Davey Alba / Bloomberg: |

Tom Warren / The Verge: |

Tom Warren / The Verge: |

Radhika Rajkumar / ZDNET: |

Takashi Mochizuki / Bloomberg: |

Andrew Webster / The Verge: |

Brody Ford / Bloomberg: |

Meghan Bobrowsky / Wall Street Journal: |

New York Times: |

Tiffany Li / The Information: |

Jay Peters / The Verge: |

Jonathan Stempel / Reuters: |

Takashi Mochizuki / Bloomberg: |

Isabelle Bousquette / Wall Street Journal: |

Kelly Cloonan / Wall Street Journal: |

Carl Franzen / VentureBeat: |

OpenAI: |

Los Angeles Times: |

Ivan Mehta / TechCrunch: |

Ben Schoon / 9to5Google: |

Marcus Mendes / 9to5Mac: |

Reuters: |

The Information: |

Rya Jetha / Business Insider: |

This is a Techmeme archive page. It shows how the site appeared at 4:30 PM ET, November 5, 2026.

The most current version of the site as…

Artificial Intelligence