Artificial Intelligence1 min read

Anthropic is working on a system to prove AI models’ identity

By · Via TechCrunch · Published by Everything Blog

In short

FlashProve establishes provable inference by generating cryptographic signatures that match model outputs against publicly shared fingerprints. These verifications can run directly on a user's local device without revealing the sensitive inner workings of closed commercial systems. To accelerate testing and development across the broader ecosystem, Anthropic has released the technical specification and code repository publicly on GitHub. While the framework is available for outside experimentation, it remains an active research project with no immediate commercial deployment scheduled.

Key points

  • Cryptographic verification prevents providers from secretly deploying cheaper model subst…: Cryptographic verification prevents providers from secretly deploying cheaper model substitutes or manipulating benchmark results.
  • The framework enables independent confirmation of third-party claims, including whether f…: The framework enables independent confirmation of third-party claims, including whether frontier models genuinely audited specific software.
  • The project currently serves as an open research effort without immediate plans for comme…: The project currently serves as an open research effort without immediate plans for commercial deployment by major laboratories.

Sources checked by our analysis pipeline: 1

Anthropic is working on an open-source system to verify which AI model produced a given output, according to a blog post published Tuesday. The system, called FlashProve, is built to provide what researchers call “provable inference” – a cryptographic proof, essentially a mathematical guarantee, that a given output came from a specific model. It’s meant to let users confirm that the answer they received really came from the model they think they’re using.

Similar to cryptographic email signatures that let recipients confirm a message really came from its claimed sender, FlashProve would be robust against impostors attempting to disguise one model as another, even when the impostor is the lab that built and runs the model. In particular, the researchers note that the system could be used to prevent an AI company from secretly swapping in a cheaper model to cut costs, or a more expensive model to inflate its performance results.

FlashProve could also be used to verify claims by third parties that a specific task was done by an advanced model. “A developer might claim that their software…

Artificial Intelligence