Emma Roth / The Verge : OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI across multiple crawlers — The new control will allow publishers to apply their AI training preferences across multiple crawlers.
OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI across multiple crawlers (Emma Roth/The Verge)
In short
Major technology firms have agreed to implement a standardized mechanism enabling website owners to block automated data gathering across several crawlers simultaneously. The new control streamlines permissions by letting publishers apply their artificial intelligence training preferences in one coordinated step. This collective move establishes a unified approach among competing artificial intelligence developers.
Key points
- Publishers can now set their data scraping preferences across several artificial intellig…: Publishers can now set their data scraping preferences across several artificial intelligence web crawlers at once.
- Competing artificial intelligence developers are working together to simplify permission…: Competing artificial intelligence developers are working together to simplify permission controls for digital content owners.
- The shared standard enables websites to restrict artificial intelligence training use acr…: The shared standard enables websites to restrict artificial intelligence training use across multiple crawlers more efficiently.