Home/Events/OpenAI, Google, Microsoft, and Anthropic Back New Standard for Opting Out of AI Scraping
OpenAI, Google, Microsoft, and Anthropic Back New Standard for Opting Out of AI Scraping
Confirmed
Confidence
90%
Impact: 80%
Updated 11m agoConsensus Brief
Major AI companies including OpenAI, Google, Microsoft, and Anthropic are adopting a new standard that allows publishers to opt out of being scraped by AI. This new control enables publishers to set their AI training preferences across multiple crawlers through a shared policy token in their robots.txt file. The initiative aims to address concerns over unauthorized scraping of content by AI models.
What Changed Since Last Update
11m ago
New corroborating source added: The Verge published an update on 2026-10-30 ("The biggest names in AI are backing a new way to opt out of scraping").
Claim Ledger
4 claims tracked across sources
Role-Based Impact Analysis
Source Timeline
10 sources corroborating
T2
T2
T2
T2
T2
T2
T2
T2
T2