Home/Events/OpenAI, Google, Microsoft, and Anthropic Back New Standard for Opting Out of AI Scraping
OpenAI, Google, Microsoft, and Anthropic Back New Standard for Opting Out of AI Scraping
Confirmed
Confidence
90%
Impact: 80%
Updated Nov 2Consensus Brief
Major AI companies including OpenAI, Google, Microsoft, and Anthropic are adopting a new standard that allows publishers to opt out of being scraped by AI. This new control enables publishers to set their AI training preferences across multiple crawlers through a shared policy token in their robots.txt file. The initiative aims to address concerns over unauthorized scraping of content by AI models.
What Changed Since Last Update
Nov 2
New corroborating source added: The Verge published an update on 2026-10-30 ("The biggest names in AI are backing a new way to opt out of scraping").
Claim Ledger
4 claims tracked across sources
Role-Based Impact Analysis
Source Timeline
30 sources corroborating
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2
T2