# The biggest names in AI are backing a new way to opt out of scraping

> **Publication**: aitalky (Independent AI Journalism)
> **Canonical Citation URL**: https://aitalky.vercel.app/news/the-biggest-names-in-ai-are-backing-a-new-way-to-opt-out-of-scraping
> **Original Source**: [The Verge AI](https://www.theverge.com/tech/1023763/openai-google-microsoft-ai-scraping-standard-opt-out)
> **Author**: Emma Roth (undefined)
> **Published Date**: Friday, October 30, 2026
> **Category**: INDUSTRY
> **Tags**: AI, The Verge AI, industry

## Executive Summary
OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI, as reported earlier by Search Engine Roundtable.



## Full Coverage
The new control will allow publishers to apply their AI training preferences across multiple crawlers

OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI, as reported earlier by Search Engine Roundtable . With this control, publishers can apply their AI training preferences across multiple AI companies, instead of setting them individually

The shared "policy token" signal is proposed by Kevin Kelley, a technical lead for standards at Anthropic, as part of the Internet Engineering Task Force (IETF). It will live within a website's robots.txt file , which has long signaled which web crawlers can and can't scrape a site — whether for search indexing, archiving, or AI training. Currently, sites have to signal their AI training preferences separately to each AI company

---
*Generated for AI agents and LLM citation by aitalky (https://aitalky.vercel.app).*