What this AI news story is about
OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI, as reported earlier by Search Engine Roundtable. With this control, publishers can apply their AI training preferences across multiple AI companies,…
What happened
OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI, as reported earlier by Search Engine Roundtable. With this control, publishers can apply their AI training preferences across multiple AI companies, instead of setting them individually.
The shared “policy token” signal is proposed by Kevin Kelley, a technical lead for standards at Anthropic, as part of the Internet Engineering Task Force (IETF). It will live within a website’s robots.txt file, which has long signaled which web crawlers can and can’t scrape a site – whether for search indexing, archiving, or …
Read the full story at The Verge.
What readers should know
This TrueVitaHub page summarizes the news information available in the feed. For the complete publisher report, additional reporting, quotes and the latest updates, visit the original source.
Continue with the original source
Read the publisher's complete report for the full story and any subsequent updates.
