AI giants promise publishers new way to block some scraping
Major AI companies including OpenAI, Google, and Microsoft have pledged to implement a standardized protocol allowing publishers to block their content from being scraped for AI training. This move comes in response to mounting legal pressure and criticism from media organizations regarding copyright infringement.
Why it matters
It represents a significant shift in the power dynamic between AI developers and content creators regarding data ownership and fair use.
OpenAI, Google, Microsoft and Anthropic pledged on Friday to give media outlets and other websites a single way to prevent their content from being scraped to train artificial intelligence (AI) models, amid growing criticisms and legal battles from news publishers. Publishers currently have to implement multiple blocking commands for every bot that crawls the web to collect data, but the new proposed solution will allow them to enter a single, standardized instruction that's recognized and honored by any AI company that adopts the protocol.
Also covering this story
One other newsroom covered this event. We read that version too.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in