Over 400 Linux CVEs published in the last 24 hours alone
A website administrator has implemented a Proof-of-Work challenge called Anubis to prevent AI companies from scraping their content. The site notes that this is a temporary measure while they develop more sophisticated methods to identify and block headless browsers.
Why it matters
This reflects the growing tension between content creators and AI companies regarding data scraping and the resulting strain on web infrastructure.
You are seeing this because the administrator of this website has set up Anubis to protect the server against the scourge of AI companies aggressively scraping websites. This can and does cause downtime for the websites, which makes their resources inaccessible for everyone.
Anubis is a compromise. Anubis uses a Proof-of-Work scheme in the vein of Hashcash, a proposed proof-of-work scheme for reducing email spam. The idea is that at individual scales the additional load is ignorable, but at mass scraper levels it adds up and makes scraping much more expensive.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in