It took a year to ship WebAssembly in Anubis
Anubis is a server-side protection tool that uses Proof-of-Work challenges to deter aggressive web scraping by AI companies. It acts as a temporary barrier while the site develops more advanced fingerprinting techniques to identify and block automated bots.
Why it matters
The rise of aggressive AI scraping is causing server instability, forcing website administrators to implement defensive measures that impact user experience.
Anubis could not load its JavaScript. The server may be overloaded. Please reload the page to try again.
You are seeing this because the administrator of this website has set up Anubis to protect the server against the scourge of AI companies aggressively scraping websites. This can and does cause downtime for the websites, which makes their resources inaccessible for everyone.
Anubis is a compromise. Anubis uses a Proof-of-Work scheme in the vein of Hashcash, a proposed proof-of-work scheme for reducing email spam. The idea is that at individual scales the additional load is ignorable, but at mass scraper levels it adds up and makes scraping much more expensive.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in