TIME Is Serving AI Bots a Different Website, with Ads Built In
TIME magazine is serving different versions of its website based on the user-agent, providing a stripped-down markdown version to AI crawlers while showing full HTML to human browsers. This practice appears to be integrated with an ad-tech vendor to track and monetize AI bot traffic.
Why it matters
This highlights a growing trend in how publishers manage the tension between AI data scraping and traditional web monetization.
TIME is now serving two different versions of its website. Humans get the magazine. AI crawlers get a stripped down markdown copy with ads baked in that no person will ever see.
I'm writing this while working on vroni.com , my AI coding tool for turning tasks into pull requests.
I fetched one ordinary TIME health article, The Morning Light Habit Sleep Experts Swear By , over and over from the same machine, changing only the User-Agent header each time. That header is the string every browser and bot sends to say what it is. TIME reads it and decides what to hand back.
As Chrome, I got 200 OK , text/html , and 303,235 bytes. The full page, design, images, scripts. As Safari, the same 303KB. As Googlebot, also the same 303KB of HTML.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in