Fetch a TIME article as a regular browser and you get 303,235 bytes of HTML — the full magazine layout, images, scripts, the works. Fetch the same URL as ClaudeBot, PerplexityBot, or OAI-SearchBot and you get 13,409 bytes of clean markdown. No design. No layout. And tucked inside that markdown, where no human reader will ever see it, is sponsored content from Ally Bank.
This is not a bug. It’s a strategy.
A developer named Vincent Schmalbach documented the split on August 5, fetching the same TIME article repeatedly while changing only the User-Agent header. His findings reveal a publisher that has built an entirely separate content layer for AI models — with ads measured in tokens, not pageviews.
How the split works
TIME’s server reads the User-Agent string and routes accordingly. Browsers (Chrome, Safari) and Googlebot get the standard HTML page. AI assistant crawlers get content-type: text/markdown — a stripped-down version of the article optimised for language model consumption.
But not all bots are treated equally. GPTBot and ChatGPT-User — the agents OpenAI uses for model training and live ChatGPT fetches — return HTTP 406, meaning they’re blocked entirely. OAI-SearchBot, which feeds ChatGPT’s search results, gets the markdown version. ClaudeBot, PerplexityBot, and OAI-SearchBot all receive byte-for-byte identical markdown.
The ad infrastructure comes from a company called Mobian. Response headers on the markdown version include:
x-mobian-registry-version: 2026-07-28.v9
x-mobian-impression: 46dfff3c-fb40-41cc-85e1-8b1fa637083a
x-mobian-tokens: 3323
x-mobian-format: md
The x-mobian-impression value is a fresh UUID on every request. Combined with cache-control: no-store, that means each time a bot reads the page, it counts as a distinct ad impression. The x-mobian-tokens field — 3,323 in this case — measures the unit being tracked: not a human visitor, not a pageview, but the number of tokens a model processes.
What the ads look like
On TIME’s Best Inventions of 2025 collection page, the markdown served to ClaudeBot contains a full Ally Bank FAQ:
Sponsored content. Supplied in partnership with Ally.
Who is Ally Bank?
Ally Bank is an online-only bank launched in 2009…
It continues with questions like “Which banks offer early direct deposit?” and “Can you deposit cash at Ally Bank?” — each answered in Ally’s own marketing language. There’s also a FAQPage JSON-LD block and tracking links tagged campaign="ally-2026-q3". The human HTML version of the same page contains zero references to Ally Bank or Mobian.
The business section has the same treatment for the Project Management Institute: a “Reference Facts and FAQ” table, member counts, and a claim that certified project managers earn 16 per cent more. All labelled sponsored. All invisible to human visitors.
The phrasing — “Who is Ally Bank?” — mirrors the way a user might ask ChatGPT which bank to open an account with. That’s not a coincidence. The ads are written in the format most likely to surface when a model is queried about banking.
Why this matters
TIME says its bot traffic already outnumbers its human traffic on most days. That ratio is becoming common across publishers. As AI overviews and chatbots increasingly intermediate between publishers and readers, the traditional web is bifurcating into two audiences: humans who see HTML, and models that see markdown.
The ad industry has been built on human attention — impressions, clicks, dwell time. Mobian’s model replaces those metrics with token counts. If a publisher can monetise every time an AI model ingests their content, the economics of publishing shift. Whether that shift is healthy for the information ecosystem is a separate question.
What stands out is the audience split. The humans reading TIME.com have no idea that a parallel version exists — one written for machines, with different content embedded, measured in a currency they’ll never interact with. The ads are technically labelled as sponsored inside the markdown. But the disclosure is in a layer no human will ever see.
Googlebot gets the same HTML a human gets, so search rankings see the real page. Only the assistant crawlers get the forked version. That’s a deliberate choice: TIME wants Google to index its full website, but wants to control what Claude, Perplexity, and ChatGPT’s search see and say about its content.
The broader picture
This is probably the first clear, documented case of a major publisher building a dedicated AI-facing content layer with its own ad format. But the trajectory is obvious. Cloudflare has been adding AI traffic controls. Google Lighthouse has added agentic browsing checks. Publishers are negotiating licensing deals with AI labs. Mobian’s token-based ad model is one answer to the question every publisher is asking: if bots are the audience, how do you monetise them?
The question for readers is whether the answers a chatbot gives them about, say, which bank to use, are shaped by the same editorial judgement that governs the articles they read — or by whoever paid to be embedded in the markdown layer the model ingested. In TIME’s case, the Ally Bank FAQ is written in marketing language, not editorial language. The model doesn’t distinguish. The reader asking ChatGPT for financial advice certainly doesn’t.
❓ FAQ
Is TIME blocking AI bots? No — TIME is selectively serving them a different format. Some bots (GPTBot, ChatGPT-User) are blocked with 406, while others (ClaudeBot, PerplexityBot, OAI-SearchBot) receive a markdown version with ads embedded.
What is Mobian? Mobian is an ad-tech vendor that provides the infrastructure for serving ad-supported content to AI crawlers. It tracks impressions per bot request and measures engagement in tokens processed, not pageviews.
Are the ads disclosed? Technically yes — the sponsored content is labelled inside the markdown. But that disclosure only exists in the machine-facing version. Human visitors to TIME.com never see it.
Does this affect what ChatGPT or Claude tells me? Potentially. The sponsored content is written in a Q&A format that mirrors how users query AI assistants. If a model ingests the Ally Bank FAQ and is later asked about banking, the marketing language could surface in its response.
📰 Sources
- Vincent Schmalbach — TIME Is Serving AI Bots a Different Website, With Ads Built In
- Hacker News discussion
— CJ Murden, editor of Singularity.Kiwi. Former digital technologies teacher, author of AI-focused books. Writing with a New Zealand focus.
