VC
Value Add VC
⚡HomePulse⚡Helpful Apps📝Blog🤝Partner
Illustration for: It's an AI Web, We're Rats in the Walls
Value Add VC/Pulse/AI

It's an AI Web, We're Rats in the Walls

A Register column argues AI crawlers, agents and bot traffic have quietly become the majority presence on much of the web, reshaping how sites are built, defended and monetized around non-human visitors.

TC
Trace Cohen
Early-stage VC & angel · Founder, New York Venture Partners
July 12, 2026
2 min read
ShareXLinkedInEmail

THE RUNDOWN

1

The Register's July 12 column argues that AI crawlers, scraping bots and autonomous agents have become such a dominant share of web traffic on many sites that human visitors are increasingly the minority presence, inverting the assumption the web was built to serve people first

2

The piece describes site operators reworking infrastructure, rate-limiting and content-access strategy specifically around managing AI bot traffic -- from training-data scrapers to agent-driven browsing tools like OpenAI's now-discontinued Atlas -- rather than treating it as marginal background load

3

The framing connects directly to VentureBeat's slopsquatting research and CISA's own incident-response gaps, reinforcing a broader theme that the infrastructure and security assumptions built for a human-centric web are increasingly mismatched to actual current traffic patterns

4

For publishers and content businesses, the shift raises a genuinely unresolved commercial question: if a majority of a site's traffic is non-human and non-monetizable through traditional advertising, the underlying business model of large parts of the open web needs to be rethought, not just defended

TC

The VC Read · Trace's Take

Trace Cohen

If most of your site's traffic is already non-human, then ad-impression-based business models are quietly dying underneath publishers who haven't noticed yet. The founders who figure out how to charge AI agents and crawlers directly for access -- rather than just trying to block them -- are sitting on a real, underbuilt category right now.

Analysis

The Register's July 12 column makes an argument that's more structural than it first sounds: AI crawlers, scraping bots and increasingly autonomous browsing agents have become such a dominant share of traffic on many websites that human visitors are, in a meaningful sense, becoming the minority presence -- rats in the walls of a house built for someone else.

The practical consequence is that site operators are reworking core infrastructure decisions specifically around managing non-human traffic: rate-limiting strategies, content-access gating, and increasingly aggressive bot-detection systems designed to distinguish training-data scrapers, search-indexing crawlers and agent-driven browsing tools -- like the agentic capability OpenAI folded into ChatGPT after discontinuing its standalone Atlas browser -- from genuine human visitors.

The theme connects directly to two other stories in this same news cycle: VentureBeat's slopsquatting research, which documents a new AI-specific software supply-chain attack vector, and CISA's own disclosed gap in incident-response readiness for cloud and code-repository exposures. All three point toward the same underlying pattern -- infrastructure, security and content-access assumptions built for a predominantly human web are increasingly mismatched to how the web actually gets used and abused today.

The commercial question underneath all of this is the one most publishers haven't fully answered yet: if a majority of a site's traffic is non-human and largely non-monetizable through conventional display advertising, the fundamental business model of large parts of the open web -- built on human eyeballs and ad impressions -- needs active rethinking, not just better bot-defense tooling bolted onto the existing model.

For founders building content, publishing or media businesses, the shift argues for treating AI-traffic monetization -- licensing content access to AI labs directly, building agent-friendly paid APIs, or gating premium content behind authentication that filters bot traffic by design -- as a first-order product and business-model decision, not an afterthought defensive measure. For infrastructure and security founders, bot-traffic management for an AI-dominated web is a genuinely underserved category with real, growing demand from any site operator dealing with this shift in real time.

The bear case: framing this as an existential crisis for the human web risks overstating a trend that may simply require better technical tooling to manage, rather than a wholesale rethink of how the internet works -- bot traffic has always existed, and the industry has adapted to prior waves of automated traffic before. What to watch next: whether major publishers begin disclosing bot-versus-human traffic splits more transparently, and whether AI labs move toward paying for content access at scale rather than relying on scraping that operators are increasingly motivated to block.

ShareXLinkedInEmail

Reported by The Register · Analysis by Value Add Pulse.

← Back to Pulse

THE WIRE in your inbox— Tech, startup & VC news with Trace's take. Free, no spam.

Read Next

AI· Aug 9, 2026

Physical AI's Biggest Week Yet: $21 Billion

Illustration for: Physical AI's Biggest Week Yet: $21 Billion
AI

Physical AI's Biggest Week Yet: $21 Billion

Six deals in seven days — Lumilens, Hadrian, Terafab, Valar Atomics, Base Power and K2 Space — pushed more than $21 billion into reactors, factories, satellites and chips, not a single model release among them.

AI· Aug 6, 2026

Claude Code Adds Self-Hosted Session Environments

Illustration for: Claude Code Adds Self-Hosted Session Environments
AI

Claude Code Adds Self-Hosted Session Environments

Anthropic opened a public beta letting Claude Code sessions run on a customer's own infrastructure instead of Anthropic's cloud, aimed at teams whose compliance or network requirements ruled out the hosted version.

AI· Aug 7, 2026

Why the AI Labs Just Rewired Their Org Charts

Illustration for: Why the AI Labs Just Rewired Their Org Charts
AI

Why the AI Labs Just Rewired Their Org Charts

Hassabis moving to chair, Jeff Dean's exit, and Anthropic's new chip team all landed in one week -- a trace take on what it means that frontier labs are restructuring around infrastructure, not research.

@Trace_Cohen·t@nyvp.com