VC
Value Add VC
⚡HomePulse⚡Helpful Apps📝Blog🤝Partner
Illustration for: It's an AI Web, We're Rats in the Walls
Value Add VC/Pulse/AI

It's an AI Web, We're Rats in the Walls

A Register column argues AI crawlers, agents and bot traffic have quietly become the majority presence on much of the web, reshaping how sites are built, defended and monetized around non-human visitors.

TC
By the AI Desk
Edited by Trace Cohen · Early-stage VC & angel · Founder, New York Venture Partners
July 12, 2026
2 min read
ShareXLinkedInEmail

THE RUNDOWN

1

The Register's July 12 column argues that AI crawlers, scraping bots and autonomous agents have become such a dominant share of web traffic on many sites that human visitors are increasingly the minority presence, inverting the assumption the web was built to serve people first

2

The piece describes site operators reworking infrastructure, rate-limiting and content-access strategy specifically around managing AI bot traffic -- from training-data scrapers to agent-driven browsing tools like OpenAI's now-discontinued Atlas -- rather than treating it as marginal background load

3

The framing connects directly to VentureBeat's slopsquatting research and CISA's own incident-response gaps, reinforcing a broader theme that the infrastructure and security assumptions built for a human-centric web are increasingly mismatched to actual current traffic patterns

4

For publishers and content businesses, the shift raises a genuinely unresolved commercial question: if a majority of a site's traffic is non-human and non-monetizable through traditional advertising, the underlying business model of large parts of the open web needs to be rethought, not just defended

TC

The VC Read · Trace's Take

Trace Cohen

If most of your site's traffic is already non-human, then ad-impression-based business models are quietly dying underneath publishers who haven't noticed yet. The founders who figure out how to charge AI agents and crawlers directly for access -- rather than just trying to block them -- are sitting on a real, underbuilt category right now.

Analysis

The Register's July 12 column makes an argument that's more structural than it first sounds: AI crawlers, scraping bots and increasingly autonomous browsing agents have become such a dominant share of traffic on many websites that human visitors are, in a meaningful sense, becoming the minority presence -- rats in the walls of a house built for someone else.

The practical consequence is that site operators are reworking core infrastructure decisions specifically around managing non-human traffic: rate-limiting strategies, content-access gating, and increasingly aggressive bot-detection systems designed to distinguish training-data scrapers, search-indexing crawlers and agent-driven browsing tools -- like the agentic capability OpenAI folded into ChatGPT after discontinuing its standalone Atlas browser -- from genuine human visitors.

The theme connects directly to two other stories in this same news cycle: VentureBeat's slopsquatting research, which documents a new AI-specific software supply-chain attack vector, and CISA's own disclosed gap in incident-response readiness for cloud and code-repository exposures. All three point toward the same underlying pattern -- infrastructure, security and content-access assumptions built for a predominantly human web are increasingly mismatched to how the web actually gets used and abused today.

The commercial question underneath all of this is the one most publishers haven't fully answered yet: if a majority of a site's traffic is non-human and largely non-monetizable through conventional display advertising, the fundamental business model of large parts of the open web -- built on human eyeballs and ad impressions -- needs active rethinking, not just better bot-defense tooling bolted onto the existing model.

For founders building content, publishing or media businesses, the shift argues for treating AI-traffic monetization -- licensing content access to AI labs directly, building agent-friendly paid APIs, or gating premium content behind authentication that filters bot traffic by design -- as a first-order product and business-model decision, not an afterthought defensive measure. For infrastructure and security founders, bot-traffic management for an AI-dominated web is a genuinely underserved category with real, growing demand from any site operator dealing with this shift in real time.

The bear case: framing this as an existential crisis for the human web risks overstating a trend that may simply require better technical tooling to manage, rather than a wholesale rethink of how the internet works -- bot traffic has always existed, and the industry has adapted to prior waves of automated traffic before. What to watch next: whether major publishers begin disclosing bot-versus-human traffic splits more transparently, and whether AI labs move toward paying for content access at scale rather than relying on scraping that operators are increasingly motivated to block.

Related Deep Dives

  • $4.7B Vibe Coding Market — What Founders Build →
  • AI Supply Chain ROI 2026: 23% Higher Profit Margins, $1.7... →
  • Cerebras Revenue 2026: $880M Guidance and How the Chip Ma... →
ShareXLinkedInEmail

Key Sources

2 sources
SourceThe Register
AnalysisValue Add Pulse

Reported by The Register · Analysis by Value Add Pulse.

← Back to Pulse

THE WIRE in your inbox— Tech, startup & VC news with Trace's take. Free, no spam.

Read Next

AI· Aug 26, 2026

Bill Gates Warns Leaders Are Unprepared for 3 AI Risks

Illustration for: Bill Gates Warns Leaders Are Unprepared for 3 AI Risks
AI

Bill Gates Warns Leaders Are Unprepared for 3 AI Risks

Bill Gates published an essay striking a more cautious tone on AI than his past optimism, warning world leaders are unprepared for stunted child development, emboldened criminals and vanishing entry-level jobs for Gen Z.

AI· Aug 24, 2026

IBM Unveils Chip That Runs Arm and Z Code on One Core

Illustration for: IBM Unveils Chip That Runs Arm and Z Code on One Core
AI

IBM Unveils Chip That Runs Arm and Z Code on One Core

IBM revealed a dual-architecture mainframe processor whose cores natively switch between Arm and z/Architecture instructions in nanoseconds, letting banks run Arm-native AI software directly alongside legacy z/OS transaction systems.

AI· Aug 25, 2026

Humanoid Robots Break Sprint Records, Some Catch Fire

Illustration for: Humanoid Robots Break Sprint Records, Some Catch Fire
AI

Humanoid Robots Break Sprint Records, Some Catch Fire

At Beijing's second World Humanoid Robot Games, a robot ran the 100 meters in 9.32 seconds, faster than Usain Bolt's human world record, while other competing robots tripped, crashed and in some cases caught fire during events.

Deep Dives

$4.7B Vibe Coding Market — What Founders BuildAI Supply Chain ROI 2026: 23% Higher Profit Margins, $1.7...Cerebras Revenue 2026: $880M Guidance and How the Chip Ma...
@Trace_Cohen·t@nyvp.com