Illustration for: Why The AI Bosses Started Warning About AI

Why The AI Bosses Started Warning About AI

A cluster of safety warnings from the people running the largest AI labs arrived within days of each other, and the reasons are commercial, regulatory and technical at once rather than a single change of heart.

TC
By the AI Desk
Edited by Trace Cohen · Early-stage VC & angel · Founder, New York Venture Partners
2 min read
ShareXLinkedInEmail
TC

The VC Read · Trace's Take

Trace Cohen

Watch capex guidance, not essays. If the labs are genuinely pacing, it shows up as a downward revision in data center commitments next quarter, and nothing else counts as evidence. My read is that the safety language is sincere and the shipping cadence is unchanged, which is the same combination we saw in social media circa 2018.

Analysis

The people building frontier AI spent the past week publicly worrying about frontier AI, and TechCrunch went looking for why. Dario Amodei published an essay arguing for pacing. Microsoft committed to kill switches. Anthropic, OpenAI and Google held private talks about an industry safety body. Three explanations compete, and they are not mutually exclusive.

The first is capability. Agentic systems that execute multi-step tasks against real infrastructure fail differently from chatbots -- an incorrect answer becomes an incorrect action, and the blast radius includes production systems. Labs have internal evaluation data on those failure modes that nobody outside sees, and it is plausible that the curve looked worse this quarter than last.

The second is regulatory positioning, and the record here is well documented. Every major platform industry -- tobacco, finance, social media -- eventually asks for the rules it can meet. Anthropic and OpenAI both employ large policy teams, both have supported specific bills while opposing others, and OpenAI negotiated California's new chatbot statute line by line. Asking for pacing when you have the largest safety budget in the field sets a floor your competitors must fund.

Nvidia fell about 3% and Micron, Marvell, SK Hynix and Super Micro dropped roughly 6% each after Amodei's essay, while Alphabet, Microsoft and Meta rose.

The third is commercial, and Monday's tape priced it directly. Nvidia fell about 3% and Micron, Marvell, SK Hynix and Super Micro dropped roughly 6% each after Amodei's essay, while Alphabet, Microsoft and Meta rose. Markets read "slow down" as a demand signal about capital expenditure on chips, not as a statement about safety. That is a costly thing for a lab chief to say if he does not mean it.

What the warnings are not is a change in shipping behavior. No lab paused a release, cancelled a training run, or delayed a product this week. Pulse covered Amodei's essay when it published; the follow-through since then has been documents, not decisions. Until a company forgoes revenue over a stated safety concern, the warnings describe an intention rather than a constraint.

The cleanest test is compute. Frontier training runs are visible in capex guidance and in data center power contracts, and both are disclosed quarterly. If pacing is real, the next earnings cycle shows it in the numbers.

ShareXLinkedInEmail

Key Sources

2 sources

Reported by TechCrunch · Analysis by Value Add Pulse.

← Back to Pulse

THE WIRE in your inbox— Tech, startup & VC news with Trace's take. Free, no spam.