VC
Value Add VC
⚡HomePulse⚡Helpful Apps📝Blog
Illustration for: Pichai: Google Starts 'Most Ambitious' Gemini 4 Training Run
Value Add VC/Pulse/AI

Pichai: Google Starts 'Most Ambitious' Gemini 4 Training Run

Sundar Pichai says Google has begun its largest-ever pretraining run for Gemini 4, even as the more immediate Gemini 3.5 Pro release stays delayed over coding-capability gaps.

Gemini 4
Model
Pretraining started
Training status
Delayed 3x
Gemini 3.5 Pro
Coding gap
Cited weakness
Target future frontier
Strategy
TC
Trace Cohen
Early-stage VC & angel · Founder, New York Venture Partners
July 23, 2026
3 min read
ShareXLinkedInEmail

THE RUNDOWN

1

Pichai told investors and press "we have started our most ambitious pretraining run yet for Gemini 4," which Google has confirmed is the largest single pretraining effort in the company's history

2

Gemini 3.5 Pro, the more near-term model, has been delayed three times; Pichai directly acknowledged Google trails rivals on AI coding capability, the specific gap slowing that release, and said the model will ship "as soon as it's ready" rather than on a fixed date

3

Pichai framed Gemini 4's target explicitly as competing at "the frontier level of where the frontier will be when Gemini 4 comes out" -- an unusual public admission that Google is training against where competitors will be, not where they are today

4

The disclosure lands the same week Alphabet raised 2026 capex guidance to as much as $205 billion and posted its first-ever negative free cash flow, meaning the company is now publicly tying its next flagship model's ambition directly to the infrastructure spend already worrying investors

TC

The VC Read · Trace's Take

Trace Cohen

Pichai admitting a coding gap in public, three delays into Gemini 3.5 Pro, is a bigger tell than the Gemini 4 pretraining headline -- incumbents don't concede weakness on the metric developers care about most unless the gap is real and closing slower than they'd like. If you're picking a foundation model for a coding-heavy product today, this is Google telling you not to wait for them; revisit the decision when Gemini 4 actually ships and can be benchmarked, not before.

AI Landscape → Frontier AI Dashboard →

Analysis

Sundar Pichai confirmed Google has begun what he called its "most ambitious pretraining run yet" for Gemini 4 -- a training effort Google says is the largest single pretraining project in the company's history. The announcement came alongside a more uncomfortable admission: Gemini 3.5 Pro, the nearer-term model investors and developers have been waiting on, has now been delayed three times, and Pichai directly acknowledged Google currently trails rivals on AI coding capability, the specific weakness slowing that release. Google said it will ship Gemini 3.5 Pro "as soon as it's ready" rather than commit to a new date.

The framing Pichai used for Gemini 4 is the more interesting strategic signal. He said Google is building the model to compete at "the frontier level of where the frontier will be when Gemini 4 comes out" -- an explicit statement that Google isn't training to match OpenAI's GPT-5.6 lineup or Anthropic's Fable today, but is instead trying to anticipate where the competitive frontier sits by the time its own model actually ships. That's a materially different posture than the coding-gap admission around Gemini 3.5 Pro suggests: Google is conceding it's behind in the near term while betting its next flagship leapfrogs the field entirely once it arrives.

The competitive backdrop makes both admissions higher stakes than they'd otherwise be. OpenAI's GPT-5.6 shipped as three separate models -- Sol, Terra and Luna -- rather than a single release, and Moonshot AI's Kimi K3 has become the most capable open-weight model released to date, reportedly matching or beating closed frontier systems from both Anthropic and OpenAI on public benchmarks. A Google that publicly concedes a coding gap on its near-term model, while it's simultaneously the incumbent search and cloud giant, hands both established rivals and rapidly improving open-weight labs a concrete opening to court developers on that exact capability.

“The framing Pichai used for Gemini 4 is the more interesting strategic signal.”

The disclosure also can't be read apart from Alphabet's spending story. The same week Pichai discussed Gemini 4's ambitious pretraining scope, Alphabet raised its 2026 capex guidance to as much as $205 billion and reported its first-ever negative free cash flow, driven almost entirely by AI infrastructure buildout. Training "the largest pretraining run in company history" is not a free-standing R&D decision -- it is a direct claim on the same capital budget already drawing scrutiny from investors questioning whether AI infrastructure spend across the industry is converting into revenue fast enough.

For founders and investors building on top of Gemini's API and enterprise stack, the practical read-through is a near-term one: Gemini 3.5 Pro's delay means the coding-capability gap Pichai admitted to is a live constraint today, not a solved problem, and teams choosing a foundation model for coding-heavy products should weight that against Anthropic's and OpenAI's current offerings rather than assume Google's gap closes on any predictable timeline. Gemini 4's more ambitious, frontier-anticipating design is a longer-horizon bet that won't affect product decisions being made this quarter.

The bear case: publicly conceding you're behind on a specific capability, three delays deep on a model already promised to the market, is a real credibility cost regardless of how ambitious the next model's training run is described as being. "Ship when it's ready" is the same language companies use right before further delays, and Gemini 4's frontier-anticipating framing is unfalsifiable until the model actually exists and can be benchmarked.

Watch whether Gemini 3.5 Pro actually ships in the coming weeks and how its coding benchmarks compare to GPT-5.6 and Kimi K3 at release, whether Google discloses a rough timeline for Gemini 4 given the scale of the training run just disclosed, and whether Alphabet's next earnings call ties Gemini 4's training costs explicitly to the capex guidance already unsettling investors.

ShareXLinkedInEmail
More onGoogle →

Analysis and editorial commentary by Value Add Pulse.

← Back to Pulse

THE WIRE in your inbox— Tech, startup & VC news with Trace's take. Free, no spam.

Read Next

AI· Jul 25, 2026

Nvidia, SK Group Unveil $500B+ Korea AI Buildout

Illustration for: Nvidia, SK Group Unveil $500B+ Korea AI Buildout
AI$500B+ Initiative

Nvidia, SK Group Unveil $500B+ Korea AI Buildout

Nvidia and South Korea's SK Group unveiled a more than $500 billion AI infrastructure initiative spanning a 2-gigawatt SK Telecom data center, a new SK Hynix memory partnership, and a $1 billion Nvidia investment in Naver.

AI· Jul 24, 2026

Anthropic Launches Claude Opus 5 at Half Fable 5's Price

Illustration for: Anthropic Launches Claude Opus 5 at Half Fable 5's Price
AI$5/$25 per 1M tokens

Anthropic Launches Claude Opus 5 at Half Fable 5's Price

Anthropic released Claude Opus 5, its fourth model in two months, delivering performance close to flagship Fable 5 at roughly half the API price and topping Fable 5 on most public benchmarks.

AI· Jul 24, 2026

Microsoft Ships In-House AI Models, Claims 89% Cost Cut

Illustration for: Microsoft Ships In-House AI Models, Claims 89% Cost Cut
AIUp to 89% GPU Cost Cut

Microsoft Ships In-House AI Models, Claims 89% Cost Cut

Microsoft released MAI-Voice-2-Flash and MAI-Image-2.5-Pro, in-house voice and image models it says cut GPU costs by up to 89% versus OpenAI's equivalent models, deepening Microsoft's push toward AI independence from its largest partner.

@Trace_Cohen·t@nyvp.com