Analysis
The first benchmarks for Nvidia's Groq 3 LPU inference hardware have been published, offering an early read on a roughly $20 billion bet, The Register reported. Separately, Nvidia announced new customers for its Vera CPU and Groq LPX racks, The Information reported.
Groq's original architecture, developed by a team led by former Google TPU engineer Jonathan Ross, took a deliberately different approach from GPUs: a deterministic, software-scheduled design with on-chip SRAM instead of external memory, optimized for streaming tokens out fast rather than crunching training batches. Its selling point was always latency -- responses that arrive at conversational speed -- rather than throughput per dollar on a training job.
“Update (August 25, 2026): Pulse has follow-up coverage — Nvidia Announces New Vera CPU, Groq LPX Rack Customers.”
Folding that into Nvidia's product line addresses a genuine strategic exposure. Training demand is concentrated among a handful of labs; inference demand scales with every deployed application, and it is the workload most likely to migrate to cheaper silicon from AMD, Google, Amazon or a specialist. A dedicated inference part inside the Nvidia stack means a customer optimizing inference cost does not have to leave the ecosystem to do it.
Benchmarks published this early are worth reading skeptically. Vendor-adjacent configurations, batch sizes and model choices all move inference numbers substantially, and the figure that decides purchasing is cost per million tokens at production concurrency, under a real serving stack. New named customers for the LPX racks are the more durable evidence, because those represent someone spending money rather than someone publishing a chart.
Update (August 25, 2026): Pulse has follow-up coverage — Nvidia Announces New Vera CPU, Groq LPX Rack Customers.
