AI & TechnologyJune 19, 2026ยท11 min readยทLast updated: June 19, 2026

NVIDIA's Networking Business: How InfiniBand and Ethernet Became AI Infrastructure

Everyone watches NVIDIA's GPUs. The quieter story is the wire between them โ€” a networking business now running above $13B a year that decides whether 100,000 GPUs behave like one computer or 100,000 idle ones.

TC
Trace Cohen
Co-Founder & GP at Six Point Ventures ยท 3x founder (BrandYourself, Launch.it, SPOT) ยท 65+ investments ยท Based in Boca Raton, FL

Quick Answer

$13B+ annualized โ€” NVIDIA's networking segment of InfiniBand plus Spectrum-X Ethernet runs above $13B a year, roughly 12% of data-center revenue and more than triple its fiscal 2023 level. It came from the $6.9B Mellanox acquisition, the interconnect that turns tens of thousands of GPUs into one training cluster.

NVIDIA's networking business runs above a $13B annual rate in 2025 โ€” roughly 12% of data-center revenue and more than triple its ~$4B level in fiscal 2023.

That's the short answer. The longer answer is more interesting: NVIDIA didn't stumble into networking. It paid $6.9B for Mellanox in 2019 because it understood something most of the market still underrates โ€” at AI scale, the wire between the GPUs matters as much as the GPUs.

NVIDIA networking, InfiniBand, and AI infrastructure: what it actually is

NVIDIA's networking business sells the high-speed interconnect that links GPUs into a single training cluster: InfiniBand switches and adapters, Spectrum-X Ethernet, ConnectX NICs, BlueField DPUs, and NVLink. It runs above $13B annualized in 2025, about 12% of data-center revenue, and came almost entirely from the $6.9B Mellanox acquisition. Its job is to move data between tens of thousands of GPUs fast enough that they behave like one machine rather than a warehouse of idle silicon.

Training a frontier model isn't one GPU working hard. It's 25,000 to 100,000 GPUs working in lockstep, exchanging gradients every few milliseconds. If the network introduces latency or drops packets, the whole cluster stalls โ€” every GPU waits for the slowest link. At that scale, a $40,000 GPU sitting idle because of a congested switch is the most expensive thing in the building. Networking is what keeps utilization high, and utilization is the entire economics of an AI data center.

NVIDIA networking revenue: from a rounding error to $13B+

Networking was a sleepy line item until the AI buildout. The trajectory tells the whole story โ€” this segment grew faster than almost anything else at NVIDIA, off a base that barely registered five years ago.

PeriodNetworking revenueApprox. share of data centerWhat drove it
FY2020 (Mellanox closes)~$3Bโ€”Acquisition completes April 2020
FY2023~$4B~17%Early AI cluster demand, InfiniBand
FY2024~$13B~13%Generative AI buildout explodes
FY2025 run rate$13B+ annualized~12%Spectrum-X ramps alongside InfiniBand
Spectrum-X aloneMulti-$B annualizedโ€”Ethernet-for-AI adoption by clouds
NVLink / scale-upEmbedded in systemsโ€”GB200 NVL72 rack-scale fabric

Figures are approximate, drawn from NVIDIA quarterly disclosures and management commentary; NVIDIA reports on a fiscal year ending in late January, so "FY2025" largely covers calendar 2024. You can track the underlying earnings on the Big Tech Earnings dashboard.

InfiniBand vs Ethernet for AI: the comparison that defines the business

The core tension in NVIDIA networking and AI infrastructure is InfiniBand versus Ethernet. InfiniBand is the purpose-built choice โ€” lossless, low-latency, with in-network compute. Ethernet is the incumbent everyone already runs. NVIDIA sells both, and Spectrum-X is its bet that it can win the Ethernet half too.

AttributeInfiniBand (NVIDIA Quantum)Ethernet (NVIDIA Spectrum-X)
LatencyLowest; lossless by designHigher, but tuned to near-IB on AI
Top line rate (2025)800 Gb/s (Quantum-2/X800)800 Gb/s (Spectrum-4/X)
In-network computeYes (SHARP collectives)Partial via BlueField DPUs
Ecosystem familiaritySpecialized HPC/AI teamsEvery network engineer knows it
Best fitLargest, tightly-coupled trainingCloud multi-tenant + AI at scale
Effective AI bandwidthReference baseline~1.6x vs standard Ethernet

For years the answer was simple: if you wanted the best training performance, you ran InfiniBand. That's why xAI, Microsoft, and Meta's largest clusters were built on it. But the world's data centers are overwhelmingly Ethernet, and hyperscalers hate single-vendor lock-in. That is precisely the opening the Ultra Ethernet Consortium โ€” backed by Broadcom, AMD, Arista, and others โ€” is targeting. NVIDIA's counter is Spectrum-X.

The $6.9B Mellanox bet that built NVIDIA networking

In March 2019 NVIDIA agreed to buy Mellanox for $6.9B, beating Intel and others in the auction. The deal closed in April 2020. At the time it looked like a steady infrastructure tuck-in โ€” Mellanox did roughly $1.3B in revenue in 2019. Six years later that business is doing more than $13B annualized. It is, alongside the original CUDA bet, one of the most consequential capital-allocation decisions in semiconductor history.

Mellanox handed NVIDIA three things it could not have built fast enough on its own: InfiniBand, the dominant AI training interconnect; high-speed Ethernet silicon; and the engineering that became BlueField DPUs. Combined with NVLink โ€” NVIDIA's own chip-to-chip and rack-scale fabric, which in the GB200 NVL72 links 72 GPUs into one giant accelerator โ€” NVIDIA now owns every layer of connectivity from inside the rack to across the data center.

InfiniBand (Quantum)

Lossless interconnect for the largest training clusters; 800 Gb/s with X800

Spectrum-X Ethernet

AI-tuned Ethernet for clouds that won't adopt InfiniBand

ConnectX NICs

The adapter inside every GPU server, moving data onto the fabric

BlueField DPUs

Offloads networking, storage, and security from the CPU

Why NVIDIA networking is becoming AI infrastructure, not an accessory

Networking typically runs 10-20% of the total cost of a large AI cluster, and that share is rising. As clusters scale from 25,000 to 100,000+ GPUs, the interconnect requirements grow faster than the compute โ€” you need more switches, more cables, more optics, and more bandwidth per GPU just to keep utilization from collapsing. On a $5B cluster, networking can be $500M-$1B of spend. That is no longer an accessory; it is a strategic line item that buyers negotiate as hard as the GPUs.

This is also why NVIDIA increasingly sells systems, not chips. The GB200 NVL72 isn't a GPU you buy โ€” it's a rack with 72 GPUs, 36 Grace CPUs, and NVLink fabric wired together, sold as one product. When NVIDIA prices a rack-scale system, the networking is baked in, the margin is captured, and the customer can't easily swap in a competitor's switch. That bundling is the quiet reason networking margins and attach rates have held up even as competitors crowd in. For the broader picture on how this stacks against AMD and Google's TPU networking, see our breakdown of the AI hardware wars.

The threats to NVIDIA's networking moat

The networking moat is real but not unassailable. Three pressures are worth watching:

What protects NVIDIA

  • โœ“ InfiniBand still leads on largest training jobs
  • โœ“ Spectrum-X already at multi-$B run rate
  • โœ“ Rack-scale systems bundle networking margin in
  • โœ“ NVLink has no real third-party substitute

What pressures it

  • โœ• Ultra Ethernet Consortium (Broadcom, AMD, Arista)
  • โœ• Hyperscalers building custom NICs and switches
  • โœ• Broadcom's Tomahawk/Jericho Ethernet share
  • โœ• Customer fatigue with single-vendor lock-in

Broadcom is the most credible challenger โ€” its merchant Ethernet silicon already powers a huge share of hyperscaler networks, and its custom-ASIC business gives it a foothold inside the same clusters NVIDIA sells into. The likely outcome isn't that NVIDIA loses networking; it's that Ethernet grows faster than InfiniBand, and NVIDIA has to defend its share with Spectrum-X rather than collect an InfiniBand toll. That is exactly why management pivoted hard to Ethernet โ€” they read the same map.

A $6.9B acquisition became a $13B+ business that decides whether 100,000 GPUs work as one.

NVIDIA didn't just sell the compute. It bought the wire โ€” and at AI scale, the wire is infrastructure.

Track AI infrastructure spend and chip earnings on the Big Tech Earnings dashboard and the AI Landscape at Value Add VC. Originally published in the Trace Cohen newsletter.

ShareXLinkedInEmail

Frequently Asked Questions

What is NVIDIA's networking business and how big is it?

NVIDIA's networking segment sells the high-speed interconnect โ€” InfiniBand and Spectrum-X Ethernet switches, ConnectX NICs, BlueField DPUs, and NVLink โ€” that links GPUs into clusters. It runs above a $13B annual rate in 2025, roughly 12% of NVIDIA's data-center revenue, up from about $4B in fiscal 2023. The business came almost entirely from the $6.9B Mellanox acquisition that closed in 2020.

What is the difference between InfiniBand and Ethernet for AI?

InfiniBand is a purpose-built interconnect with lossless delivery, hardware RDMA, and in-network computing (SHARP) that delivers the lowest latency for tightly-coupled training jobs. Ethernet is the cheaper, more familiar standard most data centers already run. NVIDIA bridges the gap with Spectrum-X, an Ethernet platform tuned for AI that claims roughly 1.6x the effective bandwidth of standard Ethernet on AI workloads.

Why did NVIDIA acquire Mellanox?

NVIDIA paid $6.9B for Mellanox in 2019 (closed April 2020) to own the interconnect layer of the AI data center, not just the compute. Mellanox brought InfiniBand, high-speed Ethernet, ConnectX NICs, and the technology that became BlueField DPUs. It is one of the best acquisitions in semiconductor history โ€” a roughly $4B business now sits on a $6.9B purchase.

What is NVIDIA Spectrum-X?

Spectrum-X is NVIDIA's Ethernet networking platform built specifically for AI, pairing Spectrum-4 switches with BlueField-3 DPUs. It targets cloud providers and enterprises that want Ethernet rather than InfiniBand, and NVIDIA says it delivers about 1.6x the effective AI workload bandwidth of conventional Ethernet. Management has said Spectrum-X is already on a multi-billion-dollar annualized revenue pace.

How much of an AI cluster's cost is networking?

Networking typically runs 10-20% of the total cost of a large AI training cluster, depending on scale and topology. On a cluster of tens of thousands of GPUs, that is hundreds of millions of dollars in switches, NICs, cables, and optics. The share rises as clusters grow because interconnect requirements scale faster than raw compute.

Explore 45+ free VC tools, dashboards, and recommended startup software.