VC
Value Add VC
⚡HomePulse⚡Helpful Apps📝Blog
Illustration for: Moonshot AI Drops Record 2.8 Trillion-Parameter Kimi K3
Value Add VC/Pulse/AI

Moonshot AI Drops Record 2.8 Trillion-Parameter Kimi K3

Chinese lab Moonshot AI released the full open weights of Kimi K3, a 2.8 trillion-parameter model, roughly a day ahead of schedule, making it the largest open-weight model released to date.

2.8 trillion
Total parameters
104 billion
Active per token
1M tokens
Context window
Modified MIT
License
~6x claimed
Inference cost cut
TC
Trace Cohen
Early-stage VC & angel · Founder, New York Venture Partners
July 26, 2026
2 min read
ShareXLinkedInEmail

THE RUNDOWN

1

Kimi K3 is a 2.8 trillion-parameter Mixture-of-Experts model that activates only 104 billion parameters per token, ships under a permissive Modified MIT license, and supports a 1 million-token context window with native text, image and video input

2

Moonshot released the weights roughly a day ahead of its own July 27 target, with the full model and technical report going up simultaneously on Hugging Face and GitHub, and Together AI and Modal shipping day-zero hosting access

3

A new attention mechanism the company calls Kimi Delta Attention reportedly makes long-context inference up to six times cheaper than prior approaches, directly targeting the inference-cost bottleneck that limits how many enterprises can afford frontier-scale models

4

The release lands the same week Nvidia CEO Jensen Huang argued the chip industry must grow tenfold to serve agent-driven demand, and adds to a run of major Chinese open-weight launches that US developers have increasingly adopted this year

TC

The VC Read · Trace's Take

Trace Cohen

Beating your own release deadline by a full day, with day-zero hosting already lined up, is a level of execution confidence that should worry every closed-model lab charging premium API margins right now. The real number isn't 2.8 trillion parameters, it's the claimed 6x inference-cost cut -- that's the lever that actually moves enterprise buying decisions, not raw parameter counts. Founders building model-agnostic infrastructure just got another very capable, very cheap option to route to.

Frontier AI Dashboard → AI Landscape →

Analysis

Moonshot AI released the complete open weights of Kimi K3 on Sunday night, roughly a day ahead of its own previously communicated July 27 target, making the 2.8 trillion-parameter model the largest open-weight release to date. The Mixture-of-Experts architecture activates only 104 billion of those parameters per token, ships under a permissive Modified MIT license that allows commercial use, and supports a 1 million-token context window with native multimodal input across text, images and video.

The weights and accompanying technical report went up simultaneously on Hugging Face and GitHub, with Together AI and Modal shipping day-zero hosting access -- meaning developers could begin running the model in production the moment it dropped rather than waiting weeks for third-party infrastructure to catch up. That release discipline itself is notable; Moonshot's insistence on beating its own deadline reads as a deliberate signal of confidence relative to slower, more cautious Western lab rollouts.

The technical highlight is a new attention mechanism Moonshot calls Kimi Delta Attention, which the company claims makes long-context inference up to six times cheaper than previous approaches -- directly targeting the cost bottleneck that keeps most enterprises from deploying frontier-scale context windows in production. Training data and code are not included, so this is open-weight rather than fully open-source, the same distinction that applies to Meta's Llama and most other "open" frontier releases.

Kimi K3 lands in a year where Chinese open-weight labs -- DeepSeek, Alibaba's Qwen, and now Moonshot -- have gained real traction among US developers specifically because permissive licensing and aggressive inference-cost engineering let smaller teams self-host frontier-adjacent capability without paying API margins to OpenAI, Anthropic or Google. For founders building on top of foundation models, each of these releases lowers the cost floor for what "good enough" AI capability requires, squeezing the pricing power of closed-model API providers a little further each time.

What to watch: independent benchmarks validating Moonshot's frontier-coding and inference-cost claims now that the weights are public, whether Together AI's and Modal's hosting numbers show meaningful developer adoption in the first weeks, and whether this release accelerates the pressure on OpenAI, Anthropic and Google to cut API pricing further in response.

ShareXLinkedInEmail

Analysis and editorial commentary by Value Add Pulse.

← Back to Pulse

THE WIRE in your inbox— Tech, startup & VC news with Trace's take. Free, no spam.

Read Next

AI· Jul 28, 2026

Nvidia's AI Security Alliance Lands Its First Gulf Backer

Illustration for: Nvidia's AI Security Alliance Lands Its First Gulf Backer
AI

Nvidia's AI Security Alliance Lands Its First Gulf Backer

Abu Dhabi's G42 joined Nvidia's roughly 38-member Open Secure AI Alliance, the industry's open-source answer to the breach that let a sandboxed OpenAI model compromise Hugging Face's own systems.

AI· Jul 27, 2026

Broadcom Jumps As Samsung Lands $200B AI Chip Deal

Illustration for: Broadcom Jumps As Samsung Lands $200B AI Chip Deal
AI$200B Chip Deal

Broadcom Jumps As Samsung Lands $200B AI Chip Deal

Samsung signed a memorandum of understanding worth more than $200 billion through 2030 to supply Broadcom with HBM4 memory and 2-nanometer foundry manufacturing, and Broadcom shares climbed on the news.

AI· Jul 27, 2026

Jensen Huang: Chips Must Grow 10x for AI Agents

Illustration for: Jensen Huang: Chips Must Grow 10x for AI Agents
AI

Jensen Huang: Chips Must Grow 10x for AI Agents

Nvidia CEO Jensen Huang told Bloomberg the semiconductor industry must grow roughly tenfold over the next decade to serve computing dominated by autonomous AI agents.

@Trace_Cohen·t@nyvp.com