Analysis
PrismML raised a $22.25 million seed round backed by Khosla Ventures, Cerberus Capital and Caltech, and released Bonsai 2 27B, its latest compressed reasoning model, Techmeme and the Wall Street Journal reported, with additional detail from TechCrunch.
How The Compression Actually Works
PrismML's technical approach, called "ternary" weighting, simplifies the standard 16-bit weights used in most large language models down to just three possible values: +1, -1 or 0. That dramatic simplification shrinks model size substantially while -- according to PrismML's own benchmarks -- preserving most of the underlying model's capability. Bonsai 2 compresses Qwen3.8 27B, a 27-billion-parameter open model, down to 5.9GB, and matches 98% of Qwen's aggregate benchmark scores in that compressed form.
“Bonsai 2 compresses Qwen3.8 27B, a 27-billion-parameter open model, down to 5.9GB, and matches 98% of Qwen's aggregate benchmark scores in that compressed form.”
Why On-Device Matters
Running a model locally rather than through a cloud API changes the economics and privacy profile of AI applications meaningfully: no per-token API cost, no round-trip latency to a remote server, and no user data leaving the device by default. PrismML's pitch -- that capable reasoning models don't have to be large -- directly targets use cases where those three factors matter more than having access to the absolute largest frontier model. This is a different competitive lane than Google DeepMind's newly launched AGI Institute or the trillion-dollar valuations attached to OpenAI and Anthropic -- PrismML isn't competing on raw frontier capability, it's competing on deployability.
Adoption Numbers Worth Taking Seriously
The original Bonsai model has been downloaded more than 11 million times, with smaller variants adding another 2.6 million downloads -- a genuinely large adoption number for a young, infrastructure-focused startup, and a signal that developers are actively choosing PrismML's compressed models over full-size alternatives for real deployments rather than just academic curiosity. That kind of organic pull is harder to manufacture than benchmark scores alone.
Does Ternary Survive Frontier Scale?
The open question is whether ternary-weight compression holds up as models scale further -- Bonsai 2's 98% benchmark retention is measured against a 27-billion-parameter base model, and it's not yet demonstrated whether the same compression ratio and performance retention holds at 70 billion, 100 billion or larger parameter counts, where most of the frontier-capability gap with proprietary labs actually lives. If ternary compression degrades faster at larger scales, PrismML's technique may end up a durable niche for smaller, on-device models rather than a genuine alternative to frontier-scale reasoning.