Tencent's Hy3 achieves frontier performance with sparse activation at 21B active parameters
Tencent's Hy3 demonstrates that mixture-of-experts scaling can deliver outsized efficiency gains in the open-source space. With only 21B active parameters from a 295B total pool, the model reportedly matches competitors 2-5x larger while halving hallucination rates to 5.4 percent. This challenges the assumption that scale alone drives capability, signaling that architectural innovation around sparse activation remains a viable path for cost-conscious deployments and open-weight alternatives to frontier labs.
Modelwire context
Skeptical readThe 5.4% hallucination rate figure is doing a lot of work here, but Tencent has not disclosed which hallucination benchmark or evaluation protocol produced it, making direct comparison to competitors essentially impossible at this stage. The '2-5x larger' range is also suspiciously wide for a headline claim.
Mixture-of-experts efficiency arguments are not new to this news cycle. The broader pattern worth tracking is whether open-weight MoE releases are actually closing the gap on closed frontier models or whether benchmark selection is doing the heavy lifting. This story sits closer to the architectural research space than to the competitive dynamics covered in recent Modelwire pieces, though the open-weight angle does connect loosely to the Hugging Face and Cerebras collaboration on Gemma 4 from July 1, where open models were shown viable for latency-sensitive production use. If Hy3's efficiency claims hold, it strengthens that case. If they don't replicate, it reinforces skepticism about vendor-run evals on self-reported metrics.
Watch whether an independent group reproduces the hallucination rate on a named public benchmark (TruthfulQA, HaluEval, or similar) within the next 60 days. If the number degrades significantly under a standardized protocol, the efficiency story weakens considerably.
Coverage we drew on
This analysis is generated by Modelwire’s editorial layer from our archive and the summary above. It is not a substitute for the original reporting. How we write it.
MentionsTencent · Hy3 · mixture-of-experts
Modelwire Editorial
This synthesis and analysis was prepared by the Modelwire editorial team. We use advanced language models to read, ground, and connect the day’s most significant AI developments, providing original strategic context that helps practitioners and leaders stay ahead of the frontier.
Modelwire summarizes, we don’t republish. The Decoder originally reported this story as “Tencent releases Hy3 open-source model that allegedly matches models up to five times its active size”. The full content lives on the-decoder.com. If you’re a publisher and want a different summarization policy for your work, see our takedown page.