E = T*H/(O+B): A Dimensionless Control Parameter for Mixture-of-Experts Ecology

The real contribution here isn't just a diagnostic metric but a claim that the metric is sufficient: if E >= 0.5, you can drop auxiliary load-balancing loss terms entirely, which are currently a standard and fiddly part of MoE training recipes. That's a meaningful simplification, but the validation set of 12 experiments across relatively modest benchmarks like CIFAR-10 and WikiText-2 leaves open whether this threshold holds at the parameter counts actually used in production MoE deployments.

This connects directly to the MIT superposition work covered here on May 3rd, which argued that scaling laws have a mechanistic basis rather than being purely empirical. That paper moved scaling from observation to explanation; this formula attempts something analogous for MoE load balancing, replacing tuned heuristics with a derived invariant. Both papers share the same intellectual ambition: finding principled structure beneath what practitioners currently treat as knobs to turn. The difference is that the MIT work was validated against the full scaling regime, while this result still needs stress-testing at frontier model scales.

Watch whether any of the major MoE-based model teams, Mistral being the most publicly transparent given their Medium 3.5 work, report reproducing the E >= 0.5 threshold at billions of parameters. If the threshold drifts or requires recalibration at scale, the formula becomes a diagnostic heuristic rather than a design rule.