
MAESTRO prunes MoE models by modeling expert routing as Markov chains
Mixture-of-Experts models promise inference speed by activating only a subset of parameters per token, but deploying them remains costly because the full expert bank must stay in memory. Researchers propose MAESTRO, a pruning method that models expert activation patterns as Markov chains to capture cross-layer dependencies, enabling structured removal of redundant experts. This addresses a real deployment bottleneck for sparse models and signals growing focus on making efficient architectures actually deployable at scale, not just theoretically faster.62
























