A Minimal Bifurcation Model of Load Imbalance in a Softmax Mixture-of-Experts Router 事件

PRODUCT_LAUNCH2026-05-29影响: MEDIUM

A Minimal Bifurcation Model of Load Imbalance in a Softmax Mixture-of-Experts Router arXiv:2605.29121v1 Announce Type: cross Abstract: We propose a minimal dynamical model of adaptive softmax routing for a two-expert Mixture-of-Experts (MoE) layer. The model is obtained as a mean-field limit of a discrete reinforcement rule: the selected expert receives a small score increment, while all scores undergo regularizing decay. In the symmetric case the limiting system has a supercritical pitchfork b

A Minimal Bifurcation Model of Load Imbalance in a Softmax Mixture-of-Experts Router · 相关报道