A Minimal Bifurcation Model of Load Imbalance in a Softmax Mixture-of-Experts Router 事件

PRODUCT_LAUNCH2026-05-29影响: MEDIUM

A Minimal Bifurcation Model of Load Imbalance in a Softmax Mixture-of-Experts Router arXiv:2605.29121v1 Announce Type: cross Abstract: We propose a minimal dynamical model of adaptive softmax routing for a two-expert Mixture-of-Experts (MoE) layer. The model is obtained as a mean-field limit of a discrete reinforcement rule: the selected expert receives a small score increment, while all scores undergo regularizing decay. In the symmetric case the limiting system has a supercritical pitchfork b

A Minimal Bifurcation Model of Load Imbalance in a Softmax Mixture-of-Experts Router · 相关公司

I
ISCCOMPANY
A
arXivNONPROFIT
C
CATIRESEARCH_INSTITUTE
C
CATASCOMPANY
C
ConnectNONPROFIT
A
ACTNONPROFIT
P
pytorchCOMPANY