E = T*H/(O+B): A Dimensionless Control Parameter for Mixture-of-Experts Ecology 事件
PRODUCT_LAUNCH2026-05-26影响: MEDIUM
E = T*H/(O+B): A Dimensionless Control Parameter for Mixture-of-Experts Ecology arXiv:2605.06415v2 Announce Type: replace-cross Abstract: We introduce E = T*H/(O+B), a dimensionless control parameter that predicts whether Mixture-of-Experts (MoE) models will develop a healthy expert ecology or collapse into dead experts. E combines four hyperparameters -- routing temperature T, routing entropy weight H, oracle weight O, and balance weight B -- into a single quantity. Through 12 controlled exper
E = T*H/(O+B): A Dimensionless Control Parameter for Mixture-of-Experts Ecology · 相关报道
相关报道
E = T*H/(O+B): A Dimensionless Control Parameter for Mixture-of-Experts Ecology
ArXiv CS.CV2026-05-26