Confidence-Adaptive SwiGLU for Mixture-of-Experts 文章

ArXiv CS.CL2026-06-02NEWSen作者: Shaohua Li, Xiuchao Sui, Xiaobing Sun, Yuhang Wu, Liangli Zhen, Yong Liu, Rick Siow Mong Goh
查看原文 →
关系图谱

Confidence-Adaptive SwiGLU for Mixture-of-Experts · 相关技术

相关技术

Mixture-of-ExpertsConfidence-Aware SwiGLUMLPSiLUMoEtransformersSwiGLU