Unlocking Feature Learning in Gated Delta Networks at Scale 文章

ArXiv CS.AI2026-06-04NEWSen作者: Yifeng Liu, Quanquan Gu
查看原文 →
关系图谱

Unlocking Feature Learning in Gated Delta Networks at Scale · 相关技术

相关技术

standard parametrizationSGDAdamGated Delta NetworktransformersMaximal Update Parametrization