Low-Rank Decay for Grokking in Scale-Invariant Transformers: A Spectral-Geometric View 文章

Low-Rank Decay for Grokking in Scale-Invariant Transformers: A Spectral-Geometric View · 相关技术