What Makes a Strong Model? A Unified Spectral Analysis of Knowledge Transfer over High-dimensional Linear Regression 文章

ArXiv CS.AI2026-06-02NEWSen作者: Wendao Wu, Fangqing Zhang, Haihan Zhang, Cong Fang

查看原文 →

What Makes a Strong Model? A Unified Spectral Analysis of Knowledge Transfer over High-dimensional Linear Regression · 相关技术

相关技术

SGD dynamics stochastic gradient descent weak-to-strong generalization Spectral Denoising Spectral Horizon Expansion high-dimensional linear regression SGD Weak-to-Strong Knowledge Distillation Teacher-Student Knowledge Transfer