LoRA-DA: Data-Aware Initialization for Low-Rank Adaptation via Asymptotic Analysis 事件

LoRA-DA: Data-Aware Initialization for Low-Rank Adaptation via Asymptotic Analysis arXiv:2510.24561v3 Announce Type: replace-cross Abstract: LoRA has become a widely adopted method for PEFT, and its initialization methods have attracted increasing attention. However, existing methods have notable limitations: many methods do not incorporate target-domain data, while gradient-based methods exploit data only at a shallow level by relying on one-step gradient decomposition. In this paper, we estab