ResMerge: Residual-based Spectral Merging of Large Language Models 事件

ResMerge: Residual-based Spectral Merging of Large Language Models arXiv:2606.02252v1 Announce Type: new Abstract: Model merging offers a training-free way to combine multiple post-trained expert models, but merging experts obtained through reinforcement learning (RL) remains challenging. Existing spectral merging methods often assume that leading singular directions contain the main task signal, while lower-energy residual components can be compressed, selected, or attenuated to reduce interfe