Spectral Collapse Drives Loss of Plasticity in Deep Continual Learning 事件

Spectral Collapse Drives Loss of Plasticity in Deep Continual Learning arXiv:2509.22335v3 Announce Type: replace-cross Abstract: We investigate why deep neural networks suffer from loss of plasticity in continual learning, and thus fail to learn new tasks without reinitializing parameters. We show that this failure is preceded by Hessian spectral collapse at new-task initialization, where meaningful curvature directions vanish and gradient descent becomes ineffective. Analyzing a linearized ReL