A Geometric Characterization of the Stationary Plateau for Two-Layer Neural Networks 事件

A Geometric Characterization of the Stationary Plateau for Two-Layer Neural Networks arXiv:2606.04327v1 Announce Type: cross Abstract: We investigate the geometric structure of stationary plateaus that arise in the loss landscape of two-layer neural networks with smooth activation functions. We focus on the phenomenon of "neuron splitting" where duplicating a hidden neuron yields an affine set of stationary points in a wider network. We provide a comprehensive classification of all stationary p