Neuron Populations Exhibit Divergent Selectivity with Scale 事件

Neuron Populations Exhibit Divergent Selectivity with Scale arXiv:2606.03990v1 Announce Type: cross Abstract: We investigate whether neuron populations within neural networks evolve predictably with scale, extending scaling laws beyond macroscopic observables such as loss. To probe this question, we study Rosetta Neurons, a previously characterized class of neurons whose activation patterns are similar across independently trained models (Dravid et al., 2023). In separate analyses of language m