Symmetry Reveals Layerwise Dynamics: How Transformers Perform In-Context Classification 事件

Symmetry Reveals Layerwise Dynamics: How Transformers Perform In-Context Classification arXiv:2604.11613v3 Announce Type: replace-cross Abstract: Transformers can perform in-context classification from a few labeled examples, yet the inference-time algorithm remains opaque. We study multi-class linear classification in the hard no-margin regime and make the computation identifiable by enforcing feature- and label-permutation equivariance at every layer. This enables interpretability while maint