The Topological Trouble With Transformers 事件

The Topological Trouble With Transformers arXiv:2604.17121v3 Announce Type: replace-cross Abstract: Transformers encode structure in sequences via an expanding contextual history. However, their purely feedforward architecture fundamentally limits dynamic state tracking. State tracking -- the iterative updating of latent variables reflecting an evolving environment -- involves inherently sequential dependencies that feedforward networks struggle to maintain. Consequently, feedforward models pus