Context-Free Recognition with Transformers 事件

Context-Free Recognition with Transformers arXiv:2601.01754v3 Announce Type: replace-cross Abstract: Transformers excel empirically on tasks that process well-formed inputs according to some grammar, such as natural language and code. However, it remains unclear how they can process grammatical syntax. In fact, under standard complexity conjectures, standard transformers cannot recognize context-free languages (CFLs), a canonical formalism to describe syntax, or even regular languages, a subcla