Mixing Mechanisms: How Language Models Retrieve Bound Entities In-Context 事件

Mixing Mechanisms: How Language Models Retrieve Bound Entities In-Context arXiv:2510.06182v2 Announce Type: replace Abstract: A key component of in-context reasoning is the ability of language models (LMs) to bind entities for later retrieval. For example, an LM might represent "Ann loves pie" by binding "Ann" to "pie", allowing it to later retrieve "Ann" when asked "Who loves pie?" Prior research on short lists of bound entities found strong evidence that LMs implement such retrieval via a pos