Position: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces! 事件

Position: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces! arXiv:2504.09762v4 Announce Type: replace Abstract: Intermediate token generation (ITG), where a model produces output before the solution, has become a standard method to improve the performance of language models on reasoning tasks. These intermediate tokens have been called \say{reasoning traces} or even \say{thinking traces} -- implicitly anthropomorphizing the traces, and implying that these traces resemble