The Shape of Wisdom: Decision Trajectories in Language Models 事件

The Shape of Wisdom: Decision Trajectories in Language Models arXiv:2606.01202v1 Announce Type: cross Abstract: Language models do not simply choose an answer at the output layer. In a 9,000-trajectory MMLU study across Qwen2.5-7B-Instruct, Llama-3.1-8B-Instruct, and Mistral-7B-Instruct-v0.3, the score of the answer moves across depth in structured ways. We describe each trajectory with three quantities: the current answer margin, the next-layer change in that margin, and the distance from a de