The Information Geometry of Softmax: Probing and Steering 事件

The Information Geometry of Softmax: Probing and Steering arXiv:2602.15293v2 Announce Type: replace-cross Abstract: This paper concerns the question of how AI systems encode semantic structure into the geometric structure of their representation spaces. The motivating observation is that the natural geometry of these representation spaces should reflect the way models use representations to produce behavior. We focus on the important special case of representations that define softmax distribut