Confidence and Calibration of Activation Oracles for Reliable Interpretation of Language Model Internals 事件

Confidence and Calibration of Activation Oracles for Reliable Interpretation of Language Model Internals arXiv:2605.26045v1 Announce Type: new Abstract: Activation oracles aim to make the activations of other models legible to humans and yield promising results compared to white-box interpretability techniques. However, uncertainty quantification (UQ) for the natural-language outputs of such activation oracles is so far understudied. Here, we investigate 6 different methods for estimating the c