LURE: Live-Usage Replay Evaluations for Reducing Evaluation Awareness 事件

LURE: Live-Usage Replay Evaluations for Reducing Evaluation Awareness arXiv:2605.26438v1 Announce Type: new Abstract: Large language models can recognize when they are being evaluated (evaluation awareness) and behave differently because of that, which undermines the validity of safety and alignment benchmarks. We propose LURE (Live-Usage Replay Evaluations), a method for constructing deployment-like evaluations by replaying realistic agentic interaction trajectories and appending evaluation pr