Stability vs. Manipulability: Evaluating Robustness Under Post-Decision Interaction in LLM Judges 事件

Stability vs. Manipulability: Evaluating Robustness Under Post-Decision Interaction in LLM Judges arXiv:2606.05384v1 Announce Type: cross Abstract: LLM-as-judge evaluation is widely used in benchmarking pipelines, where model outputs are compared and ranked using automated evaluators. These pipelines typically assume that judgments are stable properties of fixed inputs. We show that this assumption does not hold under interaction. We study post-decision manipulability: the extent to which an ev