Quantifying and Mitigating Self-Preference Bias of LLM Judges 事件

Quantifying and Mitigating Self-Preference Bias of LLM Judges arXiv:2604.22891v4 Announce Type: replace-cross Abstract: LLM-as-a-Judge has become a dominant approach in automated evaluation systems, playing critical roles in model alignment, leaderboard construction, quality control, and so on. However, the scalability and trustworthiness of this approach can be substantially distorted by Self-Preference Bias (SPB), which is a directional evaluative deviation in which LLMs systematically favor