SCOPE: Selective Conformal Optimized Pairwise LLM Judging 事件

SCOPE: Selective Conformal Optimized Pairwise LLM Judging arXiv:2602.13110v3 Announce Type: replace Abstract: Large language models (LLMs) are increasingly used as scalable judges in pairwise evaluation, but they remain prone to miscalibration and biases. We propose SCOPE (Selective Conformal Optimized Pairwise Evaluation), a framework that calibrates an acceptance threshold so that, under exchangeability, the error rate among non-abstained judgments is at most a user-specified level $\alpha$.