The Geometry of LLM-as-Judge: Why Inter-LLM Consensus Is Not Human Alignment 事件

The Geometry of LLM-as-Judge: Why Inter-LLM Consensus Is Not Human Alignment arXiv:2606.03043v1 Announce Type: new Abstract: LMs-as-judges are now standard, yet judges agree strongly with one another while agreeing only weakly with humans. We test whether this reflects shared signal or shared bias by measuring four geometric quantities on the standard LLM-as-judge stack across four community-built Indic datasets, eight Indic languages, and 41 LLM judges: score spread, effective rank, principal