Benchmarking LLM-as-a-Judge for Long-Form Output Evaluation 事件

Benchmarking LLM-as-a-Judge for Long-Form Output Evaluation arXiv:2606.01629v1 Announce Type: new Abstract: As large language models (LLMs) are increasingly used for long-form generation, reliably evaluating long-form outputs has become a critical challenge. LLM-as-a-judge offers a scalable alternative to human evaluation, yet its reliability in long-form output evaluation remains underexamined: existing meta-evaluation benchmarks focus mainly on short-form outputs. Compared with short-form eva