Online Agent-as-a-Judge: Situation-Generating Evaluation for Interactive Agents 事件

Online Agent-as-a-Judge: Situation-Generating Evaluation for Interactive Agents arXiv:2606.08200v1 Announce Type: new Abstract: Evaluating LLM-powered interactive social agents is challenging because socially relevant behaviors depend not only on isolated outputs, but also on prior interactions, social roles, and downstream actions. Existing methods typically allow a target agent to act freely in an environment and then score the resulting trajectory. However, this passive setup can miss capabi