Beyond Ideal Instruction: A Comprehensive Framework for Evaluating LLMs in Realistic Interactions 事件

Beyond Ideal Instruction: A Comprehensive Framework for Evaluating LLMs in Realistic Interactions arXiv:2606.03318v1 Announce Type: new Abstract: Despite great advances in tool-use capabilities of large language models (LLMs), existing evaluation benchmarks struggle to fully align with real-world scenarios. Such benchmarks mostly rely on simulated idealized user assumptions and lacks experience-oriented evaluation. These limitations fail to account for the ambiguity, uncooperative behaviors, an