What Benchmarks Don't Measure: The Case for Evaluating Abstention Competence in Autonomous Agents 事件

REGULATION2026-06-03影响: MEDIUM

What Benchmarks Don't Measure: The Case for Evaluating Abstention Competence in Autonomous Agents arXiv:2606.02965v1 Announce Type: new Abstract: Benchmarks for autonomous agents measure whether agents complete tasks, yet this framing is systematically blind to whether an agent should have proceeded at all. Agents trained under human-feedback objectives develop a structural tendency to proceed even when they lack the inputs, evidence, or authorization to act safely, a disposition we term compli