EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions 事件

PRODUCT_LAUNCH2026-05-26影响: MEDIUM

EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions arXiv:2605.24110v1 Announce Type: new Abstract: Coding agents are increasingly used as iterative development partners, but most benchmarks still evaluate one specification followed by one final assessment. This leaves out a basic question: can an agent keep its own codebase working as requirements change? We introduce EvoCode-Bench, a benchmark of 26 stateful coding tasks and 227 evaluated rounds. Each task preserves t