AblationBench: Evaluating Automated Planning of Ablations in Empirical AI Research 事件

AblationBench: Evaluating Automated Planning of Ablations in Empirical AI Research arXiv:2507.08038v3 Announce Type: replace Abstract: Language model agents are increasingly used to automate scientific research, yet evaluating their scientific contributions remains a challenge. A key mechanism to obtain such insights is through ablation experiments. To this end, we introduce AblationBench, a benchmark suite for evaluating agents on ablation planning tasks in empirical AI research. It includes t