Towards Evaluation Engineering: An Empirical Study of ML Evaluation Harnesses in the Wild 事件

Towards Evaluation Engineering: An Empirical Study of ML Evaluation Harnesses in the Wild arXiv:2605.24213v1 Announce Type: cross Abstract: Evaluation harnesses are software systems that orchestrate model evaluation by managing model invocation, data loading, metric computation, and result reporting. Despite their critical role in machine learning infrastructure, their operational challenges and engineering concerns have received limited attention so far. We present an empirical study of 57 eva