Small Experiments, Cheaper Decisions: A Case Study in Staged Promotion for Micro-Pretraining 事件

Small Experiments, Cheaper Decisions: A Case Study in Staged Promotion for Micro-Pretraining arXiv:2606.11387v1 Announce Type: new Abstract: Short pretraining runs can reduce experimental cost, but they can also over-promote configurations that only look strong at tiny budgets. We study an auditable staged-promotion protocol for a fixed micro-pretraining runner on two heterogeneous host blocks: Windows A100 and Linux L40S. Starting from twelve prior-screened configurations, we use staged budget