MARS: Margin and Semantic-Aware Data Augmentation for Reward Modeling 事件

MARS: Margin and Semantic-Aware Data Augmentation for Reward Modeling arXiv:2602.17658v2 Announce Type: replace-cross Abstract: Reward modeling is central to alignment pipelines such as RLHF, RLAIF, and PPO-based policy optimization, yet its reliability is constrained by limited and heterogeneous human preference data that are expensive to collect at scale. While synthetic augmentation can expand preference supervision, existing methods often augment uniformly or at the representation level, wi