Are we really tilting? The mechanics of reward guidance in flow and diffusion models 事件

Are we really tilting? The mechanics of reward guidance in flow and diffusion models arXiv:2606.02884v1 Announce Type: cross Abstract: Reward guidance algorithms steer a learned generative process toward the reward-tilted measure at inference time. While empirically powerful, these methods are prone to reward hacking: the guided model over-optimizes the reward at the cost of fidelity to the learned distribution. Prior work has attributed this to the complexity of neural reward functions or impl