Behavior-Aware Auxiliary Corrections for Off-Policy Temporal-Difference Prediction 事件

Behavior-Aware Auxiliary Corrections for Off-Policy Temporal-Difference Prediction arXiv:2605.28855v1 Announce Type: new Abstract: Temporal-difference learning with function approximation can be unstable under off-policy sampling. TDC stabilizes off-policy TD through an auxiliary covariance correction, and TDRC further regularizes this correction in a single-timescale recursion. This paper studies a behavior-aware replacement of the auxiliary covariance geometry in the linear prediction setting