Activation Steering for Synthetic Data Generation: The Role of Diversity in Downstream Safety Detection 事件

Activation Steering for Synthetic Data Generation: The Role of Diversity in Downstream Safety Detection arXiv:2605.28664v1 Announce Type: cross Abstract: Safety detection models require examples of HHH (Helpful, Harmless, Honest)-violating outputs for robust generalization, however such examples are scarce. Activation Steering (AS) has emerged as a data-efficient method for generating target-concept-aligned responses. We investigate whether AS can generate high-quality training datasets for dow