Learning What to Forget: Improving LLM Unlearning via Learned Token-Level Importance 事件

Learning What to Forget: Improving LLM Unlearning via Learned Token-Level Importance arXiv:2606.06320v1 Announce Type: cross Abstract: Machine unlearning aims to remove targeted knowledge from a trained model while preserving its general capabilities. For autoregressive language models, not all tokens in a forget sample are equally relevant to forgetting. Existing approaches either ignore this heterogeneity or rely on auxiliary models, heuristics, or external annotations to estimate each token'