Skill-Conditioned Gated Self-Distillation for LLM Reasoning 事件

Skill-Conditioned Gated Self-Distillation for LLM Reasoning arXiv:2605.28791v1 Announce Type: new Abstract: On-policy self-distillation (SD) improves LLM reasoning by using teacher-side privileged information (PI) to turn sparse verifier outcomes into dense token-level supervision. Existing methods usually assume trusted PI, such as reference answers or successful traces. We ask whether PI can instead come from an experience-derived skill bank, where retrieved skills are compact and reusable bu