Pinned
🚀 New paper alert: On-Policy Self-Distillation without Any Supervision !!
🧠 Can a model truly on-policy “self-distill"?
On-policy self-distillation removes the need for a stronger teacher, but still relies on an external ground-truth solution to make the self-teacher more



