On-policy distillation (OPD) is one of the most effective LLM post-training methods, but it traditionally requires a costly live teacher server throughout training.
In our latest work, Lightning OPD, we show that OPD can be performed fully offline by precomputing teacher
