Pinned
RL feels messy, but a two-axis view—data source (on/off/offline) × update schedule (one-step/multi-step/iterative)—brings order. I wrote a post unifying them with shared equations.
lei-kun.github.io/blogs/rl.html
Robotic FMs (e.g., GEN-0, pi_0.5) grow via a data flywheel. Best fit:




