Pinned
Can we train language models to propose better ideas to improve LM—not just run them?
Introducing 𝐋𝐌𝟐𝐋𝐌: Language Models Learn to Improve Language Models. We train a 27B model with RL to propose improvements to language models. On held-out autoregressive and diffusion LM


