Pinned
Language modeling is ambiguous. If you ask someone to caption an image, describe an audio clip, or to translate a sentence, you’ll get several valid outputs.
In this work, we handle this with a winner-takes-all training objective that encourages diverse, plausible predictions.
Replying to @valeoai
1/ Multiple Choice Learning of Low-Rank Adapters for Language Modeling
TL;DR: LoRA heads + Winner-Takes-All loss → diverse, plausible LLM outputs
📄 arxiv.org/abs/2507.10419
💻 github.com/Victorletzelte…
@VLetzelter, H. Malard, M. Fontaine, G. Richard, S. Essid, @abursuc, @ptrkprz
