Asynchronous Flow Map Language Models

The order in which tokens are predicted in language modeling has a profound impact on the quality of generated sequences. Autoregressive and masked diffusion models iteratively fill in tokens and can exploit such orderings across generation steps, but how to leverage an ordering for one-step parallel language modeling is unclear. We introduce asynchronous flow map language models (aFMLMs), which incorporate prediction order into one-step modeling by learning the flow maps of asynchronous flows. These flows specify an ordering through a tokenwise time schedule that controls the relative denoising progress of tokens. We formulate a general class of asynchronous flows that admit both prescribed and learned, state-adaptive schedules, show that they define valid flow maps, and develop new methods for their flow map distillation. The resulting models can generate all tokens in a single forward pass by internalizing the ordering encoded in the flow into their hidden computations. On Sudoku solving and code generation for GSM8K math word problems, aFMLM establishes new state-of-the-art one-step performance.

• Training code: diffusion-forcing teacher and aFMLM distillation (TinyGSM, Sudoku)
• Evaluation code: GSM8K and Sudoku
• Pretrained checkpoints: teachers and aFMLM students

@article{lee2026asynchronous,
    title={Asynchronous Flow Map Language Models},
    author={Chanhyuk Lee and Wonjung Kim and Patrick Pynadath
            and Jaehoon Yoo and Satoshi Hayakawa and Ruqi Zhang
            and Jinwoo Kim and Seunghoon Hong},
    journal={arXiv preprint arXiv:2610.42018},
    year={2026},
}