ModAR: Modality-Autoregressive World-Action Models
Adam Hung,
Bardienus P. Duisterhof,
Deva Ramanan,
Jeffrey Ichnowski
arXiv, 2026
[Website]
[Paper]
ModAR is a World Action Model (WAM) that predicts multiple future modalities one at a time—point tracks, DINO features, then depth—before generating actions.
We conduct a systematic study training multimodal WAMs from scratch and find that ModAR outperforms existing WAM formulations across data scales.
Our 30.1M scratch-trained model even outperforms a 6B video-model-initialized model finetuned on the same data!