Congrats to the Omni team! 🥯🎉
Camera pose estimation? Just AR text gen 🤯
<campose>1.04 0.00 0.32 -0.20 -0.27 -0.02</campose>
6DoF floats as a string 🪢 no pose head, no bins, no 3D priors. On RealEstate10K: AUC@30 88.32 vs VGGT 88.23 on par with a geometry specialist!
Introducing Omni, one unified model can support any-to-any multimodal modeling, including multimodal understanding, image/video generation and editing, world modeling and 3D reconstruction. All in one that adopts standard mixture-of-experts arch with only 3B activations.
