PointZero: 3D Point Track Completion for Dynamics and Robot Manipulation
Bardienus P. Duisterhof,
Kaifeng Zhang,
Adam Hung,
Bowen Wen,
Stan Birchfield,
Yunzhu Li,
Deva Ramanan,
Jeffrey Ichnowski
Under Review
PointZero proposes 3D point track completion as a pretraining objective:
given an RGB-D image and a few sparse point trajectories, it predicts future dense 3D motion.
Pretrained on our custom synthetic dataset, PointZero learns transferable 3D dynamics priors that
improve real-world action-conditioned dynamics prediction and robot manipulation after fine-tuning.