AgentSTAR is an agentic method for both reconstruction and tracking of articulated objects from monocular videos.
We can now track through rapid motion, severe occlusion and thin objects!
There’s no spoon but we can still track it 🥄
Wrote done my thoughts on what's fundamentally new for vision when using agents --- obviously, apart from some hard problems that have now been nearly solved :)
Introducing 4D Primitive-Mâché (4DPM), a new method for replayable 4D reconstruction from monocular videos.
We split dynamic scenes into 3D primitives and recover their motion. 4DPM can infer object positions even after they leave view.
Joint work with @marwan_ptr@AjdDavison