Pinned
VibeAct lets your dexterous robot hand "hear" and react to contact events!
With real-world acoustic data and digital-clone labeling, VibeAct learns a physics-grounded tactile representation that bridges sensing and simulation, enabling reactive policies trained in sim to
How can we get robot hands to “hear” slip and contact through microphones, and react to them?
We’re excited to share VibeAct, an approach that uses piezoelectric microphones embedded in robot fingertips to estimate contact and slip, then learns reactive policies from this
00:00
