Inspiration
I was redecorating and realized it would be helpful to have an AI assistant and simple tools to visualize ideas before making changes.
What it does
Helps users decorate their rooms. They can ask questions and get custom advice from an AI assistant that can see images of their room. Users can also try different types of furniture, art, and layouts to experiment with new styles. By moving their thumbs forward and backward, users can adjust the scale of the last object they grabbed. Users can also use a thumb tap gesture to change furniture objects. Pinch gestures allow users to generate filler shapes or measure.
How we built it
Built with Unity using Meta Building Blocks. The app relies on passthrough, hand tracking, and spatial UI. AI functionality integrates with OpenAI to provide real-time guidance and design suggestions.
Challenges we ran into
The app required many distinct functionalities to be controlled by hands. We had to implement multiple UI elements, robust selection mechanisms, and interaction logic that works smoothly in passthrough while maintaining usability for younger users and hobbyists.
Accomplishments that we’re proud of
Created a working prototype that combines passthrough camera access, AI-powered assistance, and intuitive hand interactions into a cohesive design experience.
What we learned
Gained experience integrating AI with passthrough, handling spatial interactions, and refining hand-tracking UX for interior design tools.
What’s next for Room Remix
Please try the app, leave a review, and join our Discord to help guide future updates and features.
Join Discord: https://discord.gg/caCr6Fyu
Log in or sign up for Devpost to join the conversation.