Inspiration
We wanted to recreate Pinterest but in the 3D realm of XR, where you can showcase your own custom room and display it for others.
What it does
Users can use text to speech to say a piece of furniture they want. They will then get a list of pictures that they can choose from, allowing the images to be turned into 3f models the player can use to decorate their room.
How we built it
Using S3 and DynamoDB, we were able to store vital information with dynamodb pointers. Utilizing different models and Flask in the backend. Unity was used for the frontend to experiment different UI in the meta quest
Challenges we ran into
A lot of us were working with new technologies so we often had to pivot and rely on each other for assistance. Additionally, the Meta Quest 3 would often fail to connect and even stop working with Hand Tracking entirely.
Accomplishments that we're proud of
We were able to accurately convert 2d images of furniture, such as couches or chairs, and turn them into 3d models. For the XR side, we were able to web scrape using API so that the user could directly upload pictures from the Meta Quest.
What we learned
We learned about the difficulties of integrating a backend into a XR Unity frontend, and that hardware can and will often glitch out at times.
What's next for VisualRoom
We wanted to flesh out the sharing side, allowing users to share their entire rooms and pieces of furniture they have through the software.
Built With
- amazon-dynamodb
- c#
- claude
- flask
- langchain
- python
- reka
- s3
- unity
Log in or sign up for Devpost to join the conversation.