Drawing Inspiration: A Mixed Reality Approach to Artistic Visualization for Home Decor
About the Project
Inspired by the challenge of visualizing art in personal spaces before making a purchase, Drawing Inspiration seeks to bridge the gap between imagination and reality. This project harnesses mixed reality and generative AI to transform simple sketches into stunning, room-scale art previews within a user's environment. Our journey through this development was fueled by a passion for art, technology, and the desire to enhance the home decor experience.
Inspiration
The idea was sparked by a common predicament: many people struggle to visualize how art would look in their space before they commit to a purchase. We wanted to empower users to not only see but also influence the art that fills their living spaces making the process interactive and personalized through mixed reality.
What We Learned
Throughout this project, we learned to integrate various technologies including Meta Quest's innovative tools like Scene, Passthrough, and Interaction SDKs, along with Unity and WebXR for frontend development. On the backend, we leveraged AWS services, employing the Elastic Container Registry (ECR) and Elastic Container Service (ECS) to manage our application deployments seamlessly, providing an agnostic front end between WebEX and Unity supported by a robust AWS back-end.
How We Built It
Our solution architecture involves:
- Frontend: Created immersive experiences using Unity for standalone applications and WebXR for browser-based interactions.
- Backend: Utilized AWS's robust cloud infrastructure to handle data processing and storage, ensuring scalable and responsive user interactions.
- AI Integration: Implemented generative AI through AWS Bedrock and Stable Diffusion models to convert textual descriptions into vivid artistic images sending to the user the final result generated as outcome.
Challenges We Faced
One of the major challenges was ensuring seamless integration between the mixed reality frontend and the AI-powered backend. Achieving real-time performance with high-quality AI-generated images required optimizing our cloud functions and managing efficient data flow across systems.
Solution
We empower users to design their wall art in a fun, confidence-building way. Our app allows users to sketch their ideas in mixed reality, which are then AI-transformed into high-quality visualizations displayed within virtual Amazon product frames.
Impact
- Entertaining Spatial AI Image Experience: Users enjoy an engaging and interactive design process.
- Personalized Wall Art: Artworks are tailored based on individual sketches, enhancing personal connection to the space.
- Generative AI Assisted Point of Sale: Paves the way for future e-commerce integrations where users can purchase the visualized art directly.
Future Directions
Looking ahead, we plan to integrate direct purchasing options and expand our AI models to include diverse artistic styles and cultural art forms, making Drawing Inspiration a comprehensive tool for interior design and artistic expression.
Conclusion
Drawing Inspiration redefines the way we interact with and purchase art for our homes. By merging cutting-edge MR and AI technologies, we provide a novel solution that not only delights but also adds functional value to everyday decisions in home decor.
Built With
- amazon-web-services
- bedrock
- c#
- interactionsdk
- javascript
- json
- passthrough
- unity
- webxr
- wit.ai


Log in or sign up for Devpost to join the conversation.