Gem-dazzle | Devpost

generated

Inspiration

A big problem we noticed about moving into college is making it feel like home. One of us burned out their first semester of college because it felt like they never had a break because they went back to a dorm that didn’t feel like home every day.

Humans need decorations in spaces to make it feel personal but many also struggle with interior design. We noticed that we can use AI to draw up sample inspiration pictures that utilize our specific room.

What it does

Our application takes in a photo of your room and a reference image from Google Images that reflects your desired interior style. It then reimagines your original space using Google Gemini AI to match the vibe—furnishings, colors, textures, and all—giving you a visually styled version of your own space.

Gem-dazzle not only provides a preview of what your room will look like but also a rough 3D interactive model showcasing the new room.

How we built it

We used Google Gemini 2.0 Flash (Image Generation)’s multimodal capabilities to understand the input room photo along with a description of an reference image selected by the user. With prompt engineering and image-to-image generation, we guide Gemini to output a realistic restyling of the original room that mimics the chosen aesthetic. Users ultimately access this model on the web for easy uploads and side-by-side comparisons.

Challenges we ran into

Google Gemini wasn't fully aware of where it was placing items in the picture. We had to write our own algorithms to find where Gemini was placing the new items so that we can allow users to click on the item to learn more with Google's state of the art Gemini 2.5 Pro Preview model grounded with Google Search.

Accomplishments that we're proud of

Prompt engineering Google Gemini to be able to generate a new image of the final room while keeping the background of the existing image intact.

What we learned

Google's AI Studio features such as branching and reruns made testing new prompts extremely easy. This definitely improved our developer experience.

What's next for Gemdazzle

We want to fine tune Google Gemini 1.5 Flash Tuning to make our 3D generations more accurate. Unfortunately, we didn't have time to finish this feature during the hackathon.