lore ai | Devpost

Inspiration

We wanted to rethink how people interact with physical spaces when they aren't physically together. Today, designing a room or planning an event usually means sending photos, sketches, links, and messages back and forth. We wondered: what if everyone could actually step into the same digital version of the room and design it together? That led us to build a collaborative spatial experience where a real room becomes a shared 3D environment. One person can view and manipulate the space through AR while friends remotely edit the same room in 3D. Changes made by one person instantly appear for everyone else. We were especially inspired by the idea that AI could do more than decorate a room—it could help a group turn a space into an experience, whether that's a party, movie night, gaming setup, study space, or other event.

What it does

Our app transforms a physical room into a shared digital twin that multiple people can collaboratively modify. Users scan their room and create a 3D representation of the space. They can then invite friends to join the same environment remotely. One user can interact with the room through AR on their phone, while another can explore and edit the same space through a 3D interface. When someone moves, adds, or removes an object, the change is synchronized across everyone's views in real time. AI helps users plan the space based on their goals and constraints. For example, a user can ask the system to turn their room into a party space for 15 people while staying within a certain budget. The AI can suggest layouts, decorations, seating, and other changes while taking the existing room into account.

How we built it

We built the experience around a shared 3D representation of the room. The room is represented as a collection of spatial objects with properties such as position, rotation, scale, and type. A real-time synchronization layer keeps this shared scene consistent between users. For the AR experience, we use the phone's camera and spatial tracking to anchor virtual objects to the physical room. The remote interface renders the same scene as an interactive 3D environment. Our AI layer interprets natural-language requests such as event type, number of guests, preferences, and budget, then translates those requirements into spatial changes and recommendations.

Challenges we ran into

One of our biggest challenges was keeping the physical AR environment and the remote 3D environment synchronized. A change that looks simple in a 3D scene has to be represented consistently in the real world, including object positions, rotations, and spatial relationships. We also had to think carefully about how to represent a room without attempting to build an unnecessarily complex or photorealistic reconstruction. We focused on creating a lightweight spatial representation that preserves the information necessary for collaboration and AR. Another challenge was making AI-generated layouts useful rather than simply visually appealing. A good layout needs to account for real constraints such as available space, existing furniture, walking paths, number of people, and budget.

Accomplishments that we're proud of

We're proud that we created a system where two people can interact with the same physical space from different interfaces. The most exciting part is seeing an object move in the remote 3D environment and immediately seeing that change reflected in AR. This turns the room into a shared environment rather than just an image or visualization.

What we learned

t is relatively easy to imagine an AI placing a couch in a room. The harder and more interesting problem is helping multiple people decide where that couch should go, understanding why they disagree, and letting everyone experience the result in the same shared space. We also learned that a successful spatial experience doesn't necessarily require a photorealistic digital twin. A lightweight but interactive representation can be more useful when the goal is collaboration.

What's next for lore ai

We want to make the shared spatial environment more immersive and intelligent. Our next steps include improving room reconstruction, supporting more types of AR and VR devices, and making remote users feel more physically present in the room. We also want to give each participant an AI assistant that understands their individual preferences and can help the group find compromises when they disagree about a layout.