"Imagine this – a mixed reality app that brings your memories to life. It's as simple as touching a physical object, and bam! Virtual content like photos, videos, and 3D scenes pop up.
No more boring photo albums or mundane scrolling. We're talking about a whole new way of editing, viewing, and reliving your best memories. It's an experience that goes beyond just seeing pictures; it's about feeling the emotions, hearing the sounds, and diving into a fully immersive journey through time.
So, join us on this ride, where every touch unveils a world of memories waiting to be rediscovered. Our team invites you to explore the limitless possibilities of our mixed reality app – because your memories deserve more than just a glance. Let's make every moment unforgettable!"
Inspiration
Our team shared a vision of collaborative collage creation in the future, and we want to develop an idea that all these parts of the experience like audio, photos, videos, and 3D scenes will be connected together. so the users can see the world they have visited before in a more wholesome way than simply photos.
What it does
It lets you click on one object and generate a related experience based on that object. Our example use case we prepared is to click on the RealityHack name card, and then multiple memories including photos, videos, and a 3D reconstruction scene related to this hack event will pop into the world. You can drag to see these memories, and you can also enter the 3D recon scene with a simple touch.
How we built it
We use Meta Presence Platform and Quest 3 to leverage the mixed reality potential. We lost one of our teammates unfortunately at the beginning, but we, two developers and two designers on board, completed the development in time.
We expedited asset design using Meshy, a 3D AI Generator. Scaniverse is used to scan in a physical space for a virtual scene.
Challenges we ran into
We run into technical challenges with the new SDK a lot. Many implementations and API calls work some of the time and fail some of the time, and with little documentation, it is hard to make quick changes in time. We tried to hack our way through these interactions with SDK and building blocks in Unity with some good and old collider methods.
Accomplishments that we're proud of
We made it! We made an app where we could achieve what we hoped for initially, and we are especially proud of our transition from MR to VR and then back to MR with a few simple hand gestures.
What we learned
We learned a lot about Meta's presence platform and its SDK, especially on the interaction part, which is one essence of our application. Besides development, we also learned how to hack a project in a very short period of time and to manage the project in a timely fashion.
What's next for Collage MR
We accomplished 75% of what we were hoping for at the beginning, and the next thing for our project is to further push the interaction part to support more gestures and make UX better. We also like to implement the input part where users can put the things they want into the app, instead of experiencing a example we have for this hackathon.
Log in or sign up for Devpost to join the conversation.