Echo XR

• 

• 

  Gaussian Splat example

• 

  Photogrammetry example

• 

  Editor to create your 'echo'

Inspiration

With the optimisation of gaussian splatting seen in Meta's hyperscans and the Scaniverse app, along with the proliferation of 3D scans taken with mobile phones with apps such as Poly Cam, this allows people to share and view 3D environments and objects, but I am yet to see anyone do anything with these scans, apart from provide a way to view them.

Echo XR aims to change that, by allowing users to tell stories with their assets.

What it does

Echo XR is a story telling app. Allowing you to string together multiple scenes overlaid with sound captured in the moment and your spoken narrative, to create immersive stories that can be shared with others.

To get a better impression as to what Echo XR is, please view the supplementary, longer video showcasing the editor and a full 'echo' here

How we built it

The project was created using Shapes XR to display scans downloaded from Poly Cam and ai audio narration created using ttsopenai, additional screen recordings from Scaniverse were used to show how gaussian splats can be used instead of photogrammetry scans.

Challenges we ran into

I struggled getting 3D scans into Shapes XR and realised too late that I could have reduced the size of the scans further before uploading to Shapes XR as it struggled with the high file sizes/ many vertices. This idea is really shown as a concept so the biggest challenge was finding assets that would allow me to tell a story as examples for the application. You can visit the Shapes XR space (328DW6D5).

Accomplishments that we're proud of

I am happy with the core concept and I am happy with how the trailer turned out, although I prefer the longer video which gives a better impression of the application and showcases the editor as well as a finished 'Echo'.

What we learned

I was using Shapes XR for the first time during this project, I found it useful and intuitive. I was happy with how quickly I could get my idea realised.

What's next for Echo XR

I imagine this as a platform that people can upload their own creations and share with others. I intend to flesh out this idea by creating a prototype using gaussian splats in Unity.

Built With

• polycam
• scaniverse
• shapesxr
• ttsopenai