Augment Aisle

Transforming In-Person shopping using Mixed Reality.

Comment

Lambda has recognized our project to be the best use of their platform at this Hackathon. We thank Lambda for their recognition!

2 minute video linked here :- https://youtu.be/0z3IBSuEd_4

Demo of the POC linked here :- https://youtube.com/shorts/tDTnVRFHKZc

Wrist Mounted UI POC linked here :- https://drive.google.com/file/d/1RlPcq-O0i1dS9nfKuRdT7WkDQmiMhZ9e/view?usp=sharing

Description of our work

Inspired by the idea of enhancing the in-person shopping experience, Augment Aisle uses mixed reality to revolutionize retail engagement. It aims to improve customer journeys and drive higher conversions with immersive AR technology.

Why we did it

Research shows that 80% of shoppers in the U.S. use a mobile phone inside a physical store for various tasks. Source. They primarily use their phones to look for various information sources, such as Price Comparison, Discounts and Offers, Product Information, Reviews, Store Navigation, Loyalty Programs, etc.

What it does

Augmented Aisle enhances in-person shopping experience by providing interactive, real-time information using augmented and mixed reality. It helps retail stores boost customer engagement and improve decision-making.

How we built it

We developed Augment Aisle using Unity and deployed it to the Quest 3 headset. The project leverages cutting-edge AR capabilities to deliver an immersive shopping experience.

Challenges we ran into

One of the biggest challenges we faced was managing the scope of the project for our MVP. We focused on balancing innovation with practical implementation within our timeline.

Accomplishments that we're proud of

We are proud of the project's potential to revolutionize in-person shopping with immersive technology. Our successful integration of Artificial Intelligence and Spatial Anchors is a significant achievement.

We also successfully integrated Unity with Lambda AI's Inference API to power our AI assistant, which has not been done before by anyone to our knowledge.

We also don't use Whisper for Speech to Text; instead, we use a free solution provided by Meta's Voice SDK, which saves money on AI API usage. Thus, we could say we are the most economical solution out there for AI-AR / Augmented Intelligence experiences without sacrificing quality.

What we learned

We gained valuable insights into optimizing AR experiences for retail environments. Additionally, we learned how to leverage AI and spatial technology effectively for real-world applications.

What's next for Augment Aisle

Our next step is to gather user feedback to assess interest and refine our product. Based on this input, we will explore opportunities for further development and market expansion. We could also power up our AI assistant by using multimodal inputs and outputs from other vendors.

Built With

Share this project:

Updates