Delivery Dash

An AR game, similar to subway surfer and temple run in spirit, but using pinch gesture to control the toddler.

Comment

Inspiration

We first intended on using the Spectacles and ML a model to classify trashes as organic, electronic, recyclable and so on. However, for privacy and security reasons, that feature is currently disabled programmatically. So after spending more than half our Hacking time building it, we had to come up with something else, and just thought of what could be fun using the technology we know already are going to work, so we came up with delivery dash

What it does

An augmented reality game where you can pickup and move the character directly to dodge obstacles and get as many coins as possible.

How we built it

The 3D models of the objects and surrounding setup were done in Lens Studio, which connects to the Spectacles device's lens. TweenTransform was used for looping and bouncing motions of each object. Lens Studio's hand gesture recognition was employed to pick up and move the driver as needed. JavaScript was used to detect collisions between the driver, obstacles, and coins. Also using JavaScript we've set up the random obstacles and coins to come out in random x coordinate.

Challenges we ran into

One major challenge was pivoting our project halfway through. Initially, we planned to use the Spectacles device to capture screenshots of objects and use a ML model to determine their recyclability. However, we discovered that the Spectacles cannot capture or save images of the outer environment, requiring us to change direction. Putting the motion on the environmental objects to make it looks like the driver (user) is actually moving was challenging. It was hard to position the object in right coordinate and make a loop that keeps the motion going while the game’s being played. Detecting the collision between the driver and objects was the most challenging part that we then changed to JavaScript.

Wha we learned

  • understanding Object type from lens studio is key-point for fast development

    @component
export class GameLogic extends BaseScriptComponent {

@input 
coinMaterial: ObjectPrefab;

  • how to interact with Lens Studio environment

  • Spatial Design Fundamentals

  • Structure of a Lens app

  • Spectacles Interaction Kit

  • Understand their Camera Module

  • How to use their Pinch Gestures API

  • Their Extended Permissions to access Camera Frame and send Http request.

What's next for.

From here, we could incorporate more dimensions of movement to make it an experience completely unique to AR, giving the player a 3-dimensional challenge opposed to the classic 2-D games that have come before. It's a proof of concept for a future of more spatially-challenging games than we've ever experienced.

Built With

Share this project:

Updates