• 

  The scene in Unity

• 

  You can see an entire 3D enviromenet we created, or use your own

• 

  Start recording by doing an ok/pinch gesture

• 

  User in an AR headset puppeteering an avatar in a virtual set

• 

  Moving the camera and view finder in experience to modify the camera angle which is output. The camera has a cute face so you look at it

• 

  Smashing that subscribe button to celebrate with an airhorn and blast some confetti in the room

Inspiration

Mikko’s brother is a Youtuber by profession. He likes to evangelize everyone telling them to start publishing content on Youtube since it’s changed his life. This is hard since the cost to create quality videos is high. To create quality videos you require a DSLR Camera, Lighting, and Locations to film in. We hope that AR and VR could possibly democratize video creation by giving people the option to create videos entirely virtually solving the need to have a camera, lighting, or location. People who live in small rooms in expensive cities can now have enough virtual space to make professional videos. We also hope that this new medium which can have a high level of anonymity can give people a voice to communicate. For instance product reviews created with our application could have a higher level of truth compared to the often rosey reviews posted to Youtube. Also by giving users the ability to choose their virtual avatar they can embody a character which is more representative of who they identify with.

How we built it

We built and designed all the 3D assets in our scene, working from Solidworks to Blender to Unity. We iterated using GitHub and Unity, getting the basic interactions right and then working on details like set design. We implemented custom code to record and playback scenes. In our application we had to create logic to solve for hand orientation for the Magic Leap.

What we learned

• Since we’re not bound by physical limitations we can use a human like face as a camera which is more approachable than the typical form factor of a camera
• Hand tracking can be a bit limiting for the actor since the hands need to be in view of the AR headset
• Many learnings about the Magic Leap Tool Chain and how Magic Leap works
• How to create assets for VR and to optimize these assets to run in lightweight headsets

Challenges we faced

• Beyond tracking key points for hands Magic Leap does not return rotational information for hand tracking. A large portion of time was spent implementing this functionality
• Many members were using software that was not their specialty, and spent time learning Unity, Blender, and Git

Built With

• augmented-reality
• blender
• c#
• magicleap
• solidworks
• unity