What it does

  • can detect "driving a car" gesture
  • can detect "flying a plane" gesture
  • can detect "shooting sideways" gesture
  • can take input from brake/accelerator pedal connected via Arduino
  • displays Grand Theft Auto V in stereoscopic 3D

How we built it

  • LeapMotion controllers for gesture control
  • Oculus Rift DK2 for virtual reality
  • Arduino for accelerator/brake pedals
  • C++ for the glue

Challenges we ran into

  • Reverse-engineering GTAV's API was more work than anticipated
  • Lack of experience in C++ was a stumbling block

Accomplishments that I'm proud of

  • Came into HackGSU knowing 0 C++. Now I know a little C++.
  • Figured out how to actually use the Oculus DK2

What's next for GTAV-Motion

  • Still need to connect the gestures to the game.
  • Myo support for running/walking control.

Built With

Share this project:

Updates