HackedVision | Devpost

First, lets give the appropriate credits for the base of the project:

Federico Mammano - Looking Through the Oculus Rift - Augmented Reality, Virtual Reality and Gesture Interaction

Inspiration

The whole idea was to learn how to use the Oculus Rift with some motion detection technology. Inspired on SciFi movies (such as Iron Man) I decided to try to put screens projected on my vision in order to have multiple information available wherever you look - just like holograms, but in your mind.

What it does

Hacked Vision is a Augmented Reality (AR) project where you can see the display of your computer on the top of your vision. You can also move the position of that AR floating screen with hand gestures. The main idea is to be have useful information on your vision range while you perform a task.

How I built it

I used an Oculus Rift and a Leap Motion Detection device as hardware for this project. For software, I have used the DirectX11 libraries, as well as OpenCV, everything with C++. I started by taking a look at some examples included with the Oculus SDK and by searching for other projects that used cameras and Oculus Rifts online. After some time learning how to merge everything, I got my project working.

Challenges I ran into

It was pretty hard to run the Oculus Rift examples on my computer. Even the smallest examples were pretty big. Another challenge was learning how to play with DirectX, something I have never done.

Accomplishments that I'm proud of

I did not think I would be able to make an Augmented Reality application in such a short time. It was something I ALWAYS DREAMED OF DOING. (In fact, I wanted to do a project like this when I was 16 - when I was learning how to write very basic code - how naive)

What I learned

DirectX11 A little bit of Linear Algebra
Detecting motion with Leap
Interacting with Oculus Rift
Interacting with Multiple Cameras
That Augmented Reality is awesome!!!!!

What's next for HackedVision

Hardware-wise, I would get two cameras for the eyes - not just one. This would improve the vision. I would also want the user to touch in the real world the place he wanted the screen to stay instead of dragging it around. It would be more useful for tasks.